2024-09-15T21:59:44.247 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T21:59:44.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T21:59:44.375 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906235 branch: squid description: fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_dbench traceless/50pc} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906235' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds inject traceless reply probability: 0.5 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8921c8ef947807b717db041d85f0761b7914d5fc ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPYlxwtR2lI2nS85B+DI2Ja+NV2fvU/dsxVHwdckonh0smQpGd/z+8PikuOTCyP6vW4MOZSi9mKRNxI7+MdUmIg= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDo1Bvr7jjXuQG79OyB6kNbP2DMkkFY+tRHgTLVtQDbWYLeff7lngVKw8ATUuznsCUBnZUUcTmw06fVRtEpYTwk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T21:59:44.376 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-15T21:59:44.377 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-15T21:59:44.377 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T21:59:44.378 INFO:teuthology.task.internal:Checking packages... 2024-09-15T21:59:44.401 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-15T21:59:44.401 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T21:59:44.401 INFO:teuthology.packaging:ref: None 2024-09-15T21:59:44.401 INFO:teuthology.packaging:tag: None 2024-09-15T21:59:44.401 INFO:teuthology.packaging:branch: squid 2024-09-15T21:59:44.401 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T21:59:44.402 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-15T21:59:44.604 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-326.g8921c8ef 2024-09-15T21:59:44.606 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T21:59:44.614 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T21:59:44.615 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T21:59:44.622 INFO:teuthology.task.internal:Saving configuration 2024-09-15T21:59:44.638 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T21:59:44.646 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T21:59:44.668 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906235', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 21:54:51.001499', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPYlxwtR2lI2nS85B+DI2Ja+NV2fvU/dsxVHwdckonh0smQpGd/z+8PikuOTCyP6vW4MOZSi9mKRNxI7+MdUmIg='} 2024-09-15T21:59:44.693 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906235', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 21:54:50.999384', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDo1Bvr7jjXuQG79OyB6kNbP2DMkkFY+tRHgTLVtQDbWYLeff7lngVKw8ATUuznsCUBnZUUcTmw06fVRtEpYTwk='} 2024-09-15T21:59:44.693 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T21:59:44.699 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-15T21:59:44.699 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-15T21:59:44.699 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T21:59:44.752 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8ec5fd7be0>, signals=[15]) 2024-09-15T21:59:44.752 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T21:59:44.760 INFO:teuthology.task.internal:Opening connections... 2024-09-15T21:59:44.760 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2024-09-15T21:59:44.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:59:44.838 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-09-15T21:59:44.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:59:44.914 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T21:59:44.920 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-09-15T21:59:44.938 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-09-15T21:59:44.939 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-09-15T21:59:44.997 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2024-09-15T21:59:44.997 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9" 2024-09-15T21:59:44.997 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2024-09-15T21:59:44.997 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2024-09-15T21:59:44.997 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9" 2024-09-15T21:59:44.997 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9" 2024-09-15T21:59:44.997 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T21:59:44.997 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2024-09-15T21:59:44.997 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon" 2024-09-15T21:59:44.997 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T21:59:44.998 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2024-09-15T21:59:44.998 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T21:59:44.998 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T21:59:44.998 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T21:59:44.998 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-09-15T21:59:45.022 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-09-15T21:59:45.041 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-09-15T21:59:45.041 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-09-15T21:59:45.099 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-09-15T21:59:45.100 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-09-15T21:59:45.100 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-09-15T21:59:45.100 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-09-15T21:59:45.100 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-09-15T21:59:45.100 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-09-15T21:59:45.100 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T21:59:45.100 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-09-15T21:59:45.100 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-09-15T21:59:45.100 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T21:59:45.100 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-09-15T21:59:45.100 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T21:59:45.101 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T21:59:45.101 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T21:59:45.101 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-09-15T21:59:45.122 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T21:59:45.130 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T21:59:45.174 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T21:59:45.174 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2024-09-15T21:59:45.176 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-09-15T21:59:45.193 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T21:59:45.198 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T21:59:45.199 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2024-09-15T21:59:45.234 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-09-15T21:59:45.345 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T21:59:45.396 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T21:59:45.410 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-15T21:59:45.410 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-15T21:59:45.411 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T21:59:45.411 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T21:59:45.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:59:45.428 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-15T21:59:45.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:59:45.429 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-09-15T21:59:45.486 INFO:teuthology.orchestra.run.smithi078.stdout:5.14.0-503.el9.x86_64 2024-09-15T21:59:45.486 INFO:teuthology.task.kernel:Running kernel on smithi078: 5.14.0-503.el9.x86_64 2024-09-15T21:59:45.486 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum install -y kernel 2024-09-15T21:59:45.487 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-503.el9.x86_64 2024-09-15T21:59:45.488 INFO:teuthology.task.kernel:Running kernel on smithi175: 5.14.0-503.el9.x86_64 2024-09-15T21:59:45.488 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum install -y kernel 2024-09-15T21:59:47.676 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-15T21:59:47.900 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-15T21:59:52.242 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 20 MB 00:03 2024-09-15T21:59:53.419 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-15T21:59:57.709 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-15T21:59:57.761 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-15T21:59:59.301 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 19 kB 00:00 2024-09-15T21:59:59.370 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-15T22:00:00.538 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-15T22:00:00.675 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-15T22:00:05.969 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-15T22:00:06.097 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-15T22:00:07.984 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T22:00:07.984 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T22:00:08.084 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-15T22:00:08.092 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-15T22:00:08.092 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-09-15T22:00:08.092 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-15T22:00:08.093 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-15T22:00:08.093 INFO:teuthology.orchestra.run.smithi175.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T22:00:08.093 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-15T22:00:08.093 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T22:00:08.093 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T22:00:08.093 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T22:00:08.093 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:00:08.093 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-15T22:00:08.093 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-15T22:00:08.093 INFO:teuthology.orchestra.run.smithi175.stdout:Install 4 Packages 2024-09-15T22:00:08.093 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:00:08.094 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 79 M 2024-09-15T22:00:08.094 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 126 M 2024-09-15T22:00:08.094 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-15T22:00:08.120 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T22:00:08.120 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T22:00:08.215 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-15T22:00:08.226 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-15T22:00:08.226 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2024-09-15T22:00:08.226 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-15T22:00:08.226 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-15T22:00:08.226 INFO:teuthology.orchestra.run.smithi078.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T22:00:08.226 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-15T22:00:08.226 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T22:00:08.226 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T22:00:08.226 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T22:00:08.227 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:00:08.227 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-15T22:00:08.227 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-15T22:00:08.227 INFO:teuthology.orchestra.run.smithi078.stdout:Install 4 Packages 2024-09-15T22:00:08.227 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:00:08.227 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 79 M 2024-09-15T22:00:08.227 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 126 M 2024-09-15T22:00:08.228 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-15T22:00:08.312 INFO:teuthology.orchestra.run.smithi175.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 250 kB/s | 23 kB 00:00 2024-09-15T22:00:08.449 INFO:teuthology.orchestra.run.smithi078.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 233 kB/s | 23 kB 00:00 2024-09-15T22:00:08.629 INFO:teuthology.orchestra.run.smithi175.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-09-15T22:00:08.899 INFO:teuthology.orchestra.run.smithi078.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-15T22:00:09.096 INFO:teuthology.orchestra.run.smithi175.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 36 MB/s | 29 MB 00:00 2024-09-15T22:00:09.299 INFO:teuthology.orchestra.run.smithi078.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 34 MB/s | 29 MB 00:00 2024-09-15T22:00:09.600 INFO:teuthology.orchestra.run.smithi078.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 28 MB/s | 35 MB 00:01 2024-09-15T22:00:09.600 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:00:09.600 INFO:teuthology.orchestra.run.smithi078.stdout:Total 57 MB/s | 79 MB 00:01 2024-09-15T22:00:09.687 INFO:teuthology.orchestra.run.smithi175.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 24 MB/s | 35 MB 00:01 2024-09-15T22:00:09.688 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:00:09.688 INFO:teuthology.orchestra.run.smithi175.stdout:Total 49 MB/s | 79 MB 00:01 2024-09-15T22:00:10.283 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-15T22:00:10.365 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-15T22:00:10.658 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-15T22:00:10.658 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-15T22:00:10.735 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-15T22:00:10.735 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-15T22:00:11.619 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-15T22:00:11.619 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-15T22:00:11.712 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-15T22:00:11.713 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-15T22:00:14.055 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-15T22:00:14.159 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-15T22:00:14.787 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:00:14.826 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:00:14.878 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:00:14.909 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:00:17.687 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:00:17.733 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:00:17.823 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:00:17.863 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:00:22.661 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:00:22.693 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:00:22.730 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:00:22.814 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:00:27.542 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:00:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:01:05.993 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:01:06.033 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:01:06.055 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:01:06.095 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:01:06.429 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:01:06.429 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:01:06.429 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:01:06.429 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:01:06.446 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:01:06.446 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:01:06.446 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:01:06.446 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:01:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:01:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:01:07.264 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-15T22:01:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T22:01:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T22:01:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T22:01:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T22:01:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:01:07.264 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-15T22:01:07.269 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:01:07.269 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:01:07.269 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-15T22:01:07.269 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T22:01:07.269 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T22:01:07.269 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T22:01:07.269 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T22:01:07.269 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:01:07.270 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-15T22:01:07.633 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:01:07.665 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:01:07.711 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:01:07.711 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:01:07.711 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T22:01:07.711 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T22:01:07.711 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T22:01:07.711 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-15T22:01:07.712 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi175.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T22:01:07.712 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:01:07.735 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:01:07.735 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:01:07.735 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T22:01:07.736 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T22:01:07.736 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T22:01:07.736 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-15T22:01:07.736 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T22:01:07.736 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:01:07.772 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:01:07.772 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:01:07.773 DEBUG:teuthology.orchestra.run.smithi175:> sudo rpm -qi grub2-tools 2024-09-15T22:01:07.794 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:01:07.795 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:01:07.795 DEBUG:teuthology.orchestra.run.smithi078:> sudo rpm -qi grub2-tools 2024-09-15T22:01:07.807 INFO:teuthology.orchestra.run.smithi175.stdout:Name : grub2-tools 2024-09-15T22:01:07.807 INFO:teuthology.orchestra.run.smithi175.stdout:Epoch : 1 2024-09-15T22:01:07.807 INFO:teuthology.orchestra.run.smithi175.stdout:Version : 2.06 2024-09-15T22:01:07.807 INFO:teuthology.orchestra.run.smithi175.stdout:Release : 82.el9 2024-09-15T22:01:07.807 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: x86_64 2024-09-15T22:01:07.807 INFO:teuthology.orchestra.run.smithi175.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T22:01:07.808 INFO:teuthology.orchestra.run.smithi175.stdout:Group : Unspecified 2024-09-15T22:01:07.808 INFO:teuthology.orchestra.run.smithi175.stdout:Size : 8274670 2024-09-15T22:01:07.808 INFO:teuthology.orchestra.run.smithi175.stdout:License : GPLv3+ 2024-09-15T22:01:07.808 INFO:teuthology.orchestra.run.smithi175.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T22:01:07.808 INFO:teuthology.orchestra.run.smithi175.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T22:01:07.808 INFO:teuthology.orchestra.run.smithi175.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T22:01:07.808 INFO:teuthology.orchestra.run.smithi175.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T22:01:07.808 INFO:teuthology.orchestra.run.smithi175.stdout:Packager : builder@centos.org 2024-09-15T22:01:07.808 INFO:teuthology.orchestra.run.smithi175.stdout:Vendor : CentOS 2024-09-15T22:01:07.808 INFO:teuthology.orchestra.run.smithi175.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T22:01:07.808 INFO:teuthology.orchestra.run.smithi175.stdout:Summary : Support tools for GRUB. 2024-09-15T22:01:07.808 INFO:teuthology.orchestra.run.smithi175.stdout:Description : 2024-09-15T22:01:07.809 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:01:07.809 INFO:teuthology.orchestra.run.smithi175.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T22:01:07.809 INFO:teuthology.orchestra.run.smithi175.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T22:01:07.809 INFO:teuthology.orchestra.run.smithi175.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T22:01:07.809 INFO:teuthology.orchestra.run.smithi175.stdout:hardware devices. 2024-09-15T22:01:07.809 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:01:07.809 INFO:teuthology.orchestra.run.smithi175.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T22:01:07.810 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T22:01:07.810 INFO:teuthology.task.kernel:Updating grub on smithi175 to boot 5.14.0-505.el9.x86_64 2024-09-15T22:01:07.810 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T22:01:07.837 INFO:teuthology.orchestra.run.smithi078.stdout:Name : grub2-tools 2024-09-15T22:01:07.837 INFO:teuthology.orchestra.run.smithi078.stdout:Epoch : 1 2024-09-15T22:01:07.837 INFO:teuthology.orchestra.run.smithi078.stdout:Version : 2.06 2024-09-15T22:01:07.837 INFO:teuthology.orchestra.run.smithi078.stdout:Release : 82.el9 2024-09-15T22:01:07.837 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: x86_64 2024-09-15T22:01:07.837 INFO:teuthology.orchestra.run.smithi078.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T22:01:07.837 INFO:teuthology.orchestra.run.smithi078.stdout:Group : Unspecified 2024-09-15T22:01:07.838 INFO:teuthology.orchestra.run.smithi078.stdout:Size : 8274670 2024-09-15T22:01:07.838 INFO:teuthology.orchestra.run.smithi078.stdout:License : GPLv3+ 2024-09-15T22:01:07.838 INFO:teuthology.orchestra.run.smithi078.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T22:01:07.838 INFO:teuthology.orchestra.run.smithi078.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T22:01:07.838 INFO:teuthology.orchestra.run.smithi078.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T22:01:07.838 INFO:teuthology.orchestra.run.smithi078.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T22:01:07.838 INFO:teuthology.orchestra.run.smithi078.stdout:Packager : builder@centos.org 2024-09-15T22:01:07.838 INFO:teuthology.orchestra.run.smithi078.stdout:Vendor : CentOS 2024-09-15T22:01:07.838 INFO:teuthology.orchestra.run.smithi078.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T22:01:07.838 INFO:teuthology.orchestra.run.smithi078.stdout:Summary : Support tools for GRUB. 2024-09-15T22:01:07.838 INFO:teuthology.orchestra.run.smithi078.stdout:Description : 2024-09-15T22:01:07.838 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:01:07.838 INFO:teuthology.orchestra.run.smithi078.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T22:01:07.838 INFO:teuthology.orchestra.run.smithi078.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T22:01:07.839 INFO:teuthology.orchestra.run.smithi078.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T22:01:07.839 INFO:teuthology.orchestra.run.smithi078.stdout:hardware devices. 2024-09-15T22:01:07.839 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:01:07.839 INFO:teuthology.orchestra.run.smithi078.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T22:01:07.840 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T22:01:07.840 INFO:teuthology.task.kernel:Updating grub on smithi078 to boot 5.14.0-505.el9.x86_64 2024-09-15T22:01:07.840 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T22:01:08.493 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2024-09-15T22:01:08.538 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2024-09-15T22:01:09.863 INFO:teuthology.orchestra.run.smithi175.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T22:01:09.874 INFO:teuthology.orchestra.run.smithi078.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T22:01:09.895 INFO:teuthology.orchestra.run.smithi175.stderr:done 2024-09-15T22:01:09.898 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-09-15T22:01:09.915 INFO:teuthology.orchestra.run.smithi078.stderr:done 2024-09-15T22:01:09.917 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.ncddJcDQnM 2024-09-15T22:01:09.917 DEBUG:teuthology.orchestra.run.smithi175:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ncddJcDQnM 2024-09-15T22:01:09.919 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-15T22:01:09.934 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.uOL1qMPxZF 2024-09-15T22:01:09.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uOL1qMPxZF 2024-09-15T22:01:09.984 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.ncddJcDQnM 2024-09-15T22:01:10.006 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.uOL1qMPxZF 2024-09-15T22:01:10.132 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.ncddJcDQnM is 6KB 2024-09-15T22:01:10.151 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.uOL1qMPxZF is 6KB 2024-09-15T22:01:10.180 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.ncddJcDQnM 2024-09-15T22:01:10.196 DEBUG:teuthology.orchestra.run.smithi175:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T22:01:10.200 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.uOL1qMPxZF 2024-09-15T22:01:10.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T22:01:10.258 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T22:01:10.258 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T22:01:10.259 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T22:01:10.259 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T22:01:10.260 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T22:01:10.278 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T22:01:10.278 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T22:01:10.278 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T22:01:10.278 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T22:01:10.280 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T22:01:10.407 DEBUG:teuthology.orchestra.run.smithi175:> sudo shutdown -r now 2024-09-15T22:01:10.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2024-09-15T22:01:40.440 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-15T22:01:40.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-15T22:01:40.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:01:40.443 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-15T22:01:40.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-15T22:01:40.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:02:40.505 DEBUG:teuthology.orchestra.remote:timed out 2024-09-15T22:02:40.505 DEBUG:teuthology.orchestra.remote:timed out 2024-09-15T22:02:49.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-15T22:02:49.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:02:49.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-15T22:02:49.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:02:49.911 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-09-15T22:02:49.932 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-15T22:02:50.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-15T22:02:50.252 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-15T22:02:50.252 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-09-15T22:02:50.267 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-505.el9.x86_64 2024-09-15T22:02:50.267 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T22:02:50.267 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T22:02:50.267 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T22:02:50.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-15T22:02:50.286 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-15T22:02:50.286 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-15T22:02:50.300 INFO:teuthology.orchestra.run.smithi078.stdout:5.14.0-505.el9.x86_64 2024-09-15T22:02:50.301 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T22:02:50.301 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T22:02:50.301 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T22:02:51.268 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-15T22:02:51.268 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T22:02:51.302 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-15T22:02:51.302 DEBUG:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T22:02:51.388 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2024-09-15T22:02:51.390 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2024-09-15T22:02:51.407 DEBUG:teuthology.parallel:result is None 2024-09-15T22:02:51.412 DEBUG:teuthology.parallel:result is None 2024-09-15T22:02:51.412 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T22:02:51.422 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T22:02:51.422 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:02:51.425 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:02:51.439 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T22:02:51.446 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T22:02:51.451 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T22:02:51.451 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:02:51.477 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:02:51.497 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T22:02:51.504 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T22:02:51.504 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:02:51.530 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:02:51.559 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:02:51.566 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:02:51.568 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:02:51.576 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:02:51.578 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T22:02:51.587 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T22:02:51.587 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:02:51.610 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:02:51.639 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T22:02:51.647 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T22:02:51.647 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:02:51.671 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:02:51.690 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:02:51.766 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:02:51.801 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:02:51.881 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:02:51.916 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:02:51.916 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:02:51.981 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:02:52.023 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:02:52.063 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:02:52.143 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:02:52.179 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:02:52.179 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:02:52.240 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2024-09-15T22:02:52.242 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-09-15T22:02:52.289 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:02:52.322 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:02:52.792 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T22:02:52.800 INFO:teuthology.task.internal:Starting timer... 2024-09-15T22:02:52.800 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T22:02:52.809 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T22:02:52.818 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-15T22:02:52.818 DEBUG:teuthology.orchestra.run.smithi078:> sudo service auditd rotate 2024-09-15T22:02:52.917 INFO:teuthology.orchestra.run.smithi078.stdout:Rotating logs: 2024-09-15T22:02:52.919 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2024-09-15T22:02:52.997 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2024-09-15T22:02:52.999 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T22:02:52.999 DEBUG:teuthology.orchestra.run.smithi078:> /usr/sbin/getenforce 2024-09-15T22:02:53.033 INFO:teuthology.orchestra.run.smithi078.stdout:Permissive 2024-09-15T22:02:53.033 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2024-09-15T22:02:53.058 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2024-09-15T22:02:53.058 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi078.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2024-09-15T22:02:53.059 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:02:53.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:02:53.099 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:02:53.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:02:53.124 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T22:02:53.124 DEBUG:teuthology.orchestra.run.smithi078:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:02:53.180 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:02:53.215 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T22:02:53.225 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-15T22:02:53.228 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-15T22:02:53.353 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T22:02:53.365 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T22:02:53.365 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T22:06:35.467 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-09-15T22:06:35.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-15T22:06:35.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:06:35.545 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-15T22:06:35.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-15T22:06:35.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-15T22:06:35.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:06:35.707 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-09-15T22:06:35.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-15T22:06:35.792 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T22:06:35.806 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T22:06:35.806 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:06:35.807 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:06:35.809 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:06:35.809 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:06:35.835 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:06:35.849 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:06:35.862 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:06:35.872 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: ntpd: command not found 2024-09-15T22:06:35.876 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:06:35.883 INFO:teuthology.orchestra.run.smithi078.stdout:506 Cannot talk to daemon 2024-09-15T22:06:35.897 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:06:35.900 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2024-09-15T22:06:35.911 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2024-09-15T22:06:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:06:35.925 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:06:35.939 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:06:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:06:35.978 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:06:35.978 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-09-15T22:06:35.979 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:06:35.979 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:06:35.979 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:06:35.979 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:06:35.996 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:06:36.000 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:06:36.000 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-09-15T22:06:36.001 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:06:36.001 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:06:36.001 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:06:36.001 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:06:36.002 INFO:teuthology.run_tasks:Running task install... 2024-09-15T22:06:36.009 DEBUG:teuthology.task.install:project ceph 2024-09-15T22:06:36.010 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-15T22:06:36.010 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-15T22:06:36.010 INFO:teuthology.task.install:Using flavor: default 2024-09-15T22:06:36.015 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T22:06:36.015 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-15T22:06:36.016 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:06:36.016 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:06:36.018 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:06:36.018 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:06:36.153 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:06:36.153 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:06:36.163 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:06:36.163 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:06:36.263 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:06:36.263 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:06:36.263 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:06:36.276 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:06:36.276 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:06:36.276 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:06:36.289 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:06:36.289 DEBUG:teuthology.orchestra.run.smithi078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:06:36.302 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:06:36.302 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:06:36.354 DEBUG:teuthology.orchestra.run.smithi078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:06:36.368 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:06:36.429 DEBUG:teuthology.orchestra.run.smithi078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:06:36.442 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:06:36.493 INFO:teuthology.orchestra.run.smithi078.stdout:check_obsoletes = 1 2024-09-15T22:06:36.495 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum clean all 2024-09-15T22:06:36.506 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2024-09-15T22:06:36.508 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2024-09-15T22:06:36.726 INFO:teuthology.orchestra.run.smithi078.stdout:45 files removed 2024-09-15T22:06:36.734 INFO:teuthology.orchestra.run.smithi175.stdout:45 files removed 2024-09-15T22:06:36.754 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:06:36.761 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:06:37.338 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 286 kB/s | 83 kB 00:00 2024-09-15T22:06:37.433 INFO:teuthology.orchestra.run.smithi078.stdout:ceph packages for x86_64 211 kB/s | 83 kB 00:00 2024-09-15T22:06:37.622 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-15T22:06:37.730 INFO:teuthology.orchestra.run.smithi078.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-15T22:06:37.898 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-15T22:06:37.997 INFO:teuthology.orchestra.run.smithi078.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-15T22:06:39.556 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.2 MB 00:01 2024-09-15T22:06:39.890 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.2 MB 00:01 2024-09-15T22:06:42.732 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 20 MB 00:02 2024-09-15T22:06:45.474 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-15T22:06:47.974 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-15T22:06:49.608 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-15T22:06:49.783 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-15T22:06:51.046 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-15T22:06:51.508 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 19 kB 00:00 2024-09-15T22:06:52.954 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-15T22:06:56.427 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-15T22:06:58.426 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-15T22:06:58.747 INFO:teuthology.orchestra.run.smithi078.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:06:58.748 INFO:teuthology.orchestra.run.smithi078.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:06:58.761 INFO:teuthology.orchestra.run.smithi078.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:06:58.762 INFO:teuthology.orchestra.run.smithi078.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:06:58.763 INFO:teuthology.orchestra.run.smithi078.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:06:58.764 INFO:teuthology.orchestra.run.smithi078.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:06:58.766 INFO:teuthology.orchestra.run.smithi078.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:06:58.769 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:06:58.770 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:06:58.832 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-15T22:06:58.852 INFO:teuthology.orchestra.run.smithi078.stdout:====================================================================================== 2024-09-15T22:06:58.852 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-09-15T22:06:58.852 INFO:teuthology.orchestra.run.smithi078.stdout:====================================================================================== 2024-09-15T22:06:58.852 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-15T22:06:58.852 INFO:teuthology.orchestra.run.smithi078.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:06:58.853 INFO:teuthology.orchestra.run.smithi078.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:06:58.853 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:06:58.853 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:06:58.853 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:06:58.853 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:06:58.853 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:06:58.853 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:06:58.853 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:06:58.853 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:06:58.853 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:06:58.853 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:06:58.853 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:06:58.854 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:06:58.854 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:06:58.854 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:06:58.854 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:06:58.854 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:06:58.854 INFO:teuthology.orchestra.run.smithi078.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:06:58.854 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:06:58.854 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:06:58.854 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:06:58.854 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:06:58.854 INFO:teuthology.orchestra.run.smithi078.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:06:58.854 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:06:58.854 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:06:58.855 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:06:58.855 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:06:58.855 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:06:58.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:06:58.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:06:58.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:06:58.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:06:58.855 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:06:58.855 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:06:58.855 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:06:58.855 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:06:58.855 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrading: 2024-09-15T22:06:58.855 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:06:58.856 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:06:58.856 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:06:58.856 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:06:58.856 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:06:58.856 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:06:58.856 INFO:teuthology.orchestra.run.smithi078.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:06:58.856 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:06:58.856 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-15T22:06:58.856 INFO:teuthology.orchestra.run.smithi078.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:06:58.856 INFO:teuthology.orchestra.run.smithi078.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:06:58.856 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:06:58.856 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:06:58.856 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:06:58.857 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:06:58.857 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:06:58.857 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:06:58.857 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:06:58.857 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:06:58.857 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:06:58.857 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:06:58.857 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:06:58.857 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:06:58.857 INFO:teuthology.orchestra.run.smithi078.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:06:58.857 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:06:58.857 INFO:teuthology.orchestra.run.smithi078.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:06:58.857 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:06:58.857 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:06:58.858 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:06:58.858 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:06:58.858 INFO:teuthology.orchestra.run.smithi078.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:06:58.858 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:06:58.858 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:06:58.858 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:06:58.858 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:06:58.858 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:06:58.858 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:06:58.858 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:06:58.858 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:06:58.858 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:06:58.858 INFO:teuthology.orchestra.run.smithi078.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:06:58.858 INFO:teuthology.orchestra.run.smithi078.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:06:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:06:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:06:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:06:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:06:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:06:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:06:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:06:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:06:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:06:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:06:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:06:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:06:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:06:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:06:58.860 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:06:58.860 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:06:58.860 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:06:58.860 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:06:58.860 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:06:58.860 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:06:58.860 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:06:58.860 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:06:58.860 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:06:58.860 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:06:58.860 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:06:58.860 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:06:58.860 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:06:58.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:06:58.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:06:58.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:06:58.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:06:58.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:06:58.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:06:58.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:06:58.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:06:58.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:06:58.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:06:58.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:06:58.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:06:58.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:06:58.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:06:58.862 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:06:58.862 INFO:teuthology.orchestra.run.smithi078.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:06:58.862 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:06:58.862 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:06:58.862 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:06:58.862 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:06:58.862 INFO:teuthology.orchestra.run.smithi078.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:06:58.862 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:06:58.862 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:06:58.862 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:06:58.862 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:06:58.862 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:06:58.862 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:06:58.862 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:06:58.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:06:58.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:06:58.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:06:58.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:06:58.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:06:58.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:06:58.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:06:58.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:06:58.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:06:58.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:06:58.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:06:58.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:06:58.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:06:58.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:06:58.864 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:06:58.864 INFO:teuthology.orchestra.run.smithi078.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:06:58.864 INFO:teuthology.orchestra.run.smithi078.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:06:58.864 INFO:teuthology.orchestra.run.smithi078.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:06:58.864 INFO:teuthology.orchestra.run.smithi078.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:06:58.864 INFO:teuthology.orchestra.run.smithi078.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:06:58.864 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:06:58.864 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:06:58.864 INFO:teuthology.orchestra.run.smithi078.stdout:Installing weak dependencies: 2024-09-15T22:06:58.864 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:06:58.864 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:06:58.864 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-15T22:06:58.864 INFO:teuthology.orchestra.run.smithi078.stdout:====================================================================================== 2024-09-15T22:06:58.865 INFO:teuthology.orchestra.run.smithi078.stdout:Install 148 Packages 2024-09-15T22:06:58.865 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrade 8 Packages 2024-09-15T22:06:58.865 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:06:58.865 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 226 M 2024-09-15T22:06:58.865 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-15T22:06:59.828 INFO:teuthology.orchestra.run.smithi078.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 49 kB/s | 6.5 kB 00:00 2024-09-15T22:07:00.054 INFO:teuthology.orchestra.run.smithi078.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 3.9 MB/s | 896 kB 00:00 2024-09-15T22:07:00.171 INFO:teuthology.orchestra.run.smithi078.stdout:(3/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-15T22:07:00.196 INFO:teuthology.orchestra.run.smithi078.stdout:(4/156): ceph-immutable-object-cache-19.1.1-326 1.0 MB/s | 145 kB 00:00 2024-09-15T22:07:00.280 INFO:teuthology.orchestra.run.smithi078.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 22 MB/s | 2.4 MB 00:00 2024-09-15T22:07:00.413 INFO:teuthology.orchestra.run.smithi078.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 7.0 MB/s | 1.5 MB 00:00 2024-09-15T22:07:00.530 INFO:teuthology.orchestra.run.smithi078.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 19 MB/s | 4.7 MB 00:00 2024-09-15T22:07:00.755 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:07:00.756 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:07:00.768 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:07:00.769 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:07:00.770 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:07:00.770 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:07:00.772 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:07:00.774 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:07:00.775 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:07:00.838 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-15T22:07:00.858 INFO:teuthology.orchestra.run.smithi175.stdout:====================================================================================== 2024-09-15T22:07:00.858 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-15T22:07:00.858 INFO:teuthology.orchestra.run.smithi175.stdout:====================================================================================== 2024-09-15T22:07:00.858 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-15T22:07:00.859 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:07:00.859 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:07:00.859 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:07:00.859 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:07:00.859 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:07:00.859 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:07:00.859 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:07:00.859 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:07:00.859 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:07:00.859 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:07:00.859 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:07:00.859 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:07:00.860 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:07:00.860 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:07:00.860 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:07:00.860 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:07:00.860 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:07:00.860 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:07:00.860 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:07:00.860 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:07:00.860 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:07:00.860 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:07:00.860 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:07:00.860 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:07:00.860 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:07:00.861 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:07:00.861 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:07:00.861 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:07:00.861 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:07:00.861 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:07:00.861 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:07:00.861 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:07:00.861 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:07:00.861 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:07:00.861 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:07:00.861 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:07:00.861 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:07:00.861 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2024-09-15T22:07:00.862 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:07:00.862 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:07:00.862 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:07:00.862 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:07:00.862 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:07:00.862 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:07:00.862 INFO:teuthology.orchestra.run.smithi175.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:07:00.862 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:07:00.862 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-15T22:07:00.862 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:07:00.862 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:07:00.862 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:07:00.862 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:07:00.862 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:07:00.863 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:07:00.863 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:07:00.863 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:07:00.863 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:07:00.863 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:07:00.863 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:07:00.863 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:07:00.863 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:07:00.863 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:07:00.863 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:07:00.863 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:07:00.863 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:07:00.864 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:07:00.864 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:07:00.864 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:07:00.864 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:07:00.864 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:07:00.864 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:07:00.864 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:07:00.864 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:07:00.864 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:07:00.864 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:07:00.864 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:07:00.864 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:07:00.864 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:07:00.865 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:07:00.865 INFO:teuthology.orchestra.run.smithi175.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:07:00.865 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:07:00.865 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:07:00.865 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:07:00.865 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:07:00.865 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:07:00.865 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:07:00.865 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:07:00.865 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:07:00.865 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:07:00.865 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:07:00.865 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:07:00.866 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:07:00.866 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:07:00.866 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:07:00.866 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:07:00.866 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:07:00.866 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:07:00.866 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:07:00.866 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:07:00.866 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:07:00.866 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:07:00.866 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:07:00.866 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:07:00.866 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:07:00.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:07:00.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:07:00.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:07:00.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:07:00.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:07:00.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:07:00.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:07:00.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:07:00.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:07:00.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:07:00.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:07:00.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:07:00.867 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:07:00.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:07:00.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:07:00.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:07:00.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:07:00.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:07:00.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:07:00.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:07:00.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:07:00.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:07:00.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:07:00.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:07:00.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:07:00.868 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:07:00.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:07:00.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:07:00.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:07:00.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:07:00.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:07:00.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:07:00.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:07:00.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:07:00.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:07:00.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:07:00.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:07:00.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:07:00.869 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:07:00.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:07:00.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:07:00.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:07:00.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:07:00.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:07:00.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:07:00.870 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:07:00.870 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:07:00.870 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:07:00.870 INFO:teuthology.orchestra.run.smithi175.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:07:00.870 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:07:00.870 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:07:00.870 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:07:00.871 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:07:00.871 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:07:00.871 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2024-09-15T22:07:00.871 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:07:00.871 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:07:00.871 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-15T22:07:00.871 INFO:teuthology.orchestra.run.smithi175.stdout:====================================================================================== 2024-09-15T22:07:00.871 INFO:teuthology.orchestra.run.smithi175.stdout:Install 148 Packages 2024-09-15T22:07:00.871 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 8 Packages 2024-09-15T22:07:00.871 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:07:00.872 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 226 M 2024-09-15T22:07:00.872 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-15T22:07:00.914 INFO:teuthology.orchestra.run.smithi078.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 17 MB/s | 21 MB 00:01 2024-09-15T22:07:00.964 INFO:teuthology.orchestra.run.smithi078.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 506 kB/s | 25 kB 00:00 2024-09-15T22:07:01.164 INFO:teuthology.orchestra.run.smithi078.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 17 MB/s | 11 MB 00:00 2024-09-15T22:07:01.231 INFO:teuthology.orchestra.run.smithi078.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.4 MB/s | 228 kB 00:00 2024-09-15T22:07:01.315 INFO:teuthology.orchestra.run.smithi078.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 324 kB/s | 27 kB 00:00 2024-09-15T22:07:01.508 INFO:teuthology.orchestra.run.smithi078.stdout:(13/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 15 MB/s | 17 MB 00:01 2024-09-15T22:07:01.532 INFO:teuthology.orchestra.run.smithi078.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 146 kB/s | 32 kB 00:00 2024-09-15T22:07:01.574 INFO:teuthology.orchestra.run.smithi078.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 751 kB 00:00 2024-09-15T22:07:01.624 INFO:teuthology.orchestra.run.smithi078.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 1.7 MB/s | 163 kB 00:00 2024-09-15T22:07:01.646 INFO:teuthology.orchestra.run.smithi175.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 46 kB/s | 6.5 kB 00:00 2024-09-15T22:07:01.649 INFO:teuthology.orchestra.run.smithi078.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 1.6 MB/s | 127 kB 00:00 2024-09-15T22:07:01.674 INFO:teuthology.orchestra.run.smithi078.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 9.9 MB/s | 506 kB 00:00 2024-09-15T22:07:01.733 INFO:teuthology.orchestra.run.smithi078.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 775 kB/s | 45 kB 00:00 2024-09-15T22:07:01.817 INFO:teuthology.orchestra.run.smithi078.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.6 MB/s | 136 kB 00:00 2024-09-15T22:07:01.925 INFO:teuthology.orchestra.run.smithi078.stdout:(21/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-15T22:07:01.950 INFO:teuthology.orchestra.run.smithi078.stdout:(22/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.2 MB/s | 161 kB 00:00 2024-09-15T22:07:01.976 INFO:teuthology.orchestra.run.smithi078.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 6.3 MB/s | 320 kB 00:00 2024-09-15T22:07:02.001 INFO:teuthology.orchestra.run.smithi078.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.8 MB/s | 300 kB 00:00 2024-09-15T22:07:02.026 INFO:teuthology.orchestra.run.smithi078.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T22:07:02.052 INFO:teuthology.orchestra.run.smithi078.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T22:07:02.063 INFO:teuthology.orchestra.run.smithi175.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 2.1 MB/s | 896 kB 00:00 2024-09-15T22:07:02.119 INFO:teuthology.orchestra.run.smithi078.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.5 MB/s | 170 kB 00:00 2024-09-15T22:07:02.177 INFO:teuthology.orchestra.run.smithi078.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 21 MB/s | 3.1 MB 00:00 2024-09-15T22:07:02.188 INFO:teuthology.orchestra.run.smithi175.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.1 MB/s | 145 kB 00:00 2024-09-15T22:07:02.203 INFO:teuthology.orchestra.run.smithi078.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 382 kB/s | 32 kB 00:00 2024-09-15T22:07:02.228 INFO:teuthology.orchestra.run.smithi078.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.9 MB/s | 146 kB 00:00 2024-09-15T22:07:02.495 INFO:teuthology.orchestra.run.smithi078.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 12 MB/s | 3.6 MB 00:00 2024-09-15T22:07:02.586 INFO:teuthology.orchestra.run.smithi078.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.7 MB/s | 249 kB 00:00 2024-09-15T22:07:02.670 INFO:teuthology.orchestra.run.smithi078.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 17 MB/s | 7.4 MB 00:00 2024-09-15T22:07:02.697 INFO:teuthology.orchestra.run.smithi175.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 4.5 MB/s | 5.4 MB 00:01 2024-09-15T22:07:02.704 INFO:teuthology.orchestra.run.smithi078.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 420 kB/s | 49 kB 00:00 2024-09-15T22:07:02.729 INFO:teuthology.orchestra.run.smithi078.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 280 kB/s | 16 kB 00:00 2024-09-15T22:07:02.755 INFO:teuthology.orchestra.run.smithi078.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 5.5 MB/s | 285 kB 00:00 2024-09-15T22:07:02.796 INFO:teuthology.orchestra.run.smithi078.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 11 MB/s | 765 kB 00:00 2024-09-15T22:07:02.822 INFO:teuthology.orchestra.run.smithi078.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 273 kB/s | 18 kB 00:00 2024-09-15T22:07:02.855 INFO:teuthology.orchestra.run.smithi175.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 9.6 MB/s | 1.5 MB 00:00 2024-09-15T22:07:02.906 INFO:teuthology.orchestra.run.smithi175.stdout:(6/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 3.3 MB/s | 2.4 MB 00:00 2024-09-15T22:07:02.964 INFO:teuthology.orchestra.run.smithi078.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-15T22:07:03.047 INFO:teuthology.orchestra.run.smithi078.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-15T22:07:03.081 INFO:teuthology.orchestra.run.smithi078.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.0 MB/s | 801 kB 00:00 2024-09-15T22:07:03.106 INFO:teuthology.orchestra.run.smithi078.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-15T22:07:03.239 INFO:teuthology.orchestra.run.smithi175.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-15T22:07:03.532 INFO:teuthology.orchestra.run.smithi078.stdout:(43/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 19 MB/s | 49 MB 00:02 2024-09-15T22:07:03.557 INFO:teuthology.orchestra.run.smithi078.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 236 kB/s | 106 kB 00:00 2024-09-15T22:07:03.599 INFO:teuthology.orchestra.run.smithi078.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 2.4 MB/s | 1.2 MB 00:00 2024-09-15T22:07:03.624 INFO:teuthology.orchestra.run.smithi078.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-15T22:07:03.683 INFO:teuthology.orchestra.run.smithi078.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-15T22:07:03.708 INFO:teuthology.orchestra.run.smithi078.stdout:(48/156): python3-pycparser-2.20-6.el9.noarch.r 770 kB/s | 135 kB 00:00 2024-09-15T22:07:03.815 INFO:teuthology.orchestra.run.smithi175.stdout:(8/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9. 18 MB/s | 11 MB 00:00 2024-09-15T22:07:03.816 INFO:teuthology.orchestra.run.smithi078.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-09-15T22:07:03.833 INFO:teuthology.orchestra.run.smithi078.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 854 kB/s | 107 kB 00:00 2024-09-15T22:07:03.859 INFO:teuthology.orchestra.run.smithi078.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 516 kB/s | 22 kB 00:00 2024-09-15T22:07:03.900 INFO:teuthology.orchestra.run.smithi078.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-09-15T22:07:03.926 INFO:teuthology.orchestra.run.smithi078.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-15T22:07:03.951 INFO:teuthology.orchestra.run.smithi078.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-15T22:07:03.976 INFO:teuthology.orchestra.run.smithi078.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-15T22:07:04.002 INFO:teuthology.orchestra.run.smithi078.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-15T22:07:04.031 INFO:teuthology.orchestra.run.smithi175.stdout:(9/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 8.4 MB/s | 21 MB 00:02 2024-09-15T22:07:04.035 INFO:teuthology.orchestra.run.smithi078.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-15T22:07:04.048 INFO:teuthology.orchestra.run.smithi175.stdout:(10/156): ceph-selinux-19.1.1-326.g8921c8ef.el9 108 kB/s | 25 kB 00:00 2024-09-15T22:07:04.061 INFO:teuthology.orchestra.run.smithi078.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-15T22:07:04.115 INFO:teuthology.orchestra.run.smithi175.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.3 MB/s | 228 kB 00:00 2024-09-15T22:07:04.178 INFO:teuthology.orchestra.run.smithi078.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-09-15T22:07:04.199 INFO:teuthology.orchestra.run.smithi175.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 325 kB/s | 27 kB 00:00 2024-09-15T22:07:04.219 INFO:teuthology.orchestra.run.smithi078.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2024-09-15T22:07:04.236 INFO:teuthology.orchestra.run.smithi078.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-15T22:07:04.261 INFO:teuthology.orchestra.run.smithi078.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-15T22:07:04.265 INFO:teuthology.orchestra.run.smithi175.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 477 kB/s | 32 kB 00:00 2024-09-15T22:07:04.303 INFO:teuthology.orchestra.run.smithi078.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-09-15T22:07:04.346 INFO:teuthology.orchestra.run.smithi078.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 920 kB/s | 38 kB 00:00 2024-09-15T22:07:04.371 INFO:teuthology.orchestra.run.smithi078.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-15T22:07:04.474 INFO:teuthology.orchestra.run.smithi175.stdout:(14/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 11 MB/s | 17 MB 00:01 2024-09-15T22:07:04.516 INFO:teuthology.orchestra.run.smithi175.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 2.9 MB/s | 751 kB 00:00 2024-09-15T22:07:04.541 INFO:teuthology.orchestra.run.smithi175.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.4 MB/s | 163 kB 00:00 2024-09-15T22:07:04.567 INFO:teuthology.orchestra.run.smithi175.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-15T22:07:04.601 INFO:teuthology.orchestra.run.smithi175.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 8.4 MB/s | 506 kB 00:00 2024-09-15T22:07:04.646 INFO:teuthology.orchestra.run.smithi078.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.0 MB/s | 3.0 MB 00:00 2024-09-15T22:07:04.659 INFO:teuthology.orchestra.run.smithi175.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 778 kB/s | 45 kB 00:00 2024-09-15T22:07:04.726 INFO:teuthology.orchestra.run.smithi175.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 2.0 MB/s | 136 kB 00:00 2024-09-15T22:07:04.793 INFO:teuthology.orchestra.run.smithi175.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 2.4 MB/s | 161 kB 00:00 2024-09-15T22:07:04.868 INFO:teuthology.orchestra.run.smithi175.stdout:(22/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 18 MB/s | 5.3 MB 00:00 2024-09-15T22:07:04.893 INFO:teuthology.orchestra.run.smithi175.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 3.1 MB/s | 320 kB 00:00 2024-09-15T22:07:04.919 INFO:teuthology.orchestra.run.smithi175.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.9 MB/s | 300 kB 00:00 2024-09-15T22:07:04.944 INFO:teuthology.orchestra.run.smithi175.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T22:07:04.986 INFO:teuthology.orchestra.run.smithi175.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-15T22:07:05.045 INFO:teuthology.orchestra.run.smithi175.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-15T22:07:05.080 INFO:teuthology.orchestra.run.smithi078.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-09-15T22:07:05.120 INFO:teuthology.orchestra.run.smithi175.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 18 MB/s | 3.1 MB 00:00 2024-09-15T22:07:05.145 INFO:teuthology.orchestra.run.smithi175.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 318 kB/s | 32 kB 00:00 2024-09-15T22:07:05.170 INFO:teuthology.orchestra.run.smithi175.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.9 MB/s | 146 kB 00:00 2024-09-15T22:07:05.338 INFO:teuthology.orchestra.run.smithi078.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 3.4 MB/s | 910 kB 00:00 2024-09-15T22:07:05.413 INFO:teuthology.orchestra.run.smithi175.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 13 MB/s | 3.6 MB 00:00 2024-09-15T22:07:05.413 INFO:teuthology.orchestra.run.smithi078.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-15T22:07:05.480 INFO:teuthology.orchestra.run.smithi175.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 3.7 MB/s | 249 kB 00:00 2024-09-15T22:07:05.539 INFO:teuthology.orchestra.run.smithi078.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-15T22:07:05.613 INFO:teuthology.orchestra.run.smithi175.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 17 MB/s | 7.4 MB 00:00 2024-09-15T22:07:05.638 INFO:teuthology.orchestra.run.smithi175.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 311 kB/s | 49 kB 00:00 2024-09-15T22:07:05.639 INFO:teuthology.orchestra.run.smithi078.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.8 MB/s | 4.9 MB 00:01 2024-09-15T22:07:05.663 INFO:teuthology.orchestra.run.smithi175.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 328 kB/s | 16 kB 00:00 2024-09-15T22:07:05.689 INFO:teuthology.orchestra.run.smithi175.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 5.6 MB/s | 285 kB 00:00 2024-09-15T22:07:05.698 INFO:teuthology.orchestra.run.smithi078.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-15T22:07:05.722 INFO:teuthology.orchestra.run.smithi175.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 13 MB/s | 765 kB 00:00 2024-09-15T22:07:05.748 INFO:teuthology.orchestra.run.smithi175.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 311 kB/s | 18 kB 00:00 2024-09-15T22:07:05.890 INFO:teuthology.orchestra.run.smithi175.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-15T22:07:05.898 INFO:teuthology.orchestra.run.smithi078.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.8 MB/s | 1.0 MB 00:00 2024-09-15T22:07:05.940 INFO:teuthology.orchestra.run.smithi078.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-15T22:07:06.024 INFO:teuthology.orchestra.run.smithi078.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-15T22:07:06.107 INFO:teuthology.orchestra.run.smithi078.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-15T22:07:06.149 INFO:teuthology.orchestra.run.smithi078.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 617 kB/s | 26 kB 00:00 2024-09-15T22:07:06.191 INFO:teuthology.orchestra.run.smithi078.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 462 kB/s | 19 kB 00:00 2024-09-15T22:07:06.266 INFO:teuthology.orchestra.run.smithi078.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-15T22:07:06.308 INFO:teuthology.orchestra.run.smithi078.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 836 kB/s | 35 kB 00:00 2024-09-15T22:07:06.340 INFO:teuthology.orchestra.run.smithi175.stdout:(40/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 21 MB/s | 49 MB 00:02 2024-09-15T22:07:06.365 INFO:teuthology.orchestra.run.smithi175.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 402 kB/s | 191 kB 00:00 2024-09-15T22:07:06.399 INFO:teuthology.orchestra.run.smithi175.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-15T22:07:06.458 INFO:teuthology.orchestra.run.smithi175.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-15T22:07:06.516 INFO:teuthology.orchestra.run.smithi175.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-15T22:07:06.558 INFO:teuthology.orchestra.run.smithi175.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-09-15T22:07:06.583 INFO:teuthology.orchestra.run.smithi175.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-15T22:07:06.609 INFO:teuthology.orchestra.run.smithi175.stdout:(47/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 945 kB/s | 253 kB 00:00 2024-09-15T22:07:06.634 INFO:teuthology.orchestra.run.smithi175.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-15T22:07:06.776 INFO:teuthology.orchestra.run.smithi175.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 755 kB/s | 107 kB 00:00 2024-09-15T22:07:06.826 INFO:teuthology.orchestra.run.smithi175.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-09-15T22:07:06.868 INFO:teuthology.orchestra.run.smithi175.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-09-15T22:07:06.893 INFO:teuthology.orchestra.run.smithi175.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 185 kB/s | 22 kB 00:00 2024-09-15T22:07:06.919 INFO:teuthology.orchestra.run.smithi175.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-15T22:07:06.952 INFO:teuthology.orchestra.run.smithi175.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-09-15T22:07:07.011 INFO:teuthology.orchestra.run.smithi175.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-09-15T22:07:07.036 INFO:teuthology.orchestra.run.smithi175.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-15T22:07:07.103 INFO:teuthology.orchestra.run.smithi175.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-15T22:07:07.128 INFO:teuthology.orchestra.run.smithi175.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 493 kB/s | 45 kB 00:00 2024-09-15T22:07:07.133 INFO:teuthology.orchestra.run.smithi078.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 3.4 MB/s | 5.8 MB 00:01 2024-09-15T22:07:07.162 INFO:teuthology.orchestra.run.smithi175.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-15T22:07:07.212 INFO:teuthology.orchestra.run.smithi175.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-09-15T22:07:07.234 INFO:teuthology.orchestra.run.smithi078.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-09-15T22:07:07.246 INFO:teuthology.orchestra.run.smithi175.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-15T22:07:07.271 INFO:teuthology.orchestra.run.smithi175.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-15T22:07:07.296 INFO:teuthology.orchestra.run.smithi175.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-09-15T22:07:07.321 INFO:teuthology.orchestra.run.smithi175.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-15T22:07:07.325 INFO:teuthology.orchestra.run.smithi078.stdout:(83/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.7 MB/s | 6.0 MB 00:01 2024-09-15T22:07:07.364 INFO:teuthology.orchestra.run.smithi175.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 575 kB/s | 38 kB 00:00 2024-09-15T22:07:07.367 INFO:teuthology.orchestra.run.smithi078.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-09-15T22:07:07.393 INFO:teuthology.orchestra.run.smithi078.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-15T22:07:07.414 INFO:teuthology.orchestra.run.smithi175.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-09-15T22:07:07.418 INFO:teuthology.orchestra.run.smithi078.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-09-15T22:07:07.493 INFO:teuthology.orchestra.run.smithi078.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-15T22:07:07.518 INFO:teuthology.orchestra.run.smithi078.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-15T22:07:07.531 INFO:teuthology.orchestra.run.smithi175.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 24 MB/s | 4.9 MB 00:00 2024-09-15T22:07:07.561 INFO:teuthology.orchestra.run.smithi078.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-15T22:07:07.602 INFO:teuthology.orchestra.run.smithi078.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-15T22:07:07.628 INFO:teuthology.orchestra.run.smithi078.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-15T22:07:07.670 INFO:teuthology.orchestra.run.smithi078.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-15T22:07:07.712 INFO:teuthology.orchestra.run.smithi078.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-15T22:07:07.739 INFO:teuthology.orchestra.run.smithi175.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-15T22:07:07.781 INFO:teuthology.orchestra.run.smithi175.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2024-09-15T22:07:07.795 INFO:teuthology.orchestra.run.smithi078.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-15T22:07:07.815 INFO:teuthology.orchestra.run.smithi175.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 3.2 MB/s | 910 kB 00:00 2024-09-15T22:07:07.829 INFO:teuthology.orchestra.run.smithi078.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 36 kB 00:00 2024-09-15T22:07:07.840 INFO:teuthology.orchestra.run.smithi175.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 1.3 MB/s | 137 kB 00:00 2024-09-15T22:07:07.863 INFO:teuthology.orchestra.run.smithi078.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-15T22:07:07.915 INFO:teuthology.orchestra.run.smithi175.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-15T22:07:07.949 INFO:teuthology.orchestra.run.smithi175.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 806 kB/s | 87 kB 00:00 2024-09-15T22:07:07.963 INFO:teuthology.orchestra.run.smithi078.stdout:(97/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.1 MB/s | 5.1 MB 00:01 2024-09-15T22:07:08.005 INFO:teuthology.orchestra.run.smithi078.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-15T22:07:08.022 INFO:teuthology.orchestra.run.smithi078.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 991 kB/s | 58 kB 00:00 2024-09-15T22:07:08.033 INFO:teuthology.orchestra.run.smithi175.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-15T22:07:08.058 INFO:teuthology.orchestra.run.smithi175.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 563 kB/s | 61 kB 00:00 2024-09-15T22:07:08.064 INFO:teuthology.orchestra.run.smithi078.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-15T22:07:08.097 INFO:teuthology.orchestra.run.smithi078.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 845 kB/s | 64 kB 00:00 2024-09-15T22:07:08.114 INFO:teuthology.orchestra.run.smithi078.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-15T22:07:08.117 INFO:teuthology.orchestra.run.smithi175.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-15T22:07:08.142 INFO:teuthology.orchestra.run.smithi175.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-15T22:07:08.182 INFO:teuthology.orchestra.run.smithi078.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-15T22:07:08.217 INFO:teuthology.orchestra.run.smithi175.stdout:(78/156): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-15T22:07:08.234 INFO:teuthology.orchestra.run.smithi175.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-09-15T22:07:08.251 INFO:teuthology.orchestra.run.smithi175.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-15T22:07:08.265 INFO:teuthology.orchestra.run.smithi078.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.5 MB/s | 548 kB 00:00 2024-09-15T22:07:08.284 INFO:teuthology.orchestra.run.smithi175.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-15T22:07:08.298 INFO:teuthology.orchestra.run.smithi078.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-09-15T22:07:08.332 INFO:teuthology.orchestra.run.smithi078.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 4.5 MB/s | 308 kB 00:00 2024-09-15T22:07:08.334 INFO:teuthology.orchestra.run.smithi175.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 416 kB/s | 35 kB 00:00 2024-09-15T22:07:08.360 INFO:teuthology.orchestra.run.smithi175.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.2 MB/s | 250 kB 00:00 2024-09-15T22:07:08.366 INFO:teuthology.orchestra.run.smithi078.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 291 kB/s | 19 kB 00:00 2024-09-15T22:07:08.391 INFO:teuthology.orchestra.run.smithi078.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-15T22:07:08.425 INFO:teuthology.orchestra.run.smithi078.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-15T22:07:08.435 INFO:teuthology.orchestra.run.smithi175.stdout:(84/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-15T22:07:08.460 INFO:teuthology.orchestra.run.smithi078.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-15T22:07:08.461 INFO:teuthology.orchestra.run.smithi175.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 772 kB/s | 77 kB 00:00 2024-09-15T22:07:08.486 INFO:teuthology.orchestra.run.smithi175.stdout:(86/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-15T22:07:08.500 INFO:teuthology.orchestra.run.smithi078.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-15T22:07:08.511 INFO:teuthology.orchestra.run.smithi175.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 558 kB/s | 42 kB 00:00 2024-09-15T22:07:08.536 INFO:teuthology.orchestra.run.smithi175.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-15T22:07:08.595 INFO:teuthology.orchestra.run.smithi175.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-15T22:07:08.600 INFO:teuthology.orchestra.run.smithi078.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-15T22:07:08.620 INFO:teuthology.orchestra.run.smithi175.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 610 kB/s | 51 kB 00:00 2024-09-15T22:07:08.654 INFO:teuthology.orchestra.run.smithi175.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 279 kB 00:00 2024-09-15T22:07:08.668 INFO:teuthology.orchestra.run.smithi078.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-15T22:07:08.687 INFO:teuthology.orchestra.run.smithi175.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 584 kB/s | 54 kB 00:00 2024-09-15T22:07:08.701 INFO:teuthology.orchestra.run.smithi078.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-15T22:07:08.726 INFO:teuthology.orchestra.run.smithi078.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-15T22:07:08.729 INFO:teuthology.orchestra.run.smithi175.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-09-15T22:07:08.751 INFO:teuthology.orchestra.run.smithi078.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-15T22:07:08.771 INFO:teuthology.orchestra.run.smithi175.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 528 kB/s | 44 kB 00:00 2024-09-15T22:07:08.805 INFO:teuthology.orchestra.run.smithi175.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-15T22:07:08.818 INFO:teuthology.orchestra.run.smithi078.stdout:(117/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-09-15T22:07:08.844 INFO:teuthology.orchestra.run.smithi078.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-09-15T22:07:08.855 INFO:teuthology.orchestra.run.smithi175.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 430 kB/s | 36 kB 00:00 2024-09-15T22:07:08.877 INFO:teuthology.orchestra.run.smithi078.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-15T22:07:08.889 INFO:teuthology.orchestra.run.smithi175.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-09-15T22:07:08.903 INFO:teuthology.orchestra.run.smithi078.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-15T22:07:08.928 INFO:teuthology.orchestra.run.smithi078.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-15T22:07:08.962 INFO:teuthology.orchestra.run.smithi078.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-15T22:07:08.987 INFO:teuthology.orchestra.run.smithi078.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-15T22:07:09.021 INFO:teuthology.orchestra.run.smithi078.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 527 kB/s | 18 kB 00:00 2024-09-15T22:07:09.046 INFO:teuthology.orchestra.run.smithi078.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-09-15T22:07:09.072 INFO:teuthology.orchestra.run.smithi078.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 786 kB/s | 19 kB 00:00 2024-09-15T22:07:09.089 INFO:teuthology.orchestra.run.smithi175.stdout:(98/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-15T22:07:09.097 INFO:teuthology.orchestra.run.smithi078.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 785 kB/s | 20 kB 00:00 2024-09-15T22:07:09.114 INFO:teuthology.orchestra.run.smithi175.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 257 kB/s | 58 kB 00:00 2024-09-15T22:07:09.139 INFO:teuthology.orchestra.run.smithi175.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.0 MB/s | 304 kB 00:00 2024-09-15T22:07:09.147 INFO:teuthology.orchestra.run.smithi078.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-15T22:07:09.173 INFO:teuthology.orchestra.run.smithi175.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-15T22:07:09.180 INFO:teuthology.orchestra.run.smithi078.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-15T22:07:09.206 INFO:teuthology.orchestra.run.smithi078.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-15T22:07:09.215 INFO:teuthology.orchestra.run.smithi175.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 634 kB/s | 64 kB 00:00 2024-09-15T22:07:09.239 INFO:teuthology.orchestra.run.smithi078.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-15T22:07:09.240 INFO:teuthology.orchestra.run.smithi175.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 446 kB/s | 45 kB 00:00 2024-09-15T22:07:09.265 INFO:teuthology.orchestra.run.smithi078.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 985 kB/s | 58 kB 00:00 2024-09-15T22:07:09.265 INFO:teuthology.orchestra.run.smithi175.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-15T22:07:09.307 INFO:teuthology.orchestra.run.smithi078.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 395 kB/s | 16 kB 00:00 2024-09-15T22:07:09.324 INFO:teuthology.orchestra.run.smithi175.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 7.8 MB/s | 863 kB 00:00 2024-09-15T22:07:09.340 INFO:teuthology.orchestra.run.smithi078.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-15T22:07:09.366 INFO:teuthology.orchestra.run.smithi078.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-15T22:07:09.366 INFO:teuthology.orchestra.run.smithi175.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 4.3 MB/s | 548 kB 00:00 2024-09-15T22:07:09.382 INFO:teuthology.orchestra.run.smithi078.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 675 kB/s | 28 kB 00:00 2024-09-15T22:07:09.399 INFO:teuthology.orchestra.run.smithi078.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 918 kB/s | 31 kB 00:00 2024-09-15T22:07:09.400 INFO:teuthology.orchestra.run.smithi175.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.2 MB/s | 308 kB 00:00 2024-09-15T22:07:09.425 INFO:teuthology.orchestra.run.smithi078.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2024-09-15T22:07:09.425 INFO:teuthology.orchestra.run.smithi175.stdout:(108/156): grpc-data-1.46.7-10.el9.noarch.rpm 197 kB/s | 19 kB 00:00 2024-09-15T22:07:09.450 INFO:teuthology.orchestra.run.smithi078.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-15T22:07:09.450 INFO:teuthology.orchestra.run.smithi175.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-09-15T22:07:09.467 INFO:teuthology.orchestra.run.smithi078.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 857 kB/s | 36 kB 00:00 2024-09-15T22:07:09.475 INFO:teuthology.orchestra.run.smithi175.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-09-15T22:07:09.492 INFO:teuthology.orchestra.run.smithi078.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-15T22:07:09.501 INFO:teuthology.orchestra.run.smithi175.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-15T22:07:09.517 INFO:teuthology.orchestra.run.smithi078.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-15T22:07:09.526 INFO:teuthology.orchestra.run.smithi175.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-15T22:07:09.543 INFO:teuthology.orchestra.run.smithi078.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-15T22:07:09.568 INFO:teuthology.orchestra.run.smithi078.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 800 kB/s | 20 kB 00:00 2024-09-15T22:07:09.576 INFO:teuthology.orchestra.run.smithi175.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-15T22:07:09.593 INFO:teuthology.orchestra.run.smithi078.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-15T22:07:09.601 INFO:teuthology.orchestra.run.smithi175.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-15T22:07:09.618 INFO:teuthology.orchestra.run.smithi078.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-15T22:07:09.627 INFO:teuthology.orchestra.run.smithi175.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-15T22:07:09.652 INFO:teuthology.orchestra.run.smithi175.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-15T22:07:09.669 INFO:teuthology.orchestra.run.smithi078.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-15T22:07:09.686 INFO:teuthology.orchestra.run.smithi175.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-09-15T22:07:09.711 INFO:teuthology.orchestra.run.smithi175.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-15T22:07:09.745 INFO:teuthology.orchestra.run.smithi175.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-15T22:07:09.770 INFO:teuthology.orchestra.run.smithi175.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-15T22:07:09.795 INFO:teuthology.orchestra.run.smithi175.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-15T22:07:09.821 INFO:teuthology.orchestra.run.smithi175.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-15T22:07:09.837 INFO:teuthology.orchestra.run.smithi175.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 644 kB/s | 11 kB 00:00 2024-09-15T22:07:09.854 INFO:teuthology.orchestra.run.smithi175.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-15T22:07:09.871 INFO:teuthology.orchestra.run.smithi175.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-15T22:07:09.888 INFO:teuthology.orchestra.run.smithi175.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-15T22:07:09.905 INFO:teuthology.orchestra.run.smithi175.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-15T22:07:09.919 INFO:teuthology.orchestra.run.smithi078.stdout:(148/156): librados2-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-15T22:07:09.978 INFO:teuthology.orchestra.run.smithi078.stdout:(149/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-15T22:07:09.981 INFO:teuthology.orchestra.run.smithi175.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.2 MB/s | 4.4 MB 00:00 2024-09-15T22:07:10.006 INFO:teuthology.orchestra.run.smithi175.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T22:07:10.039 INFO:teuthology.orchestra.run.smithi175.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-15T22:07:10.065 INFO:teuthology.orchestra.run.smithi175.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T22:07:10.099 INFO:teuthology.orchestra.run.smithi175.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-15T22:07:10.124 INFO:teuthology.orchestra.run.smithi175.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-15T22:07:10.149 INFO:teuthology.orchestra.run.smithi175.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-15T22:07:10.174 INFO:teuthology.orchestra.run.smithi175.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-15T22:07:10.200 INFO:teuthology.orchestra.run.smithi175.stdout:(136/156): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-15T22:07:10.241 INFO:teuthology.orchestra.run.smithi175.stdout:(137/156): python3-kubernetes-26.1.0-2.el9.noar 3.0 MB/s | 1.0 MB 00:00 2024-09-15T22:07:10.283 INFO:teuthology.orchestra.run.smithi175.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-15T22:07:10.295 INFO:teuthology.orchestra.run.smithi078.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 6.2 MB/s | 2.3 MB 00:00 2024-09-15T22:07:10.309 INFO:teuthology.orchestra.run.smithi175.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 885 kB/s | 59 kB 00:00 2024-09-15T22:07:10.334 INFO:teuthology.orchestra.run.smithi175.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-15T22:07:10.336 INFO:teuthology.orchestra.run.smithi078.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 5.0 MB/s | 1.8 MB 00:00 2024-09-15T22:07:10.359 INFO:teuthology.orchestra.run.smithi175.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-15T22:07:10.362 INFO:teuthology.orchestra.run.smithi078.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 609 kB/s | 41 kB 00:00 2024-09-15T22:07:10.393 INFO:teuthology.orchestra.run.smithi175.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 978 kB/s | 188 kB 00:00 2024-09-15T22:07:10.396 INFO:teuthology.orchestra.run.smithi078.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 4.1 MB/s | 249 kB 00:00 2024-09-15T22:07:10.418 INFO:teuthology.orchestra.run.smithi175.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-15T22:07:10.443 INFO:teuthology.orchestra.run.smithi175.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-15T22:07:10.468 INFO:teuthology.orchestra.run.smithi175.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-15T22:07:10.494 INFO:teuthology.orchestra.run.smithi175.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-15T22:07:10.520 INFO:teuthology.orchestra.run.smithi175.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-15T22:07:10.521 INFO:teuthology.orchestra.run.smithi078.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 8.5 MB/s | 1.4 MB 00:00 2024-09-15T22:07:10.578 INFO:teuthology.orchestra.run.smithi175.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-15T22:07:10.654 INFO:teuthology.orchestra.run.smithi078.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.3 MB/s | 2.4 MB 00:00 2024-09-15T22:07:10.845 INFO:teuthology.orchestra.run.smithi175.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 9.8 MB/s | 3.4 MB 00:00 2024-09-15T22:07:10.903 INFO:teuthology.orchestra.run.smithi175.stdout:(150/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 8.2 MB/s | 3.2 MB 00:00 2024-09-15T22:07:10.987 INFO:teuthology.orchestra.run.smithi175.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 489 kB/s | 41 kB 00:00 2024-09-15T22:07:11.096 INFO:teuthology.orchestra.run.smithi175.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 2.2 MB/s | 249 kB 00:00 2024-09-15T22:07:11.138 INFO:teuthology.orchestra.run.smithi175.stdout:(153/156): NetworkManager-1.49.90-1.el9.x86_64. 4.1 MB/s | 2.3 MB 00:00 2024-09-15T22:07:11.205 INFO:teuthology.orchestra.run.smithi175.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 5.0 MB/s | 1.8 MB 00:00 2024-09-15T22:07:11.263 INFO:teuthology.orchestra.run.smithi175.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 8.1 MB/s | 1.4 MB 00:00 2024-09-15T22:07:12.305 INFO:teuthology.orchestra.run.smithi175.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-15T22:07:12.312 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:07:12.312 INFO:teuthology.orchestra.run.smithi175.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-15T22:07:12.788 INFO:teuthology.orchestra.run.smithi078.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.1 MB/s | 16 MB 00:05 2024-09-15T22:07:12.793 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:07:12.793 INFO:teuthology.orchestra.run.smithi078.stdout:Total 16 MB/s | 226 MB 00:13 2024-09-15T22:07:13.542 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-15T22:07:13.693 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-15T22:07:13.693 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-15T22:07:14.018 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-15T22:07:14.167 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-15T22:07:14.167 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-15T22:07:15.915 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-15T22:07:15.916 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-15T22:07:16.494 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-15T22:07:16.495 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-15T22:07:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-15T22:07:22.475 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:07:22.513 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:07:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:07:22.624 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:07:22.650 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:07:22.697 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:07:22.994 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-15T22:07:23.038 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:07:23.109 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:07:23.143 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:07:23.153 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:07:23.217 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:07:23.251 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:07:23.264 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:07:23.276 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:07:23.315 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:07:23.336 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:07:23.410 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:07:23.440 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:07:23.625 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:07:23.666 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:07:23.686 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:07:23.714 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:07:23.778 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:07:23.818 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:07:23.840 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:07:23.895 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:07:23.899 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:07:23.925 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:07:23.937 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:07:23.949 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:07:24.028 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:07:24.062 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:07:24.093 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:07:24.240 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:07:24.259 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:07:24.297 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:07:24.325 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:07:24.381 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:07:24.421 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:07:24.451 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:07:24.491 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:07:24.514 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:07:24.535 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:07:24.561 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:07:24.575 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:07:24.771 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:07:24.795 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:07:24.908 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:07:24.957 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:07:25.001 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:07:25.038 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:07:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:07:25.075 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:07:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:07:25.182 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:07:25.190 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:07:25.231 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:07:25.268 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:07:25.274 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:07:25.307 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:07:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:07:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:07:25.465 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:07:25.495 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:07:25.505 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:07:25.547 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:07:25.608 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:07:25.622 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:07:25.658 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:07:25.702 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:07:25.702 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:07:25.730 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:07:25.732 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:07:25.775 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:07:25.807 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:07:25.839 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:07:25.853 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:07:25.883 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:07:25.916 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:07:25.926 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:07:25.968 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:07:26.009 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:07:26.037 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:07:26.067 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:07:26.104 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:07:26.122 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:07:26.158 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:07:26.191 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:07:26.233 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:07:26.309 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:07:26.352 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:07:26.404 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:07:26.473 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:07:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:07:26.678 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:07:26.725 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:07:26.764 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:07:26.807 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:07:26.845 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:07:26.864 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:07:26.911 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:07:26.938 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:07:27.069 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:07:27.071 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:07:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:07:27.122 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:07:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:07:27.267 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:07:27.298 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:07:27.334 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:07:27.381 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:07:27.416 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:07:27.460 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:07:27.501 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:07:27.637 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:07:27.643 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:07:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:07:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:07:27.736 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:07:27.766 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:07:27.809 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:07:27.822 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:07:27.847 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:07:27.854 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:07:27.889 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:07:27.894 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:07:27.936 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:07:27.969 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:07:28.063 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:07:28.117 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:07:28.170 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:07:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:07:28.234 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:07:28.276 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:07:28.312 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:07:28.358 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:07:28.394 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:07:28.419 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:07:28.437 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:07:28.468 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:07:28.479 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:07:28.505 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:07:28.568 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:07:28.622 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:07:28.665 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:07:28.714 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:07:28.765 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:07:28.816 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:07:28.857 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:07:28.897 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:07:28.908 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:07:28.939 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:07:28.964 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:07:29.025 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:07:29.071 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:07:29.101 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:07:29.143 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:07:29.177 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:07:29.232 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:07:29.264 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:07:29.315 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:07:29.347 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:07:29.433 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:07:29.449 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:07:29.471 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:07:29.497 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:07:29.507 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:07:29.548 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:07:29.589 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:07:29.620 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:07:29.654 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:07:29.688 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:07:29.722 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:07:29.763 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:07:29.798 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:07:29.883 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:07:29.928 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:07:29.968 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:07:30.077 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:07:30.135 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:07:30.209 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:07:30.261 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:07:30.295 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:07:30.392 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:07:30.441 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:07:30.511 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:07:30.606 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:07:30.647 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:07:30.831 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:07:30.844 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:07:30.862 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:07:30.899 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:07:30.933 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:07:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:07:31.031 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:07:31.088 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:07:31.132 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:07:31.211 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:07:31.253 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:07:31.436 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:07:31.467 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:07:31.544 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:07:31.587 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:07:31.699 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:07:32.193 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:07:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:07:32.920 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:07:33.023 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:07:33.050 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:07:33.084 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:07:33.391 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:07:33.432 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:07:33.520 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:07:33.551 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:07:33.558 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:07:33.587 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:07:33.646 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:07:33.674 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:07:33.715 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:07:34.025 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:07:34.066 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:07:34.070 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:07:34.099 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:07:34.153 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:07:34.159 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:07:34.184 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:07:34.191 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:07:34.228 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:07:34.707 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:07:34.740 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:07:34.811 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:07:34.842 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:07:36.515 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:07:36.564 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:07:37.115 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:07:37.131 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:07:37.159 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:07:37.162 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:07:37.256 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:07:37.256 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:07:37.256 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:07:37.256 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:07:37.301 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:07:37.716 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:07:37.749 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:07:37.840 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:07:37.840 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:07:37.840 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:07:37.841 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:07:37.876 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:07:49.007 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:07:49.007 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2024-09-15T22:07:49.008 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2024-09-15T22:07:49.008 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2024-09-15T22:07:49.008 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2024-09-15T22:07:49.008 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2024-09-15T22:07:49.008 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2024-09-15T22:07:49.008 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2024-09-15T22:07:49.008 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:07:49.187 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:07:49.203 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:07:49.203 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:49.204 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:07:49.204 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:07:49.770 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:07:49.771 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /sys 2024-09-15T22:07:49.771 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /proc 2024-09-15T22:07:49.771 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /mnt 2024-09-15T22:07:49.771 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /var/tmp 2024-09-15T22:07:49.771 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /home 2024-09-15T22:07:49.771 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /root 2024-09-15T22:07:49.771 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /tmp 2024-09-15T22:07:49.771 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:07:49.938 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:07:49.953 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:07:49.953 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:49.954 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:07:49.954 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:07:50.683 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:07:50.710 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:07:50.710 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:50.710 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:07:50.710 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:07:50.710 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:07:50.710 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:07:50.942 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:07:50.965 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:07:50.965 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:50.965 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:07:50.966 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:07:50.966 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:07:50.966 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:07:51.401 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:07:51.406 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:07:51.424 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:07:51.424 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:51.425 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:07:51.425 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:07:51.425 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:07:51.425 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:07:51.435 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:07:51.435 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:51.435 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:07:51.435 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:07:51.435 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:07:51.435 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:07:51.522 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:07:51.570 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:07:51.626 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:07:51.675 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:07:51.698 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:07:51.698 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:51.698 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:07:51.698 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:07:51.699 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:07:51.699 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:07:51.817 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:07:51.868 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:07:51.945 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:07:52.033 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:07:52.143 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:07:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:07:52.167 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:07:52.167 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:52.167 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:07:52.167 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:07:52.167 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:07:52.167 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:07:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:07:52.250 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:07:52.265 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:07:52.285 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:07:52.330 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:07:52.386 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:07:52.579 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:07:52.627 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:07:52.681 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:07:52.705 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:07:52.709 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:07:52.741 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:07:52.794 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:07:52.802 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:07:52.833 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:07:52.933 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:07:52.987 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:07:53.018 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:07:53.046 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:07:53.457 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:07:53.486 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:07:53.517 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:07:53.588 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:07:53.617 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:07:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:07:53.909 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:07:54.653 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:07:54.686 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:07:54.864 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:07:54.901 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:07:55.001 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:07:55.180 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:07:55.211 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:07:55.235 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:07:55.235 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:55.235 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:07:55.235 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:07:55.235 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:07:55.235 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:07:55.278 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:07:55.290 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:07:55.388 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:07:55.442 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:07:55.641 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:07:55.669 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:07:55.773 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:07:55.940 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:07:55.971 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:07:55.996 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:07:55.997 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:55.997 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:07:55.997 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:07:55.997 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:07:55.997 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:07:56.047 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:07:56.059 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:07:56.156 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:07:56.211 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:07:56.370 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:07:56.406 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:07:56.431 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:07:56.431 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:56.431 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:07:56.431 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:07:56.431 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:07:56.431 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:07:56.481 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:07:56.505 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:07:56.505 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:56.505 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:07:56.505 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:07:56.549 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:07:56.572 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:07:56.572 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:56.573 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:07:56.573 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:07:56.573 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:07:56.573 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:07:56.874 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:07:56.897 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:07:56.898 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:56.898 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:07:56.898 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:07:56.898 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:07:56.898 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:07:57.135 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:07:57.175 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:07:57.200 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:07:57.200 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:57.200 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:07:57.200 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:07:57.200 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:07:57.200 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:07:57.242 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:07:57.266 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:07:57.266 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:57.266 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:07:57.266 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:07:57.318 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:07:57.342 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:07:57.342 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:57.342 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:07:57.342 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:07:57.342 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:07:57.342 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:07:57.644 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:07:57.667 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:07:57.668 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:07:57.668 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:07:57.668 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:07:57.668 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:07:57.668 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:01.452 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:08:01.494 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:08:01.534 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:08:01.567 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:08:01.594 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:08:01.790 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:08:01.832 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:08:01.862 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:08:01.892 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:08:01.930 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:08:02.214 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:08:02.255 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:08:02.304 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:08:02.345 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:08:02.372 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:08:02.494 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:08:02.535 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:08:02.556 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:08:02.560 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:08:02.602 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:08:02.633 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:08:02.661 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:08:02.708 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:08:03.327 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:08:03.372 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:08:03.383 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:08:03.393 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:08:03.465 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:08:03.519 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:08:03.619 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:08:03.659 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:08:03.685 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:08:03.711 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:08:03.711 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:08:03.803 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:08:03.803 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:08:03.887 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:08:03.912 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:08:03.917 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:08:03.918 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:08:04.106 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:08:04.106 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:08:04.199 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:08:04.227 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:08:04.262 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:08:04.319 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:08:04.370 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:08:04.470 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:08:04.505 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:08:04.530 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:08:04.556 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:08:04.557 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:08:04.649 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:08:04.649 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:08:04.741 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:08:04.766 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:08:04.772 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:08:04.772 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:08:04.951 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:08:04.951 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:08:05.028 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:08:05.101 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:08:09.937 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:08:09.937 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:08:09.937 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:08:09.937 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:08:09.938 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:08:09.938 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:08:09.938 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:08:09.938 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:08:09.938 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:08:09.938 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:08:09.938 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:08:09.938 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:08:09.938 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:08:09.938 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:08:09.938 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:08:09.939 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:08:09.939 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:08:09.939 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:08:09.939 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:08:09.939 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:08:09.939 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:08:09.939 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:08:09.939 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:08:09.939 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:08:09.939 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:08:09.939 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:08:09.939 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:08:09.939 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:08:09.940 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:08:09.940 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:08:09.940 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:08:09.940 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:08:09.940 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:08:09.940 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:08:09.940 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:08:09.940 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:08:09.940 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:08:09.940 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:08:09.940 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:08:09.940 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:08:09.941 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:08:09.941 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:08:09.941 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:08:09.941 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:08:09.941 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:08:09.941 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:08:09.941 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:08:09.941 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:08:09.941 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:08:09.941 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:08:09.941 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:08:09.941 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:08:09.942 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:08:09.942 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:08:09.942 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:08:09.942 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:08:09.942 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:08:09.942 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:08:09.942 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:08:09.942 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:08:09.942 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:08:09.942 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:08:09.942 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:08:09.942 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:08:09.942 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:08:09.943 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:08:09.943 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:08:09.943 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:08:09.943 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:08:09.943 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:08:09.943 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:08:09.943 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:08:09.943 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:08:09.943 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:08:09.943 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:08:09.943 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:08:09.943 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:08:09.944 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:08:09.944 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:08:09.944 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:08:09.944 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:08:09.944 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:08:09.944 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:08:09.944 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:08:09.944 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:08:09.944 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:08:09.944 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:08:09.944 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:08:09.944 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:08:09.944 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:08:09.945 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:08:09.945 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:08:09.945 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:08:09.945 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:08:09.945 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:08:09.945 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:08:09.945 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:08:09.945 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:08:09.945 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:08:09.945 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:08:09.945 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:08:09.945 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:08:09.945 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:08:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:08:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:08:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:08:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:08:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:08:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:08:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:08:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:08:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:08:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:08:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:08:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:08:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:08:09.947 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:08:09.947 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:08:09.947 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:08:09.947 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:08:09.947 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:08:09.947 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:08:09.947 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:08:09.947 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:08:09.947 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:08:09.947 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:08:09.947 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:08:09.947 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:08:09.948 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:08:09.948 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:08:09.948 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:08:09.948 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:08:09.948 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:08:09.948 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:08:09.948 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:08:09.948 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:08:09.948 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:08:09.948 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:08:09.948 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:08:09.948 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:08:09.948 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:08:09.949 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:08:09.949 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:08:09.949 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:08:09.949 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:08:09.949 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:08:09.949 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:08:09.949 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:08:09.949 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:08:09.949 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:08:09.949 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:08:09.949 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:08:09.949 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:08:09.950 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:08:09.950 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:08:09.950 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:08:09.950 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:08:09.950 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:08:09.950 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:08:09.950 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:08:09.950 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:08:09.950 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:08:09.950 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:08:09.950 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:08:10.877 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:08:10.877 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:08:10.878 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:08:10.878 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:08:10.878 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:08:10.878 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:08:10.878 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:08:10.878 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:08:10.878 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:08:10.878 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:08:10.878 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:08:10.878 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:08:10.878 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:08:10.878 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:08:10.878 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:08:10.878 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:08:10.879 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:08:10.879 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:08:10.879 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:08:10.879 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:08:10.879 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:08:10.879 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:08:10.879 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:08:10.879 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:08:10.879 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:08:10.879 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:08:10.879 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:08:10.879 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:08:10.879 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:08:10.879 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:08:10.880 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:08:10.891 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:08:10.891 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:08:10.891 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:08:10.892 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:08:10.892 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:08:10.892 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:08:10.892 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:08:10.892 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:08:10.892 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:08:10.892 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:08:10.892 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:08:10.892 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:08:10.892 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:08:10.892 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:08:10.892 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:08:10.892 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:08:10.893 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:08:10.893 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:08:10.893 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:08:10.893 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:08:10.893 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:08:10.893 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:08:10.893 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:08:10.893 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:08:10.893 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:08:10.893 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:08:10.893 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:08:10.893 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:08:10.893 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:08:10.893 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:08:10.894 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:08:10.894 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:08:10.894 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:08:10.894 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:08:10.894 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:08:10.894 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:08:10.894 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:08:10.894 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:08:10.894 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:08:10.894 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:08:10.894 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:08:10.894 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:08:10.894 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:08:10.895 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:08:10.895 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:08:10.895 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:08:10.895 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:08:10.895 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:08:10.895 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:08:10.895 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:08:10.895 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:08:10.895 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:08:10.895 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:08:10.895 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:08:10.895 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:08:10.895 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:08:10.896 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:08:10.896 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:08:10.896 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:08:10.896 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:08:10.896 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:08:10.896 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:08:10.896 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:08:10.896 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:08:10.896 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:08:10.896 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:08:10.896 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:08:10.897 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:08:10.897 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:08:10.897 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:08:10.897 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:08:10.897 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:08:10.897 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:08:10.897 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:08:10.897 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:08:10.897 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:08:10.897 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:08:10.897 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:08:10.897 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:08:10.897 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:08:10.897 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:08:10.898 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:08:10.898 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:08:10.898 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:08:10.898 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:08:10.898 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:08:10.898 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:08:10.898 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:08:10.898 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:08:10.898 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:08:10.898 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:08:10.898 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:08:10.898 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:08:10.898 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:08:10.899 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:08:10.899 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:08:10.899 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:08:10.899 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:08:10.899 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:08:10.899 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:08:10.899 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:08:10.899 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:08:10.899 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:08:10.899 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:08:10.899 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:08:10.899 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:08:10.899 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:08:10.899 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:08:10.900 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:08:10.900 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:08:10.900 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:08:10.900 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:08:10.900 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:08:10.900 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:08:10.900 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:08:10.900 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:08:10.900 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:08:10.900 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:08:10.900 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:08:10.900 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:08:10.900 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:08:10.900 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:08:10.900 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:08:10.901 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:08:10.901 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:08:10.901 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:08:10.901 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:08:10.901 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:08:10.901 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:08:10.901 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:08:10.901 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:08:10.901 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:08:10.902 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:08:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:08:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:12.624 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2024-09-15T22:08:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:08:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:08:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:08:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:08:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:08:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:08:12.625 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-15T22:08:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:08:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:08:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:08:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:08:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:08:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:08:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:08:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:08:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:08:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:08:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:08:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:08:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:08:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:08:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:08:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:08:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:08:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:08:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:08:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:08:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:08:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:08:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:08:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:08:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:08:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:08:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:08:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:08:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:08:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:08:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:08:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:08:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:08:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:08:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:08:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:08:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:08:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:08:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:08:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:08:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:08:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:08:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:08:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:08:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:08:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:08:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:08:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:08:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:08:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:08:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:08:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:08:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:08:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:08:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:08:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:08:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:08:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:08:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:08:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:08:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:08:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:08:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:08:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:08:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:08:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:08:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:08:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:08:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:08:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:08:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:08:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:08:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:08:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:08:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:08:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:08:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:08:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:08:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:08:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:08:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:08:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:08:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:08:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:08:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:08:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:08:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:08:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:08:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:08:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:08:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:08:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:08:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:08:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:08:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:08:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:08:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:08:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:08:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:08:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:08:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:08:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:08:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:08:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:08:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:08:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:08:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:08:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:08:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:08:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:12.636 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-15T22:08:13.025 DEBUG:teuthology.parallel:result is None 2024-09-15T22:08:13.552 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:08:13.552 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:13.552 INFO:teuthology.orchestra.run.smithi078.stdout:Upgraded: 2024-09-15T22:08:13.552 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:08:13.553 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:08:13.553 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:08:13.553 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:08:13.553 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.553 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.553 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:08:13.553 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:08:13.553 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-15T22:08:13.553 INFO:teuthology.orchestra.run.smithi078.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:08:13.553 INFO:teuthology.orchestra.run.smithi078.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:08:13.553 INFO:teuthology.orchestra.run.smithi078.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:08:13.553 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:08:13.553 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.554 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.554 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.554 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.554 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:13.554 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.554 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.554 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.554 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:13.554 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:13.554 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:13.554 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:13.554 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:13.555 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.555 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.555 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:13.555 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.555 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.555 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.555 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:13.555 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:13.555 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.555 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.555 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:08:13.555 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:08:13.555 INFO:teuthology.orchestra.run.smithi078.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:08:13.556 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:08:13.556 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:08:13.556 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:08:13.556 INFO:teuthology.orchestra.run.smithi078.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:08:13.556 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:08:13.556 INFO:teuthology.orchestra.run.smithi078.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:08:13.556 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:08:13.556 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:08:13.556 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:08:13.556 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.556 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.556 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.556 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:08:13.557 INFO:teuthology.orchestra.run.smithi078.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:08:13.557 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:08:13.557 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:08:13.557 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:08:13.557 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.557 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.557 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:08:13.557 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.557 INFO:teuthology.orchestra.run.smithi078.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:08:13.557 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:08:13.557 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:08:13.557 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:08:13.557 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:08:13.558 INFO:teuthology.orchestra.run.smithi078.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:08:13.558 INFO:teuthology.orchestra.run.smithi078.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:08:13.558 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:08:13.558 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:08:13.558 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:08:13.558 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:08:13.558 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:08:13.558 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:08:13.558 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:08:13.558 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:08:13.558 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:08:13.558 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:08:13.559 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:08:13.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:08:13.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:08:13.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:08:13.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:08:13.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:08:13.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:08:13.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:08:13.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:08:13.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:08:13.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:08:13.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:08:13.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:08:13.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:08:13.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:08:13.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:08:13.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:08:13.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:08:13.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:08:13.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:08:13.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:08:13.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:08:13.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:08:13.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:08:13.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:08:13.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:08:13.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:08:13.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:08:13.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:08:13.562 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:08:13.562 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:08:13.562 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:08:13.562 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:08:13.562 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:08:13.562 INFO:teuthology.orchestra.run.smithi078.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:08:13.562 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:08:13.562 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:08:13.562 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:08:13.562 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:08:13.562 INFO:teuthology.orchestra.run.smithi078.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:08:13.562 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:08:13.562 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:08:13.563 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:08:13.563 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:08:13.563 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:08:13.563 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:08:13.563 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.563 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.563 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:08:13.563 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:08:13.563 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:08:13.563 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.563 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:08:13.563 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:08:13.563 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:08:13.563 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:08:13.564 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:08:13.564 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:08:13.564 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:08:13.564 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:08:13.564 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:08:13.564 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:08:13.564 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:08:13.564 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:08:13.564 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:08:13.564 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:08:13.564 INFO:teuthology.orchestra.run.smithi078.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:08:13.564 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.564 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.565 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:08:13.565 INFO:teuthology.orchestra.run.smithi078.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:08:13.565 INFO:teuthology.orchestra.run.smithi078.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:08:13.565 INFO:teuthology.orchestra.run.smithi078.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:08:13.565 INFO:teuthology.orchestra.run.smithi078.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:08:13.565 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:08:13.565 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:08:13.565 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:08:13.566 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:13.566 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-15T22:08:13.955 DEBUG:teuthology.parallel:result is None 2024-09-15T22:08:13.955 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:08:14.116 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:08:14.138 INFO:teuthology.orchestra.run.smithi078.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:08:14.138 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:08:14.139 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:08:14.140 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:08:14.281 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:08:14.308 INFO:teuthology.orchestra.run.smithi175.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:08:14.308 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:08:14.308 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:08:14.310 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T22:08:14.310 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:14.310 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:08:14.337 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:14.337 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:08:14.380 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T22:08:14.380 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:14.380 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:08:14.405 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:08:14.468 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:14.469 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:08:14.497 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:08:14.564 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T22:08:14.565 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:14.565 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:08:14.589 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:08:14.653 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:14.653 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:08:14.679 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:08:14.746 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T22:08:14.746 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:14.747 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:08:14.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:08:14.836 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:14.837 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:08:14.863 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:08:14.929 INFO:teuthology.run_tasks:Running task ceph... 2024-09-15T22:08:15.008 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-15T22:08:15.009 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2024-09-15T22:08:15.012 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2024-09-15T22:08:15.037 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-15T22:08:15.037 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T22:08:15.077 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T22:08:15.102 INFO:tasks.ceph:Creating extra log directories... 2024-09-15T22:08:15.103 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T22:08:15.142 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T22:08:15.174 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-15T22:08:15.174 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-15T22:08:15.174 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-15T22:08:15.174 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:15.174 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-15T22:08:15.220 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-15T22:08:15.331 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-15T22:08:15.356 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:15.356 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-15T22:08:15.372 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-15T22:08:15.483 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-15T22:08:15.513 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-15T22:08:15.513 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-15T22:08:15.514 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906235', 'branch': 'squid', 'description': 'fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_dbench traceless/50pc}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7906235', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 3393, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'sleep_before_teardown': 0, 'subset': '294/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPYlxwtR2lI2nS85B+DI2Ja+NV2fvU/dsxVHwdckonh0smQpGd/z+8PikuOTCyP6vW4MOZSi9mKRNxI7+MdUmIg=', 'smithi175.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDo1Bvr7jjXuQG79OyB6kNbP2DMkkFY+tRHgTLVtQDbWYLeff7lngVKw8ATUuznsCUBnZUUcTmw06fVRtEpYTwk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_21:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-15T22:08:15.514 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T22:08:15.516 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T22:08:15.566 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T22:08:15.572 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T22:08:15.631 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:15.631 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:08:15.649 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:08:15.649 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2024-09-15T22:08:15.705 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:08:15.705 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:15.705 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-15T22:08:15.705 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:15.705 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:15.705 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-15 22:08:05.455762817 +0000 2024-09-15T22:08:15.705 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-15 22:06:15.459482804 +0000 2024-09-15T22:08:15.705 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-15 22:06:15.459482804 +0000 2024-09-15T22:08:15.705 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-15 22:06:15.459482804 +0000 2024-09-15T22:08:15.706 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:08:15.767 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-15T22:08:15.767 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-15T22:08:15.768 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000187214 s, 2.7 MB/s 2024-09-15T22:08:15.769 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:08:15.825 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2024-09-15T22:08:15.880 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:08:15.880 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:15.880 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-15T22:08:15.881 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:15.881 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:15.881 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-15 22:08:05.455762817 +0000 2024-09-15T22:08:15.881 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-15 22:06:15.797477498 +0000 2024-09-15T22:08:15.881 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-15 22:06:15.797477498 +0000 2024-09-15T22:08:15.881 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-15 22:06:15.797477498 +0000 2024-09-15T22:08:15.881 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:08:15.943 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-15T22:08:15.944 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-15T22:08:15.944 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000196479 s, 2.6 MB/s 2024-09-15T22:08:15.945 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:08:16.001 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2024-09-15T22:08:16.057 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:08:16.057 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:16.057 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-15T22:08:16.057 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:16.057 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:16.057 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-15 22:08:05.455762817 +0000 2024-09-15T22:08:16.057 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-15 22:06:16.124472367 +0000 2024-09-15T22:08:16.057 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-15 22:06:16.124472367 +0000 2024-09-15T22:08:16.057 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-15 22:06:16.124472367 +0000 2024-09-15T22:08:16.058 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:08:16.119 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-15T22:08:16.119 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-15T22:08:16.119 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000204688 s, 2.5 MB/s 2024-09-15T22:08:16.120 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:08:16.177 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2024-09-15T22:08:16.232 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:08:16.232 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:16.232 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-15T22:08:16.232 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:16.232 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:16.232 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-15 22:08:05.456762801 +0000 2024-09-15T22:08:16.232 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-15 22:06:16.443467363 +0000 2024-09-15T22:08:16.233 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-15 22:06:16.443467363 +0000 2024-09-15T22:08:16.233 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-15 22:06:16.443467363 +0000 2024-09-15T22:08:16.233 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:08:16.294 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-15T22:08:16.294 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-15T22:08:16.295 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000196925 s, 2.6 MB/s 2024-09-15T22:08:16.295 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:08:16.352 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:08:16.352 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:16.352 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:08:16.371 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:08:16.371 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-09-15T22:08:16.431 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:08:16.431 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:16.431 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-15T22:08:16.432 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:16.432 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:16.432 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-15 22:08:04.640098744 +0000 2024-09-15T22:08:16.432 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-15 22:06:15.471350946 +0000 2024-09-15T22:08:16.432 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-15 22:06:15.471350946 +0000 2024-09-15T22:08:16.432 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-15 22:06:15.471350946 +0000 2024-09-15T22:08:16.432 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:08:16.499 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-15T22:08:16.499 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-15T22:08:16.499 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000216195 s, 2.4 MB/s 2024-09-15T22:08:16.500 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:08:16.559 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-09-15T22:08:16.616 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:08:16.617 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:16.617 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-15T22:08:16.617 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:16.617 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:16.617 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-15 22:08:04.640098744 +0000 2024-09-15T22:08:16.617 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-15 22:06:15.789345997 +0000 2024-09-15T22:08:16.617 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-15 22:06:15.789345997 +0000 2024-09-15T22:08:16.617 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-15 22:06:15.789345997 +0000 2024-09-15T22:08:16.617 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:08:16.684 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-15T22:08:16.684 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-15T22:08:16.685 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000277885 s, 1.8 MB/s 2024-09-15T22:08:16.686 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:08:16.744 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-09-15T22:08:16.802 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:08:16.802 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:16.802 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-15T22:08:16.802 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:16.802 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:16.802 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-15 22:08:04.640098744 +0000 2024-09-15T22:08:16.802 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-15 22:06:16.112340971 +0000 2024-09-15T22:08:16.802 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-15 22:06:16.112340971 +0000 2024-09-15T22:08:16.802 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-15 22:06:16.112340971 +0000 2024-09-15T22:08:16.802 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:08:16.867 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-15T22:08:16.868 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-15T22:08:16.868 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000215631 s, 2.4 MB/s 2024-09-15T22:08:16.869 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:08:16.926 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-09-15T22:08:16.984 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:08:16.984 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:16.984 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-15T22:08:16.984 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:16.985 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:16.985 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-15 22:08:04.641098728 +0000 2024-09-15T22:08:16.985 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-15 22:06:16.445335788 +0000 2024-09-15T22:08:16.985 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-15 22:06:16.445335788 +0000 2024-09-15T22:08:16.985 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-15 22:06:16.445335788 +0000 2024-09-15T22:08:16.985 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:08:17.050 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-15T22:08:17.050 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-15T22:08:17.050 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000239445 s, 2.1 MB/s 2024-09-15T22:08:17.051 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:08:17.108 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:08:17.108 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T22:08:17.108 INFO:tasks.ceph:Generating config... 2024-09-15T22:08:17.110 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-15T22:08:17.110 INFO:tasks.ceph:[client] debug client = 20 2024-09-15T22:08:17.110 INFO:tasks.ceph:[client] debug ms = 1 2024-09-15T22:08:17.110 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-15T22:08:17.110 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-15T22:08:17.110 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-15T22:08:17.110 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-15T22:08:17.110 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-15T22:08:17.110 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-09-15T22:08:17.111 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-09-15T22:08:17.111 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-09-15T22:08:17.111 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-09-15T22:08:17.111 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-15T22:08:17.111 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-15T22:08:17.111 INFO:tasks.ceph:[mds] mds inject traceless reply probability = 0.5 2024-09-15T22:08:17.111 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-15T22:08:17.111 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-15T22:08:17.111 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-15T22:08:17.111 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-15T22:08:17.111 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-15T22:08:17.112 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-15T22:08:17.112 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-15T22:08:17.112 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-15T22:08:17.112 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-15T22:08:17.112 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-15T22:08:17.112 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-15T22:08:17.112 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-15T22:08:17.112 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-15T22:08:17.112 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-15T22:08:17.112 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-15T22:08:17.112 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-15T22:08:17.113 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-15T22:08:17.113 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-15T22:08:17.113 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-15T22:08:17.113 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-15T22:08:17.113 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-15T22:08:17.113 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-15T22:08:17.113 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-15T22:08:17.113 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-15T22:08:17.114 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-15T22:08:17.114 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-15T22:08:17.114 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-15T22:08:17.114 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-15T22:08:17.114 INFO:tasks.ceph:Setting up mon.a... 2024-09-15T22:08:17.114 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-15T22:08:17.169 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.keyring 2024-09-15T22:08:17.172 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-15T22:08:17.217 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T22:08:17.283 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.78'), ('mon.b', '172.21.15.175'), ('mon.c', '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]')] 2024-09-15T22:08:17.283 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.78,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-15T22:08:17.284 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:17.284 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T22:08:17.338 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.78 --add b 172.21.15.175 --addv c '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:08:17.423 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:08:17.424 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: generated fsid 34e44e87-1d1a-416f-b208-c16e07980ff5 2024-09-15T22:08:17.424 INFO:teuthology.orchestra.run.smithi078.stdout:setting min_mon_release = quincy 2024-09-15T22:08:17.424 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 0 2024-09-15T22:08:17.424 INFO:teuthology.orchestra.run.smithi078.stdout:fsid 34e44e87-1d1a-416f-b208-c16e07980ff5 2024-09-15T22:08:17.424 INFO:teuthology.orchestra.run.smithi078.stdout:last_changed 2024-09-15T22:08:17.423133+0000 2024-09-15T22:08:17.424 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-15T22:08:17.423133+0000 2024-09-15T22:08:17.424 INFO:teuthology.orchestra.run.smithi078.stdout:min_mon_release 17 (quincy) 2024-09-15T22:08:17.424 INFO:teuthology.orchestra.run.smithi078.stdout:election_strategy: 1 2024-09-15T22:08:17.424 INFO:teuthology.orchestra.run.smithi078.stdout:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-15T22:08:17.424 INFO:teuthology.orchestra.run.smithi078.stdout:1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.b 2024-09-15T22:08:17.424 INFO:teuthology.orchestra.run.smithi078.stdout:2: [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] mon.c 2024-09-15T22:08:17.424 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-15T22:08:17.425 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T22:08:17.440 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 34e44e87-1d1a-416f-b208-c16e07980ff5... 2024-09-15T22:08:17.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:08:17.483 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:08:17.522 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2024-09-15T22:08:17.523 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2024-09-15T22:08:17.523 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:08:17.523 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2024-09-15T22:08:17.523 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.523 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2024-09-15T22:08:17.523 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.523 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2024-09-15T22:08:17.523 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.523 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2024-09-15T22:08:17.523 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2024-09-15T22:08:17.523 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.523 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2024-09-15T22:08:17.524 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2024-09-15T22:08:17.524 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.524 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:08:17.524 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2024-09-15T22:08:17.524 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.524 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:08:17.524 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:08:17.524 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.524 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2024-09-15T22:08:17.524 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.524 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2024-09-15T22:08:17.524 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2024-09-15T22:08:17.525 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:08:17.525 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:08:17.525 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2024-09-15T22:08:17.525 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:08:17.525 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2024-09-15T22:08:17.525 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:08:17.525 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:08:17.525 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2024-09-15T22:08:17.525 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.525 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:08:17.525 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.525 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2024-09-15T22:08:17.525 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.526 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2024-09-15T22:08:17.526 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.526 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2024-09-15T22:08:17.526 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2024-09-15T22:08:17.526 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2024-09-15T22:08:17.526 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.78,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2024-09-15T22:08:17.526 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = 34e44e87-1d1a-416f-b208-c16e07980ff5 2024-09-15T22:08:17.526 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.526 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2024-09-15T22:08:17.526 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2024-09-15T22:08:17.526 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.526 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2024-09-15T22:08:17.527 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2024-09-15T22:08:17.527 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:08:17.527 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.527 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2024-09-15T22:08:17.527 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2024-09-15T22:08:17.527 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.527 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2024-09-15T22:08:17.527 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2024-09-15T22:08:17.527 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2024-09-15T22:08:17.527 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug trim objects = true 2024-09-15T22:08:17.527 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.527 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2024-09-15T22:08:17.527 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2024-09-15T22:08:17.527 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.528 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:08:17.528 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.528 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2024-09-15T22:08:17.528 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.528 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2024-09-15T22:08:17.528 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.528 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:08:17.528 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2024-09-15T22:08:17.528 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.528 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2024-09-15T22:08:17.528 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2024-09-15T22:08:17.528 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2024-09-15T22:08:17.528 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore compression mode = aggressive 2024-09-15T22:08:17.528 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2024-09-15T22:08:17.529 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 20 2024-09-15T22:08:17.529 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 20 2024-09-15T22:08:17.529 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-15T22:08:17.529 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2024-09-15T22:08:17.529 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 10 2024-09-15T22:08:17.529 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:08:17.529 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2024-09-15T22:08:17.529 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:08:17.529 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:08:17.529 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2024-09-15T22:08:17.529 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2024-09-15T22:08:17.529 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.529 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2024-09-15T22:08:17.530 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-15T22:08:17.530 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2024-09-15T22:08:17.530 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-09-15T22:08:17.530 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-09-15T22:08:17.530 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:08:17.530 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:08:17.530 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2024-09-15T22:08:17.530 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2024-09-15T22:08:17.530 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.530 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2024-09-15T22:08:17.530 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-15T22:08:17.530 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-09-15T22:08:17.530 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2024-09-15T22:08:17.530 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2024-09-15T22:08:17.531 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:08:17.532 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.532 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:08:17.532 INFO:teuthology.orchestra.run.smithi078.stdout: mon down mkfs grace = 300 2024-09-15T22:08:17.532 INFO:teuthology.orchestra.run.smithi078.stdout: mon op complaint time = 120 2024-09-15T22:08:17.532 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on pool no app = False 2024-09-15T22:08:17.532 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:17.532 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2024-09-15T22:08:17.532 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2024-09-15T22:08:17.532 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2024-09-15T22:08:17.532 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2024-09-15T22:08:17.532 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:08:17.532 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:08:17.532 INFO:teuthology.orchestra.run.smithi078.stdout: client mount timeout = 600 2024-09-15T22:08:17.532 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2024-09-15T22:08:17.532 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-15T22:08:17.533 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2024-09-15T22:08:17.533 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2024-09-15T22:08:17.533 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2024-09-15T22:08:17.533 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2024-09-15T22:08:17.533 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2024-09-15T22:08:17.533 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2024-09-15T22:08:17.533 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2024-09-15T22:08:17.533 INFO:teuthology.orchestra.run.smithi078.stdout:[mds] 2024-09-15T22:08:17.533 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds = 20 2024-09-15T22:08:17.533 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds balancer = 20 2024-09-15T22:08:17.533 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-15T22:08:17.533 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal fragment size max = 10000 2024-09-15T22:08:17.533 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal merge size = 5 2024-09-15T22:08:17.533 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal split bits = 3 2024-09-15T22:08:17.534 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal split size = 100 2024-09-15T22:08:17.534 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug frag = True 2024-09-15T22:08:17.534 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug scatterstat = True 2024-09-15T22:08:17.534 INFO:teuthology.orchestra.run.smithi078.stdout: mds inject traceless reply probability = 0.5 2024-09-15T22:08:17.534 INFO:teuthology.orchestra.run.smithi078.stdout: mds op complaint time = 180 2024-09-15T22:08:17.534 INFO:teuthology.orchestra.run.smithi078.stdout: mds verify scatter = True 2024-09-15T22:08:17.534 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2024-09-15T22:08:17.534 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2024-09-15T22:08:17.534 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2024-09-15T22:08:17.535 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2024-09-15T22:08:17.535 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2024-09-15T22:08:17.535 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:08:17.535 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2024-09-15T22:08:17.535 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.535 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2024-09-15T22:08:17.535 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.535 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2024-09-15T22:08:17.535 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.535 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2024-09-15T22:08:17.535 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2024-09-15T22:08:17.535 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.535 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2024-09-15T22:08:17.536 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2024-09-15T22:08:17.536 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.536 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:08:17.536 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2024-09-15T22:08:17.536 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.536 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:08:17.536 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:08:17.536 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.536 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2024-09-15T22:08:17.536 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.536 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2024-09-15T22:08:17.536 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2024-09-15T22:08:17.536 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:08:17.537 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:08:17.537 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2024-09-15T22:08:17.537 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:08:17.537 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2024-09-15T22:08:17.537 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:08:17.537 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:08:17.537 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2024-09-15T22:08:17.537 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.537 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:08:17.537 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.537 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2024-09-15T22:08:17.537 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.538 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2024-09-15T22:08:17.538 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.538 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2024-09-15T22:08:17.538 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2024-09-15T22:08:17.538 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2024-09-15T22:08:17.538 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.78,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2024-09-15T22:08:17.538 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = 34e44e87-1d1a-416f-b208-c16e07980ff5 2024-09-15T22:08:17.538 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.538 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2024-09-15T22:08:17.538 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2024-09-15T22:08:17.538 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.538 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2024-09-15T22:08:17.538 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2024-09-15T22:08:17.538 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:08:17.538 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.539 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2024-09-15T22:08:17.539 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2024-09-15T22:08:17.539 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.539 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2024-09-15T22:08:17.539 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2024-09-15T22:08:17.539 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2024-09-15T22:08:17.539 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug trim objects = true 2024-09-15T22:08:17.539 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.539 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2024-09-15T22:08:17.539 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2024-09-15T22:08:17.539 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.539 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:08:17.539 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.539 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2024-09-15T22:08:17.539 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.540 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2024-09-15T22:08:17.540 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.540 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:08:17.540 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2024-09-15T22:08:17.540 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.540 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2024-09-15T22:08:17.540 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2024-09-15T22:08:17.540 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2024-09-15T22:08:17.540 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore compression mode = aggressive 2024-09-15T22:08:17.540 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2024-09-15T22:08:17.540 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 20 2024-09-15T22:08:17.540 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 20 2024-09-15T22:08:17.540 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-09-15T22:08:17.540 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2024-09-15T22:08:17.540 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 10 2024-09-15T22:08:17.541 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:08:17.541 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2024-09-15T22:08:17.541 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:08:17.541 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:08:17.541 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2024-09-15T22:08:17.541 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-09-15T22:08:17.541 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.541 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2024-09-15T22:08:17.541 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-09-15T22:08:17.541 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2024-09-15T22:08:17.541 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-09-15T22:08:17.541 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-09-15T22:08:17.541 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:08:17.541 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:08:17.541 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2024-09-15T22:08:17.542 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-09-15T22:08:17.542 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.542 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2024-09-15T22:08:17.542 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-09-15T22:08:17.542 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-09-15T22:08:17.542 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2024-09-15T22:08:17.542 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-09-15T22:08:17.542 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2024-09-15T22:08:17.542 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2024-09-15T22:08:17.542 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:08:17.542 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2024-09-15T22:08:17.542 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2024-09-15T22:08:17.542 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:08:17.542 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.542 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout: mon down mkfs grace = 300 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on pool no app = False 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-15T22:08:17.543 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2024-09-15T22:08:17.544 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2024-09-15T22:08:17.544 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2024-09-15T22:08:17.544 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2024-09-15T22:08:17.544 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:08:17.544 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:08:17.544 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2024-09-15T22:08:17.544 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-09-15T22:08:17.544 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-09-15T22:08:17.544 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-09-15T22:08:17.544 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-09-15T22:08:17.544 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2024-09-15T22:08:17.544 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2024-09-15T22:08:17.544 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2024-09-15T22:08:17.544 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-09-15T22:08:17.544 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-09-15T22:08:17.545 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2024-09-15T22:08:17.545 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2024-09-15T22:08:17.545 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds balancer = 20 2024-09-15T22:08:17.545 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-09-15T22:08:17.545 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal fragment size max = 10000 2024-09-15T22:08:17.545 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal merge size = 5 2024-09-15T22:08:17.545 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal split bits = 3 2024-09-15T22:08:17.545 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal split size = 100 2024-09-15T22:08:17.545 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2024-09-15T22:08:17.545 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = True 2024-09-15T22:08:17.545 INFO:teuthology.orchestra.run.smithi175.stdout: mds inject traceless reply probability = 0.5 2024-09-15T22:08:17.545 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2024-09-15T22:08:17.545 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = True 2024-09-15T22:08:17.545 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-09-15T22:08:17.545 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-09-15T22:08:17.546 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-09-15T22:08:17.547 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-15T22:08:17.547 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-15T22:08:17.640 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-15T22:08:17.641 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:17.641 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-15T22:08:17.656 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:17.656 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-15T22:08:17.711 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2024-09-15T22:08:17.711 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:17.711 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T22:08:17.712 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T22:08:17.786 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:17.786 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:08:17.842 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2024-09-15T22:08:17.842 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:17.842 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T22:08:17.842 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T22:08:17.882 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:17.882 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:08:17.938 INFO:tasks.ceph:Setting up mon nodes... 2024-09-15T22:08:17.939 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-15T22:08:17.939 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T22:08:17.990 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T22:08:17.993 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T22:08:18.060 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T22:08:18.063 INFO:tasks.ceph:Setting up mds nodes... 2024-09-15T22:08:18.063 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T22:08:18.113 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T22:08:18.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-15T22:08:18.140 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T22:08:18.193 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T22:08:18.196 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-15T22:08:18.220 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-15T22:08:18.220 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T22:08:18.261 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-15T22:08:18.273 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-15T22:08:18.274 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T22:08:18.274 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-15T22:08:18.338 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:08:18.338 INFO:tasks.ceph:role: osd.0 2024-09-15T22:08:18.338 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-15T22:08:18.338 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T22:08:18.410 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:08:18.410 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:08:18.410 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:08:18.410 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:08:18.410 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:08:18.410 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:08:18.410 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:08:18.411 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:08:18.411 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:08:18.411 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:08:18.909 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-15T22:08:18.911 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-15T22:08:18.911 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-15T22:08:19.016 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-15T22:08:19.047 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-15T22:08:19.111 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:08:19.111 INFO:tasks.ceph:role: osd.1 2024-09-15T22:08:19.111 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-15T22:08:19.111 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T22:08:19.183 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:08:19.183 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:08:19.183 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:08:19.184 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:08:19.184 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:08:19.184 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:08:19.184 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:08:19.184 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:08:19.184 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:08:19.184 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:08:19.639 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-15T22:08:19.641 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-15T22:08:19.641 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-15T22:08:19.715 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-15T22:08:19.785 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-15T22:08:19.850 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:08:19.850 INFO:tasks.ceph:role: osd.2 2024-09-15T22:08:19.850 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-15T22:08:19.850 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T22:08:19.923 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:08:19.923 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:08:19.923 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:08:19.923 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:08:19.923 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:08:19.923 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:08:19.924 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:08:19.924 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:08:19.924 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:08:19.924 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:08:20.408 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-15T22:08:20.607 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-15T22:08:20.607 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-15T22:08:20.709 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-15T22:08:20.739 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-15T22:08:20.804 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:08:20.804 INFO:tasks.ceph:role: osd.3 2024-09-15T22:08:20.804 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-15T22:08:20.804 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T22:08:20.876 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:08:20.876 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:08:20.876 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:08:20.877 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:08:20.877 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:08:20.877 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:08:20.877 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:08:20.877 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:08:20.877 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:08:20.877 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:08:21.383 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-15T22:08:21.385 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-15T22:08:21.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-15T22:08:21.522 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-15T22:08:21.551 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:08:21.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:21.647+0000 7f6ad16e6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-15T22:08:21.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:21.648+0000 7f6ad16e6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-15T22:08:21.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:21.648+0000 7f6ad16e6640 -1 bdev(0x5581195c3800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-15T22:08:21.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:21.648+0000 7f6ad16e6640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-15T22:08:25.298 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-15T22:08:25.329 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:08:25.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:25.421+0000 7f68cd3c5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-15T22:08:25.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:25.422+0000 7f68cd3c5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-15T22:08:25.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:25.422+0000 7f68cd3c5640 -1 bdev(0x5584d2ef1800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-15T22:08:25.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:25.422+0000 7f68cd3c5640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-15T22:08:28.344 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-15T22:08:28.372 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:08:28.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:28.459+0000 7ff38f410640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-15T22:08:28.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:28.459+0000 7ff38f410640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-15T22:08:28.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:28.459+0000 7ff38f410640 -1 bdev(0x55bb1ce6d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-15T22:08:28.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:28.460+0000 7ff38f410640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-15T22:08:32.110 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-15T22:08:32.139 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:08:32.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:32.226+0000 7f0d5dbbb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-15T22:08:32.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:32.226+0000 7f0d5dbbb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-15T22:08:32.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:32.226+0000 7f0d5dbbb640 -1 bdev(0x5654b2355800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-15T22:08:32.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:32.226+0000 7f0d5dbbb640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-15T22:08:35.628 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-15T22:08:35.655 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-15T22:08:35.686 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:08:35.686 INFO:tasks.ceph:role: osd.4 2024-09-15T22:08:35.686 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-15T22:08:35.686 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T22:08:35.765 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:08:35.765 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:08:35.765 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:08:35.765 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:08:35.765 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:08:35.765 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:08:35.765 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:08:35.766 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:08:35.766 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:08:35.766 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:08:36.277 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-09-15T22:08:36.279 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-09-15T22:08:36.279 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-15T22:08:36.387 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-15T22:08:36.422 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-15T22:08:36.489 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:08:36.489 INFO:tasks.ceph:role: osd.5 2024-09-15T22:08:36.489 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-15T22:08:36.489 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T22:08:36.563 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:08:36.563 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:08:36.563 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:08:36.563 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:08:36.563 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:08:36.563 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:08:36.564 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:08:36.564 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:08:36.564 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:08:36.564 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:08:37.035 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-09-15T22:08:37.037 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-09-15T22:08:37.037 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-15T22:08:37.131 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-15T22:08:37.162 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-15T22:08:37.228 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:08:37.228 INFO:tasks.ceph:role: osd.6 2024-09-15T22:08:37.228 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-15T22:08:37.229 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T22:08:37.301 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:08:37.301 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:08:37.301 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:08:37.301 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:08:37.301 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:08:37.301 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:08:37.301 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:08:37.302 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:08:37.302 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:08:37.302 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:08:37.790 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-09-15T22:08:37.792 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-09-15T22:08:37.792 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-15T22:08:37.932 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-15T22:08:37.965 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-15T22:08:38.033 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:08:38.033 INFO:tasks.ceph:role: osd.7 2024-09-15T22:08:38.033 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-15T22:08:38.033 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T22:08:38.108 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:08:38.108 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:08:38.108 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:08:38.109 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T22:08:38.109 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:08:38.109 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:08:38.109 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:08:38.109 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T22:08:38.109 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:08:38.109 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:08:38.622 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-09-15T22:08:38.624 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-09-15T22:08:38.624 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-15T22:08:38.740 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-15T22:08:38.773 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:08:38.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:38.870+0000 7f41a1f34640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-15T22:08:38.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:38.870+0000 7f41a1f34640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-15T22:08:38.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:38.870+0000 7f41a1f34640 -1 bdev(0x5599a0279800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-15T22:08:38.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:38.870+0000 7f41a1f34640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-15T22:08:41.811 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-15T22:08:41.840 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:08:41.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:41.931+0000 7fae9fe15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-15T22:08:41.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:41.931+0000 7fae9fe15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-15T22:08:41.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:41.931+0000 7fae9fe15640 -1 bdev(0x557f1c531800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-15T22:08:41.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:41.931+0000 7fae9fe15640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-15T22:08:44.849 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-15T22:08:44.878 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:08:44.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:44.968+0000 7f29e1a0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-15T22:08:44.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:44.968+0000 7f29e1a0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-15T22:08:44.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:44.968+0000 7f29e1a0c640 -1 bdev(0x5589cce1d800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-15T22:08:44.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:44.968+0000 7f29e1a0c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-15T22:08:45.515 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:08:45.518 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:08:48.129 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-15T22:08:48.158 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:08:48.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:48.248+0000 7ff17c3fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-15T22:08:48.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:48.248+0000 7ff17c3fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-15T22:08:48.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:48.248+0000 7ff17c3fd640 -1 bdev(0x55b5e07ed800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-15T22:08:48.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:48.249+0000 7ff17c3fd640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-15T22:08:51.416 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-15T22:08:51.446 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-15T22:08:51.446 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:51.446 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-15T22:08:51.475 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:51.475 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-15T22:08:51.543 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:51.543 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-15T22:08:51.610 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:51.610 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-15T22:08:51.677 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:51.677 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-15T22:08:51.743 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:51.743 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-15T22:08:51.809 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:51.809 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-15T22:08:51.839 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:51.839 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-15T22:08:51.908 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:51.908 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-15T22:08:51.977 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:51.978 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-15T22:08:52.047 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:52.047 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-15T22:08:52.116 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:52.116 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-15T22:08:52.184 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:52.184 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-15T22:08:52.201 INFO:tasks.ceph:Adding keys to all mons... 2024-09-15T22:08:52.201 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T22:08:52.244 DEBUG:teuthology.orchestra.run.smithi175:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T22:08:52.266 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2024-09-15T22:08:52.267 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDRWudm3loLOxAAIk7al217mkgJ20/UI4Gz+A== 2024-09-15T22:08:52.267 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2024-09-15T22:08:52.267 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDSWudmAUK6BhAAeuzBp5JkM3smDnsjld144Q== 2024-09-15T22:08:52.267 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2024-09-15T22:08:52.267 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDVWudmL7WoJhAAVkZetJmD9hmtT/cQAgxcFg== 2024-09-15T22:08:52.267 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2024-09-15T22:08:52.267 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDZWudmTik4GRAAaGnbFxF7Q9VkSvrUY3G1SA== 2024-09-15T22:08:52.267 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2024-09-15T22:08:52.267 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDcWudmyH53GxAATnsIfSAXeIMhPPidUDEtMA== 2024-09-15T22:08:52.267 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2024-09-15T22:08:52.267 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDgWudmNiqQDRAAAUV36rPVM7omY7y29sz20Q== 2024-09-15T22:08:52.267 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2024-09-15T22:08:52.268 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDSWudmYXyPAxAAMKkAZCtAfqR6HKiEFOZIsA== 2024-09-15T22:08:52.268 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2024-09-15T22:08:52.268 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDSWudmBIZ/CxAAjCeoA8wvNQN30IPlQarjgA== 2024-09-15T22:08:52.268 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2024-09-15T22:08:52.268 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDmWudmLyztMxAALyuJyYEu1Ul71ompLJQyMA== 2024-09-15T22:08:52.268 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2024-09-15T22:08:52.268 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDpWudm/tuNNxAAXNT1kaM1fRnhEy6goO2izw== 2024-09-15T22:08:52.268 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2024-09-15T22:08:52.268 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDsWudmj7O/ORAAuyfZWW4G/nsy03fzk6DhuA== 2024-09-15T22:08:52.268 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2024-09-15T22:08:52.268 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDwWudmRWvdDhAAVCROPxP6I8u6HnqjhFD9ZQ== 2024-09-15T22:08:52.268 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-09-15T22:08:52.268 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDSWudmAiKODxAAiAEpmadAGJ+wLb0Fvm/2XA== 2024-09-15T22:08:52.269 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.y] 2024-09-15T22:08:52.269 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDRWudm3loLOxAAIk7al217mkgJ20/UI4Gz+A== 2024-09-15T22:08:52.269 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-09-15T22:08:52.270 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDSWudmAUK6BhAAeuzBp5JkM3smDnsjld144Q== 2024-09-15T22:08:52.270 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.0] 2024-09-15T22:08:52.270 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDVWudmL7WoJhAAVkZetJmD9hmtT/cQAgxcFg== 2024-09-15T22:08:52.270 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.1] 2024-09-15T22:08:52.270 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDZWudmTik4GRAAaGnbFxF7Q9VkSvrUY3G1SA== 2024-09-15T22:08:52.270 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.2] 2024-09-15T22:08:52.270 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDcWudmyH53GxAATnsIfSAXeIMhPPidUDEtMA== 2024-09-15T22:08:52.270 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.3] 2024-09-15T22:08:52.270 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDgWudmNiqQDRAAAUV36rPVM7omY7y29sz20Q== 2024-09-15T22:08:52.270 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.x] 2024-09-15T22:08:52.270 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDSWudmYXyPAxAAMKkAZCtAfqR6HKiEFOZIsA== 2024-09-15T22:08:52.270 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-09-15T22:08:52.270 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDSWudmBIZ/CxAAjCeoA8wvNQN30IPlQarjgA== 2024-09-15T22:08:52.270 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.4] 2024-09-15T22:08:52.270 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDmWudmLyztMxAALyuJyYEu1Ul71ompLJQyMA== 2024-09-15T22:08:52.271 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.5] 2024-09-15T22:08:52.271 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDpWudm/tuNNxAAXNT1kaM1fRnhEy6goO2izw== 2024-09-15T22:08:52.271 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.6] 2024-09-15T22:08:52.271 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDsWudmj7O/ORAAuyfZWW4G/nsy03fzk6DhuA== 2024-09-15T22:08:52.271 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.7] 2024-09-15T22:08:52.271 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDwWudmRWvdDhAAVCROPxP6I8u6HnqjhFD9ZQ== 2024-09-15T22:08:52.271 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2024-09-15T22:08:52.271 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDSWudmAiKODxAAiAEpmadAGJ+wLb0Fvm/2XA== 2024-09-15T22:08:52.272 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:08:52.312 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:08:52.366 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:08:52.369 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:08:52.423 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.426 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.476 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.478 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.530 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.532 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.584 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.586 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.636 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:08:52.639 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:08:52.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:08:52.692 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:08:52.746 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.748 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.799 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.802 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.853 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.855 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.906 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.908 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:08:52.958 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:08:52.961 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:08:53.014 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-15T22:08:53.015 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-15T22:08:53.039 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T22:08:53.135 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-15T22:08:53.159 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-15T22:08:53.185 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T22:08:53.281 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-15T22:08:53.306 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-15T22:08:53.370 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T22:08:53.466 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-15T22:08:53.490 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:08:53.493 DEBUG:teuthology.orchestra.run.smithi175:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:08:53.546 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-15T22:08:53.546 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-15T22:08:53.546 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-15T22:08:53.549 INFO:tasks.ceph.mon.a:Started 2024-09-15T22:08:53.549 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-15T22:08:53.549 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-15T22:08:53.588 INFO:tasks.ceph.mon.b:Started 2024-09-15T22:08:53.588 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-15T22:08:53.589 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-15T22:08:53.590 INFO:tasks.ceph.mon.c:Started 2024-09-15T22:08:53.590 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-15T22:08:53.591 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-15T22:08:53.591 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-15T22:08:53.593 INFO:tasks.ceph.mgr.y:Started 2024-09-15T22:08:53.593 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-15T22:08:53.593 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-15T22:08:53.595 INFO:tasks.ceph.mgr.x:Started 2024-09-15T22:08:53.595 INFO:tasks.ceph:Setting crush tunables to default 2024-09-15T22:08:53.596 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd crush tunables default 2024-09-15T22:08:53.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.692+0000 7f9cd2159640 1 Processor -- start 2024-09-15T22:08:53.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.692+0000 7f9cd2159640 1 -- start start 2024-09-15T22:08:53.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.693+0000 7f9cd2159640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ccc14bd00 0x7f9ccc1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:53.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.693+0000 7f9cd2159640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ccc0751f0 con 0x7f9ccc074e10 2024-09-15T22:08:53.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.693+0000 7f9cd2159640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ccc074300 con 0x7f9ccc0b3e00 2024-09-15T22:08:53.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.693+0000 7f9cd2159640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9ccc0b0640 con 0x7f9ccc14bd00 2024-09-15T22:08:53.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.693+0000 7f9ccb7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9ccc074e10 0x7f9ccc0af310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57262/0 (socket says 172.21.15.78:57262) 2024-09-15T22:08:53.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.693+0000 7f9ccb7fe640 1 -- 172.21.15.78:0/3185337150 learned_addr learned my addr 172.21.15.78:0/3185337150 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:08:53.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.693+0000 7f9ccbfff640 1 --2- 172.21.15.78:0/3185337150 >> v2:172.21.15.175:3300/0 conn(0x7f9ccc14bd00 0x7f9ccc1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:53.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.693+0000 7f9ccbfff640 1 -- 172.21.15.78:0/3185337150 >> v2:172.21.15.175:3300/0 conn(0x7f9ccc14bd00 msgr2=0x7f9ccc1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T22:08:53.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.693+0000 7f9ccbfff640 1 -- 172.21.15.78:0/3185337150 >> v2:172.21.15.175:3300/0 conn(0x7f9ccc14bd00 msgr2=0x7f9ccc1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:08:53.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.693+0000 7f9ccbfff640 1 --2- 172.21.15.78:0/3185337150 >> v2:172.21.15.175:3300/0 conn(0x7f9ccc14bd00 0x7f9ccc1533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:08:53.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.693+0000 7f9ccbfff640 1 --2- 172.21.15.78:0/3185337150 >> v2:172.21.15.175:3300/0 conn(0x7f9ccc14bd00 0x7f9ccc1533e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:08:53.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.850+0000 7f9cca7fc640 1 -- 172.21.15.78:0/3185337150 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870258026 0 0) 0x7f9ccc0751f0 con 0x7f9ccc074e10 2024-09-15T22:08:53.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.850+0000 7f9cca7fc640 1 -- 172.21.15.78:0/3185337150 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cb4003520 con 0x7f9ccc074e10 2024-09-15T22:08:53.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.850+0000 7f9cca7fc640 1 -- 172.21.15.78:0/3185337150 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3839204313 0 0) 0x7f9cb4003520 con 0x7f9ccc074e10 2024-09-15T22:08:53.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.850+0000 7f9cca7fc640 1 -- 172.21.15.78:0/3185337150 >> v2:172.21.15.175:3300/0 conn(0x7f9ccc14bd00 msgr2=0x7f9ccc1533e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:08:53.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.850+0000 7f9cca7fc640 1 --2- 172.21.15.78:0/3185337150 >> v2:172.21.15.175:3300/0 conn(0x7f9ccc14bd00 0x7f9ccc1533e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:53.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.850+0000 7f9cca7fc640 1 -- 172.21.15.78:0/3185337150 >> v1:172.21.15.175:6789/0 conn(0x7f9ccc0b3e00 legacy=0x7f9ccc14b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:53.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.850+0000 7f9cca7fc640 1 -- 172.21.15.78:0/3185337150 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc0b0920 con 0x7f9ccc074e10 2024-09-15T22:08:53.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.850+0000 7f9cca7fc640 1 -- 172.21.15.78:0/3185337150 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3961011974 0 0) 0x7f9cbc001670 con 0x7f9ccc074e10 2024-09-15T22:08:53.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.850+0000 7f9cca7fc640 1 -- 172.21.15.78:0/3185337150 >> v1:172.21.15.78:6789/0 conn(0x7f9ccc074e10 legacy=0x7f9ccc0af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:53.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.851+0000 7f9cca7fc640 1 --2- 172.21.15.78:0/3185337150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cb4003a00 0x7f9cb4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:53.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.851+0000 7f9cca7fc640 1 --2- 172.21.15.78:0/3185337150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb4004800 0x7f9cb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:53.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.851+0000 7f9cca7fc640 1 --2- 172.21.15.78:0/3185337150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cb4005210 0x7f9cb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:53.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.851+0000 7f9cca7fc640 1 -- 172.21.15.78:0/3185337150 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc0b0640 con 0x7f9cb4004800 2024-09-15T22:08:53.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.851+0000 7f9cca7fc640 1 -- 172.21.15.78:0/3185337150 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb400c160 con 0x7f9cb4005210 2024-09-15T22:08:53.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.851+0000 7f9cca7fc640 1 -- 172.21.15.78:0/3185337150 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb400c360 con 0x7f9cb4003a00 2024-09-15T22:08:53.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.851+0000 7f9ccaffd640 1 --2- 172.21.15.78:0/3185337150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb4004800 0x7f9cb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:53.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.851+0000 7f9ccb7fe640 1 --2- 172.21.15.78:0/3185337150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cb4003a00 0x7f9cb4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:53.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.851+0000 7f9ccbfff640 1 --2- 172.21.15.78:0/3185337150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cb4005210 0x7f9cb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:53.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.851+0000 7f9ccaffd640 1 -- 172.21.15.78:0/3185337150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cb4003a00 msgr2=0x7f9cb4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:08:53.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.851+0000 7f9ccaffd640 1 --2- 172.21.15.78:0/3185337150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cb4003a00 0x7f9cb4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:53.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.851+0000 7f9ccaffd640 1 -- 172.21.15.78:0/3185337150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cb4005210 msgr2=0x7f9cb400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:08:53.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.851+0000 7f9ccaffd640 1 --2- 172.21.15.78:0/3185337150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cb4005210 0x7f9cb400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:53.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.851+0000 7f9ccaffd640 1 -- 172.21.15.78:0/3185337150 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb4003520 con 0x7f9cb4004800 2024-09-15T22:08:53.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.851+0000 7f9ccbfff640 1 -- 172.21.15.78:0/3185337150 reap_dead start 2024-09-15T22:08:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.852+0000 7f9ccaffd640 1 --2- 172.21.15.78:0/3185337150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb4004800 0x7f9cb4004c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0001750 tx=0x7f9cb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33595ed99399a59 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.852+0000 7f9cca7fc640 1 -- 172.21.15.78:0/3185337150 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0001370 con 0x7f9cb4004800 2024-09-15T22:08:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.852+0000 7f9cca7fc640 1 -- 172.21.15.78:0/3185337150 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc00052d0 con 0x7f9cb4004800 2024-09-15T22:08:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.852+0000 7f9cca7fc640 1 -- 172.21.15.78:0/3185337150 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc002abc0 con 0x7f9cb4004800 2024-09-15T22:08:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.852+0000 7f9cd2159640 1 -- 172.21.15.78:0/3185337150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb4004800 msgr2=0x7f9cb4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.852+0000 7f9cd2159640 1 --2- 172.21.15.78:0/3185337150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb4004800 0x7f9cb4004c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0001750 tx=0x7f9cb4005830 comp rx=0 tx=0).stop 2024-09-15T22:08:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.852+0000 7f9cd2159640 1 -- 172.21.15.78:0/3185337150 shutdown_connections 2024-09-15T22:08:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.853+0000 7f9cd2159640 1 --2- 172.21.15.78:0/3185337150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb4004800 0x7f9cb4004c80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.853+0000 7f9cd2159640 1 -- 172.21.15.78:0/3185337150 >> 172.21.15.78:0/3185337150 conn(0x7f9ccc0ba2a0 msgr2=0x7f9ccc0ba6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.853+0000 7f9cd2159640 1 -- 172.21.15.78:0/3185337150 shutdown_connections 2024-09-15T22:08:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.853+0000 7f9cd2159640 1 -- 172.21.15.78:0/3185337150 wait complete. 2024-09-15T22:08:53.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.854+0000 7f9cd2159640 1 Processor -- start 2024-09-15T22:08:53.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.854+0000 7f9cd2159640 1 -- start start 2024-09-15T22:08:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.854+0000 7f9cd2159640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cb4004800 0x7f9ccc072c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.854+0000 7f9cd2159640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ccc0706b0 0x7f9ccc144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.854+0000 7f9cd2159640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ccc144d60 0x7f9ccc1e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.854+0000 7f9cd2159640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc0b12d0 con 0x7f9ccc0706b0 2024-09-15T22:08:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.854+0000 7f9cd2159640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc0b5d60 con 0x7f9cb4004800 2024-09-15T22:08:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.854+0000 7f9cd2159640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9ccc0b1450 con 0x7f9ccc144d60 2024-09-15T22:08:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.854+0000 7f9ccaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ccc0706b0 0x7f9ccc144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.854+0000 7f9ccaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ccc0706b0 0x7f9ccc144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40520/0 (socket says 172.21.15.78:40520) 2024-09-15T22:08:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.854+0000 7f9ccaffd640 1 -- 172.21.15.78:0/3227963416 learned_addr learned my addr 172.21.15.78:0/3227963416 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:08:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.854+0000 7f9ccb7fe640 1 --2- 172.21.15.78:0/3227963416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cb4004800 0x7f9ccc072c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.855+0000 7f9ccbfff640 1 --2- 172.21.15.78:0/3227963416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ccc144d60 0x7f9ccc1e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.855+0000 7f9ccaffd640 1 -- 172.21.15.78:0/3227963416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ccc144d60 msgr2=0x7f9ccc1e0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.855+0000 7f9ccaffd640 1 --2- 172.21.15.78:0/3227963416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ccc144d60 0x7f9ccc1e0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:53.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.855+0000 7f9ccaffd640 1 -- 172.21.15.78:0/3227963416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cb4004800 msgr2=0x7f9ccc072c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:53.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.855+0000 7f9ccaffd640 1 --2- 172.21.15.78:0/3227963416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cb4004800 0x7f9ccc072c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:53.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.855+0000 7f9ccaffd640 1 -- 172.21.15.78:0/3227963416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc072210 con 0x7f9ccc0706b0 2024-09-15T22:08:53.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.855+0000 7f9ccaffd640 1 --2- 172.21.15.78:0/3227963416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ccc0706b0 0x7f9ccc144820 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0000c00 tx=0x7f9cc0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:53.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.856+0000 7f9cb3fff640 1 -- 172.21.15.78:0/3227963416 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc003f030 con 0x7f9ccc0706b0 2024-09-15T22:08:53.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.856+0000 7f9cb3fff640 1 -- 172.21.15.78:0/3227963416 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc0005480 con 0x7f9ccc0706b0 2024-09-15T22:08:53.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.856+0000 7f9cb3fff640 1 -- 172.21.15.78:0/3227963416 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0037040 con 0x7f9ccc0706b0 2024-09-15T22:08:53.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.856+0000 7f9cd2159640 1 -- 172.21.15.78:0/3227963416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ccc144320 con 0x7f9ccc0706b0 2024-09-15T22:08:53.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.856+0000 7f9cd2159640 1 -- 172.21.15.78:0/3227963416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ccc071280 con 0x7f9ccc0706b0 2024-09-15T22:08:53.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.856+0000 7f9cb3fff640 1 -- 172.21.15.78:0/3227963416 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9cc0042070 con 0x7f9ccc0706b0 2024-09-15T22:08:53.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.856+0000 7f9cb3fff640 1 -- 172.21.15.78:0/3227963416 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9cc0003930 con 0x7f9ccc0706b0 2024-09-15T22:08:53.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.857+0000 7f9cd2159640 1 -- 172.21.15.78:0/3227963416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ccc0751f0 con 0x7f9ccc0706b0 2024-09-15T22:08:53.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.860+0000 7f9cb3fff640 1 -- 172.21.15.78:0/3227963416 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9cc0001370 con 0x7f9ccc0706b0 2024-09-15T22:08:53.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.923+0000 7f9cd2159640 1 -- 172.21.15.78:0/3227963416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f9ccc072480 con 0x7f9ccc0706b0 2024-09-15T22:08:53.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.925+0000 7f9cb3fff640 1 -- 172.21.15.78:0/3227963416 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f9cc00067d0 con 0x7f9ccc0706b0 2024-09-15T22:08:53.926 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2024-09-15T22:08:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.926+0000 7f9cd2159640 1 -- 172.21.15.78:0/3227963416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ccc0706b0 msgr2=0x7f9ccc144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.926+0000 7f9cd2159640 1 --2- 172.21.15.78:0/3227963416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ccc0706b0 0x7f9ccc144820 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0000c00 tx=0x7f9cc0001120 comp rx=0 tx=0).stop 2024-09-15T22:08:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.926+0000 7f9cd2159640 1 -- 172.21.15.78:0/3227963416 shutdown_connections 2024-09-15T22:08:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.926+0000 7f9cd2159640 1 --2- 172.21.15.78:0/3227963416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ccc144d60 0x7f9ccc1e0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.926+0000 7f9cd2159640 1 --2- 172.21.15.78:0/3227963416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ccc0706b0 0x7f9ccc144820 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.926+0000 7f9cd2159640 1 --2- 172.21.15.78:0/3227963416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cb4004800 0x7f9ccc072c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.926+0000 7f9cd2159640 1 -- 172.21.15.78:0/3227963416 >> 172.21.15.78:0/3227963416 conn(0x7f9ccc0ba2a0 msgr2=0x7f9ccc147790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:53.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.926+0000 7f9cd2159640 1 -- 172.21.15.78:0/3227963416 shutdown_connections 2024-09-15T22:08:53.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:53.926+0000 7f9cd2159640 1 -- 172.21.15.78:0/3227963416 wait complete. 2024-09-15T22:08:53.938 INFO:tasks.ceph:check_enable_crimson: False 2024-09-15T22:08:53.938 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-15T22:08:53.939 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:53.939 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-15T22:08:53.954 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:53.953+0000 7fede6130040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:08:53.963 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:53.963 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-15T22:08:53.970 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:53.969+0000 7f56da720040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:08:53.994 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:53.994 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-15T22:08:53.995 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:53.993+0000 7fede6130040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:08:54.014 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:54.012+0000 7f56da720040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:08:54.038 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:08:54.038 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-15T22:08:54.103 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:54.103 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-15T22:08:54.127 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:54.127 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-15T22:08:54.152 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:54.151+0000 7fede6130040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:08:54.167 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:54.165+0000 7f56da720040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:08:54.176 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:54.177 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-15T22:08:54.205 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:54.203+0000 7fede6130040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:08:54.217 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:54.215+0000 7f56da720040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:08:54.230 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-15T22:08:54.230 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-15T22:08:54.295 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 71eb9af6-bf66-4450-a5d1-d4a81f71f95b 0 2024-09-15T22:08:54.383 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:54.381+0000 7f56da720040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:08:54.388 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:54.387+0000 7fede6130040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:08:54.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.433+0000 7f3473ce4640 1 Processor -- start 2024-09-15T22:08:54.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.433+0000 7f3473ce4640 1 -- start start 2024-09-15T22:08:54.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.434+0000 7f3473ce4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f346c0b0040 0x7f346c1417c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:54.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.434+0000 7f3473ce4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c148370 0x7f346c141d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:54.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.434+0000 7f3473ce4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f346c0b5a40 con 0x7f346c0b5660 2024-09-15T22:08:54.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.434+0000 7f3473ce4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f346c0af6b0 con 0x7f346c0b0040 2024-09-15T22:08:54.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.434+0000 7f3473ce4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f346c0b0590 con 0x7f346c148370 2024-09-15T22:08:54.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.434+0000 7f3471a80640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f346c0b5660 0x7f346c147c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:55056/0 (socket says 172.21.15.175:55056) 2024-09-15T22:08:54.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.434+0000 7f3472281640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c148370 0x7f346c141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:54.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.434+0000 7f3471a80640 1 -- 172.21.15.175:0/1796939601 learned_addr learned my addr 172.21.15.175:0/1796939601 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-09-15T22:08:54.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.434+0000 7f347127f640 1 --2- 172.21.15.175:0/1796939601 >> v2:172.21.15.78:3300/0 conn(0x7f346c0b0040 0x7f346c1417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:54.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.434+0000 7f3472281640 1 -- 172.21.15.175:0/1796939601 >> v2:172.21.15.78:3300/0 conn(0x7f346c0b0040 msgr2=0x7f346c1417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:08:54.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.434+0000 7f3472281640 1 --2- 172.21.15.175:0/1796939601 >> v2:172.21.15.78:3300/0 conn(0x7f346c0b0040 0x7f346c1417c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.434+0000 7f3472281640 1 -- 172.21.15.175:0/1796939601 >> v1:172.21.15.175:6789/0 conn(0x7f346c0b5660 legacy=0x7f346c147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:54.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.434+0000 7f3472281640 1 -- 172.21.15.175:0/1796939601 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346c0af060 con 0x7f346c148370 2024-09-15T22:08:54.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.435+0000 7f3472281640 1 --2- 172.21.15.175:0/1796939601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c148370 0x7f346c141d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3464009d90 tx=0x7f346402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d5df4add15e868b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:54.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.435+0000 7f3470a7e640 1 -- 172.21.15.175:0/1796939601 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464031600 con 0x7f346c148370 2024-09-15T22:08:54.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.435+0000 7f3470a7e640 1 -- 172.21.15.175:0/1796939601 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34640317a0 con 0x7f346c148370 2024-09-15T22:08:54.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.435+0000 7f3470a7e640 1 -- 172.21.15.175:0/1796939601 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464031b70 con 0x7f346c148370 2024-09-15T22:08:54.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.436+0000 7f3473ce4640 1 -- 172.21.15.175:0/1796939601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c148370 msgr2=0x7f346c141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:54.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.436+0000 7f3473ce4640 1 --2- 172.21.15.175:0/1796939601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c148370 0x7f346c141d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3464009d90 tx=0x7f346402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.436+0000 7f3473ce4640 1 -- 172.21.15.175:0/1796939601 shutdown_connections 2024-09-15T22:08:54.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.436+0000 7f3473ce4640 1 --2- 172.21.15.175:0/1796939601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c148370 0x7f346c141d00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.436+0000 7f3473ce4640 1 --2- 172.21.15.175:0/1796939601 >> v2:172.21.15.78:3300/0 conn(0x7f346c0b0040 0x7f346c1417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.436+0000 7f3473ce4640 1 -- 172.21.15.175:0/1796939601 >> 172.21.15.175:0/1796939601 conn(0x7f346c0b66c0 msgr2=0x7f346c0b6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:54.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.436+0000 7f3473ce4640 1 -- 172.21.15.175:0/1796939601 shutdown_connections 2024-09-15T22:08:54.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.436+0000 7f3473ce4640 1 -- 172.21.15.175:0/1796939601 wait complete. 2024-09-15T22:08:54.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.437+0000 7f3473ce4640 1 Processor -- start 2024-09-15T22:08:54.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.437+0000 7f3473ce4640 1 -- start start 2024-09-15T22:08:54.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.437+0000 7f3473ce4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c0b0040 0x7f346c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:54.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.437+0000 7f3473ce4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c0b5660 0x7f346c072790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:54.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.437+0000 7f3473ce4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f346c148370 0x7f346c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:54.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.437+0000 7f3473ce4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f346c0737b0 con 0x7f346c148370 2024-09-15T22:08:54.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.437+0000 7f3473ce4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f346c073630 con 0x7f346c0b5660 2024-09-15T22:08:54.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.437+0000 7f3473ce4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f346c073930 con 0x7f346c0b0040 2024-09-15T22:08:54.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f347127f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c0b5660 0x7f346c072790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:54.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f3471a80640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c0b0040 0x7f346c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f347127f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c0b5660 0x7f346c072790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41880/0 (socket says 172.21.15.175:41880) 2024-09-15T22:08:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f347127f640 1 -- 172.21.15.175:0/3436285105 learned_addr learned my addr 172.21.15.175:0/3436285105 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-15T22:08:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f3472281640 1 --2- 172.21.15.175:0/3436285105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f346c148370 0x7f346c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f347127f640 1 -- 172.21.15.175:0/3436285105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c0b0040 msgr2=0x7f346c06d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f347127f640 1 --2- 172.21.15.175:0/3436285105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c0b0040 0x7f346c06d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f347127f640 1 -- 172.21.15.175:0/3436285105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f346c148370 msgr2=0x7f346c06fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f347127f640 1 --2- 172.21.15.175:0/3436285105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f346c148370 0x7f346c06fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f347127f640 1 -- 172.21.15.175:0/3436285105 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346c070d80 con 0x7f346c0b5660 2024-09-15T22:08:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f347127f640 1 --2- 172.21.15.175:0/3436285105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c0b5660 0x7f346c072790 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f346000d5f0 tx=0x7f346000dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f345e7fc640 1 -- 172.21.15.175:0/3436285105 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600125f0 con 0x7f346c0b5660 2024-09-15T22:08:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f345e7fc640 1 -- 172.21.15.175:0/3436285105 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3460019070 con 0x7f346c0b5660 2024-09-15T22:08:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f3473ce4640 1 -- 172.21.15.175:0/3436285105 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f346c071060 con 0x7f346c0b5660 2024-09-15T22:08:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f345e7fc640 1 -- 172.21.15.175:0/3436285105 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600129d0 con 0x7f346c0b5660 2024-09-15T22:08:54.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f3473ce4640 1 -- 172.21.15.175:0/3436285105 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f346c0b1e80 con 0x7f346c0b5660 2024-09-15T22:08:54.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f345e7fc640 1 -- 172.21.15.175:0/3436285105 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3460012b70 con 0x7f346c0b5660 2024-09-15T22:08:54.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.438+0000 7f345e7fc640 1 -- 172.21.15.175:0/3436285105 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f3460014510 con 0x7f346c0b5660 2024-09-15T22:08:54.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.439+0000 7f3473ce4640 1 -- 172.21.15.175:0/3436285105 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f346c147c40 con 0x7f346c0b5660 2024-09-15T22:08:54.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.441+0000 7f345e7fc640 1 -- 172.21.15.175:0/3436285105 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3460014760 con 0x7f346c0b5660 2024-09-15T22:08:54.493 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:54.491+0000 7f56da720040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:08:54.503 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:54.502+0000 7fede6130040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:08:54.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.511+0000 7f3473ce4640 1 -- 172.21.15.175:0/3436285105 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "71eb9af6-bf66-4450-a5d1-d4a81f71f95b", "id": 0} v 0) -- 0x7f346c1469a0 con 0x7f346c0b5660 2024-09-15T22:08:54.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.517+0000 7f345e7fc640 1 -- 172.21.15.175:0/3436285105 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "71eb9af6-bf66-4450-a5d1-d4a81f71f95b", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f3460014a10 con 0x7f346c0b5660 2024-09-15T22:08:54.518 INFO:teuthology.orchestra.run.smithi175.stdout:0 2024-09-15T22:08:54.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.517+0000 7f3473ce4640 1 -- 172.21.15.175:0/3436285105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c0b5660 msgr2=0x7f346c072790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:54.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.517+0000 7f3473ce4640 1 --2- 172.21.15.175:0/3436285105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c0b5660 0x7f346c072790 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f346000d5f0 tx=0x7f346000dab0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.517+0000 7f3473ce4640 1 -- 172.21.15.175:0/3436285105 shutdown_connections 2024-09-15T22:08:54.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.517+0000 7f3473ce4640 1 --2- 172.21.15.175:0/3436285105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f346c148370 0x7f346c06fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.517+0000 7f3473ce4640 1 --2- 172.21.15.175:0/3436285105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c0b5660 0x7f346c072790 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.517+0000 7f3473ce4640 1 --2- 172.21.15.175:0/3436285105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c0b0040 0x7f346c06d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.517+0000 7f3473ce4640 1 -- 172.21.15.175:0/3436285105 >> 172.21.15.175:0/3436285105 conn(0x7f346c0b66c0 msgr2=0x7f346c146ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:54.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.518+0000 7f3473ce4640 1 -- 172.21.15.175:0/3436285105 shutdown_connections 2024-09-15T22:08:54.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.518+0000 7f3473ce4640 1 -- 172.21.15.175:0/3436285105 wait complete. 2024-09-15T22:08:54.529 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new f0070f6d-7998-4ad3-b597-e5777e61d503 1 2024-09-15T22:08:54.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.626+0000 7fb1dcb68640 1 Processor -- start 2024-09-15T22:08:54.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.626+0000 7fb1dcb68640 1 -- start start 2024-09-15T22:08:54.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.627+0000 7fb1dcb68640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80b3280 0x7fb1d8073d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:54.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.627+0000 7fb1dcb68640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb1d80b17a0 0x7fb1d80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:54.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.627+0000 7fb1dcb68640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1d80b6940 con 0x7fb1d80b64b0 2024-09-15T22:08:54.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.627+0000 7fb1dcb68640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fb1d80b3660 con 0x7fb1d80b17a0 2024-09-15T22:08:54.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.627+0000 7fb1dcb68640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d81446b0 con 0x7fb1d80b3280 2024-09-15T22:08:54.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.627+0000 7fb1d659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80b3280 0x7fb1d8073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:54.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.627+0000 7fb1d6d9d640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb1d80b64b0 0x7fb1d813e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:55064/0 (socket says 172.21.15.175:55064) 2024-09-15T22:08:54.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.627+0000 7fb1d6d9d640 1 -- 172.21.15.175:0/3975969713 learned_addr learned my addr 172.21.15.175:0/3975969713 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-09-15T22:08:54.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.627+0000 7fb1d659c640 1 --2- 172.21.15.175:0/3975969713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80b3280 0x7fb1d8073d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:33154/0 (socket says 172.21.15.175:33154) 2024-09-15T22:08:54.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.627+0000 7fb1d5d9b640 1 --2- 172.21.15.175:0/3975969713 >> v2:172.21.15.78:3300/0 conn(0x7fb1d80b17a0 0x7fb1d80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:54.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.627+0000 7fb1d659c640 1 -- 172.21.15.175:0/3975969713 >> v2:172.21.15.78:3300/0 conn(0x7fb1d80b17a0 msgr2=0x7fb1d80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:08:54.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.627+0000 7fb1d659c640 1 --2- 172.21.15.175:0/3975969713 >> v2:172.21.15.78:3300/0 conn(0x7fb1d80b17a0 0x7fb1d80b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.627+0000 7fb1d659c640 1 -- 172.21.15.175:0/3975969713 >> v1:172.21.15.175:6789/0 conn(0x7fb1d80b64b0 legacy=0x7fb1d813e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:54.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.627+0000 7fb1d559a640 1 -- 172.21.15.175:0/3975969713 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858563806 0 0) 0x7fb1d80b6940 con 0x7fb1d80b64b0 2024-09-15T22:08:54.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.627+0000 7fb1d659c640 1 -- 172.21.15.175:0/3975969713 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d80b45e0 con 0x7fb1d80b3280 2024-09-15T22:08:54.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.628+0000 7fb1d659c640 1 --2- 172.21.15.175:0/3975969713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80b3280 0x7fb1d8073d90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00097a0 tx=0x7fb1c002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9921180332dd2421 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:54.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.629+0000 7fb1d559a640 1 -- 172.21.15.175:0/3975969713 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0037070 con 0x7fb1d80b3280 2024-09-15T22:08:54.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.629+0000 7fb1d559a640 1 -- 172.21.15.175:0/3975969713 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c002ae50 con 0x7fb1d80b3280 2024-09-15T22:08:54.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.629+0000 7fb1d559a640 1 -- 172.21.15.175:0/3975969713 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0032660 con 0x7fb1d80b3280 2024-09-15T22:08:54.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.629+0000 7fb1dcb68640 1 -- 172.21.15.175:0/3975969713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80b3280 msgr2=0x7fb1d8073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:54.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.629+0000 7fb1dcb68640 1 --2- 172.21.15.175:0/3975969713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80b3280 0x7fb1d8073d90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00097a0 tx=0x7fb1c002a100 comp rx=0 tx=0).stop 2024-09-15T22:08:54.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.629+0000 7fb1dcb68640 1 -- 172.21.15.175:0/3975969713 shutdown_connections 2024-09-15T22:08:54.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.629+0000 7fb1dcb68640 1 --2- 172.21.15.175:0/3975969713 >> v2:172.21.15.78:3300/0 conn(0x7fb1d80b17a0 0x7fb1d80b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.629+0000 7fb1dcb68640 1 --2- 172.21.15.175:0/3975969713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80b3280 0x7fb1d8073d90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.629+0000 7fb1dcb68640 1 -- 172.21.15.175:0/3975969713 >> 172.21.15.175:0/3975969713 conn(0x7fb1d80ba2a0 msgr2=0x7fb1d80ba6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:54.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.629+0000 7fb1dcb68640 1 -- 172.21.15.175:0/3975969713 shutdown_connections 2024-09-15T22:08:54.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.629+0000 7fb1dcb68640 1 -- 172.21.15.175:0/3975969713 wait complete. 2024-09-15T22:08:54.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.631+0000 7fb1dcb68640 1 Processor -- start 2024-09-15T22:08:54.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.631+0000 7fb1dcb68640 1 -- start start 2024-09-15T22:08:54.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.631+0000 7fb1dcb68640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80b17a0 0x7fb1d813b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:54.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.631+0000 7fb1dcb68640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1d80b3280 0x7fb1d81385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:54.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.631+0000 7fb1dcb68640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1d80b64b0 0x7fb1d8138b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:54.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.631+0000 7fb1dcb68640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d8144f30 con 0x7fb1d80b64b0 2024-09-15T22:08:54.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.631+0000 7fb1dcb68640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d8144c50 con 0x7fb1d80b3280 2024-09-15T22:08:54.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.631+0000 7fb1dcb68640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d80b41b0 con 0x7fb1d80b17a0 2024-09-15T22:08:54.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.631+0000 7fb1d5d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1d80b3280 0x7fb1d81385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:54.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.631+0000 7fb1d659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80b17a0 0x7fb1d813b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:54.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.631+0000 7fb1d5d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1d80b3280 0x7fb1d81385d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41890/0 (socket says 172.21.15.175:41890) 2024-09-15T22:08:54.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.631+0000 7fb1d5d9b640 1 -- 172.21.15.175:0/2791932030 learned_addr learned my addr 172.21.15.175:0/2791932030 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-15T22:08:54.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.631+0000 7fb1d6d9d640 1 --2- 172.21.15.175:0/2791932030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1d80b64b0 0x7fb1d8138b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:54.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.632+0000 7fb1d659c640 1 -- 172.21.15.175:0/2791932030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1d80b3280 msgr2=0x7fb1d81385d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:54.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.632+0000 7fb1d659c640 1 --2- 172.21.15.175:0/2791932030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1d80b3280 0x7fb1d81385d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.632+0000 7fb1d659c640 1 -- 172.21.15.175:0/2791932030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1d80b64b0 msgr2=0x7fb1d8138b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:54.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.632+0000 7fb1d659c640 1 --2- 172.21.15.175:0/2791932030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1d80b64b0 0x7fb1d8138b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.632+0000 7fb1d659c640 1 -- 172.21.15.175:0/2791932030 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d8147440 con 0x7fb1d80b17a0 2024-09-15T22:08:54.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.632+0000 7fb1d5d9b640 1 --2- 172.21.15.175:0/2791932030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1d80b3280 0x7fb1d81385d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:08:54.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.632+0000 7fb1d659c640 1 --2- 172.21.15.175:0/2791932030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80b17a0 0x7fb1d813b930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0031000 tx=0x7fb1c00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:54.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.632+0000 7fb1ceffd640 1 -- 172.21.15.175:0/2791932030 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0041070 con 0x7fb1d80b17a0 2024-09-15T22:08:54.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.632+0000 7fb1ceffd640 1 -- 172.21.15.175:0/2791932030 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c0032e20 con 0x7fb1d80b17a0 2024-09-15T22:08:54.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.632+0000 7fb1dcb68640 1 -- 172.21.15.175:0/2791932030 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d81d2060 con 0x7fb1d80b17a0 2024-09-15T22:08:54.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.632+0000 7fb1ceffd640 1 -- 172.21.15.175:0/2791932030 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0037040 con 0x7fb1d80b17a0 2024-09-15T22:08:54.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.632+0000 7fb1dcb68640 1 -- 172.21.15.175:0/2791932030 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d8145b50 con 0x7fb1d80b17a0 2024-09-15T22:08:54.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.632+0000 7fb1ceffd640 1 -- 172.21.15.175:0/2791932030 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb1c003a070 con 0x7fb1d80b17a0 2024-09-15T22:08:54.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.632+0000 7fb1ceffd640 1 -- 172.21.15.175:0/2791932030 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fb1c0045b20 con 0x7fb1d80b17a0 2024-09-15T22:08:54.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.633+0000 7fb1dcb68640 1 -- 172.21.15.175:0/2791932030 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d8145450 con 0x7fb1d80b17a0 2024-09-15T22:08:54.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.635+0000 7fb1ceffd640 1 -- 172.21.15.175:0/2791932030 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb1c003c890 con 0x7fb1d80b17a0 2024-09-15T22:08:54.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.705+0000 7fb1dcb68640 1 -- 172.21.15.175:0/2791932030 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f0070f6d-7998-4ad3-b597-e5777e61d503", "id": 1} v 0) -- 0x7fb1d8142690 con 0x7fb1d80b17a0 2024-09-15T22:08:54.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.708+0000 7fb1ceffd640 1 -- 172.21.15.175:0/2791932030 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0070f6d-7998-4ad3-b597-e5777e61d503", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fb1c003ca70 con 0x7fb1d80b17a0 2024-09-15T22:08:54.709 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-09-15T22:08:54.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.709+0000 7fb1dcb68640 1 -- 172.21.15.175:0/2791932030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80b17a0 msgr2=0x7fb1d813b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:54.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.709+0000 7fb1dcb68640 1 --2- 172.21.15.175:0/2791932030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80b17a0 0x7fb1d813b930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0031000 tx=0x7fb1c00046c0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.709+0000 7fb1dcb68640 1 -- 172.21.15.175:0/2791932030 shutdown_connections 2024-09-15T22:08:54.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.709+0000 7fb1dcb68640 1 --2- 172.21.15.175:0/2791932030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1d80b64b0 0x7fb1d8138b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.709+0000 7fb1dcb68640 1 --2- 172.21.15.175:0/2791932030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1d80b3280 0x7fb1d81385d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.709+0000 7fb1dcb68640 1 --2- 172.21.15.175:0/2791932030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d80b17a0 0x7fb1d813b930 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.709+0000 7fb1dcb68640 1 -- 172.21.15.175:0/2791932030 >> 172.21.15.175:0/2791932030 conn(0x7fb1d80ba2a0 msgr2=0x7fb1d8142900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:54.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.709+0000 7fb1dcb68640 1 -- 172.21.15.175:0/2791932030 shutdown_connections 2024-09-15T22:08:54.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.709+0000 7fb1dcb68640 1 -- 172.21.15.175:0/2791932030 wait complete. 2024-09-15T22:08:54.720 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 6d9c91c7-2c8a-48f9-9bef-67ea7320980e 2 2024-09-15T22:08:54.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.817+0000 7fd13296d640 1 Processor -- start 2024-09-15T22:08:54.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.817+0000 7fd13296d640 1 -- start start 2024-09-15T22:08:54.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.818+0000 7fd13296d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd12c0b39b0 0x7fd12c13f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:54.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.818+0000 7fd13296d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd12c13fc10 0x7fd12c1501a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:54.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.818+0000 7fd13296d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd12c0b3df0 con 0x7fd12c0b6670 2024-09-15T22:08:54.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.818+0000 7fd13296d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd12c0b50f0 con 0x7fd12c13fc10 2024-09-15T22:08:54.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.818+0000 7fd13296d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd12c1400c0 con 0x7fd12c0b39b0 2024-09-15T22:08:54.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.818+0000 7fd12b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd12c0b39b0 0x7fd12c13f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:54.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.818+0000 7fd130f0a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd12c13fc10 0x7fd12c1501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:54.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.818+0000 7fd130f0a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd12c13fc10 0x7fd12c1501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41906/0 (socket says 172.21.15.175:41906) 2024-09-15T22:08:54.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.818+0000 7fd12b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd12c0b39b0 0x7fd12c13f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:33164/0 (socket says 172.21.15.175:33164) 2024-09-15T22:08:54.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.818+0000 7fd130f0a640 1 -- 172.21.15.175:0/3628945703 learned_addr learned my addr 172.21.15.175:0/3628945703 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-15T22:08:54.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.818+0000 7fd130f0a640 1 -- 172.21.15.175:0/3628945703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd12c0b39b0 msgr2=0x7fd12c13f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:08:54.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.818+0000 7fd130f0a640 1 --2- 172.21.15.175:0/3628945703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd12c0b39b0 0x7fd12c13f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.818+0000 7fd130f0a640 1 -- 172.21.15.175:0/3628945703 >> v1:172.21.15.78:6789/0 conn(0x7fd12c0b6670 legacy=0x7fd12c073920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:54.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.818+0000 7fd130f0a640 1 -- 172.21.15.175:0/3628945703 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12c0b4dc0 con 0x7fd12c13fc10 2024-09-15T22:08:54.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.818+0000 7fd12b7fe640 1 --2- 172.21.15.175:0/3628945703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd12c0b39b0 0x7fd12c13f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:08:54.821 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:54.819+0000 7f56da720040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:08:54.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.819+0000 7fd130f0a640 1 --2- 172.21.15.175:0/3628945703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd12c13fc10 0x7fd12c1501a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd124009e50 tx=0x7fd12402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be4ad3fecc1f9518 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:54.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.819+0000 7fd12affd640 1 -- 172.21.15.175:0/3628945703 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124036070 con 0x7fd12c13fc10 2024-09-15T22:08:54.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.819+0000 7fd12affd640 1 -- 172.21.15.175:0/3628945703 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd124031600 con 0x7fd12c13fc10 2024-09-15T22:08:54.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.819+0000 7fd12affd640 1 -- 172.21.15.175:0/3628945703 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1240319d0 con 0x7fd12c13fc10 2024-09-15T22:08:54.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.820+0000 7fd13296d640 1 -- 172.21.15.175:0/3628945703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd12c13fc10 msgr2=0x7fd12c1501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:54.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.820+0000 7fd13296d640 1 --2- 172.21.15.175:0/3628945703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd12c13fc10 0x7fd12c1501a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd124009e50 tx=0x7fd12402a5f0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.820+0000 7fd13296d640 1 -- 172.21.15.175:0/3628945703 shutdown_connections 2024-09-15T22:08:54.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.820+0000 7fd13296d640 1 --2- 172.21.15.175:0/3628945703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd12c13fc10 0x7fd12c1501a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.820+0000 7fd13296d640 1 --2- 172.21.15.175:0/3628945703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd12c0b39b0 0x7fd12c13f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.820+0000 7fd13296d640 1 -- 172.21.15.175:0/3628945703 >> 172.21.15.175:0/3628945703 conn(0x7fd12c0ba2a0 msgr2=0x7fd12c0ba6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:54.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.820+0000 7fd13296d640 1 -- 172.21.15.175:0/3628945703 shutdown_connections 2024-09-15T22:08:54.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.820+0000 7fd13296d640 1 -- 172.21.15.175:0/3628945703 wait complete. 2024-09-15T22:08:54.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.821+0000 7fd13296d640 1 Processor -- start 2024-09-15T22:08:54.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.821+0000 7fd13296d640 1 -- start start 2024-09-15T22:08:54.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.821+0000 7fd13296d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd12c0b39b0 0x7fd12c1de9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:54.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.821+0000 7fd13296d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd12c0b6670 0x7fd12c137cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:54.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.821+0000 7fd13296d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd12c13fc10 0x7fd12c138230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:54.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.821+0000 7fd13296d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd12c0b4080 con 0x7fd12c0b39b0 2024-09-15T22:08:54.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.821+0000 7fd13296d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd12c071640 con 0x7fd12c13fc10 2024-09-15T22:08:54.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.821+0000 7fd13296d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd12c0b5580 con 0x7fd12c0b6670 2024-09-15T22:08:54.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.821+0000 7fd130f0a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd12c13fc10 0x7fd12c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:54.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd12b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd12c0b6670 0x7fd12c137cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:54.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd130f0a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd12c13fc10 0x7fd12c138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41920/0 (socket says 172.21.15.175:41920) 2024-09-15T22:08:54.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd12b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd12c0b6670 0x7fd12c137cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:33180/0 (socket says 172.21.15.175:33180) 2024-09-15T22:08:54.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd130f0a640 1 -- 172.21.15.175:0/659131992 learned_addr learned my addr 172.21.15.175:0/659131992 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-15T22:08:54.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd12bfff640 1 --2- 172.21.15.175:0/659131992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd12c0b39b0 0x7fd12c1de9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:54.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd130f0a640 1 -- 172.21.15.175:0/659131992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd12c0b6670 msgr2=0x7fd12c137cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:54.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd130f0a640 1 --2- 172.21.15.175:0/659131992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd12c0b6670 0x7fd12c137cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd130f0a640 1 -- 172.21.15.175:0/659131992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd12c0b39b0 msgr2=0x7fd12c1de9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:54.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd130f0a640 1 --2- 172.21.15.175:0/659131992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd12c0b39b0 0x7fd12c1de9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd130f0a640 1 -- 172.21.15.175:0/659131992 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12c146740 con 0x7fd12c13fc10 2024-09-15T22:08:54.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd12b7fe640 1 --2- 172.21.15.175:0/659131992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd12c0b6670 0x7fd12c137cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:08:54.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd130f0a640 1 --2- 172.21.15.175:0/659131992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd12c13fc10 0x7fd12c138230 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd12402abe0 tx=0x7fd124004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:54.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd128ff9640 1 -- 172.21.15.175:0/659131992 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124041020 con 0x7fd12c13fc10 2024-09-15T22:08:54.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd128ff9640 1 -- 172.21.15.175:0/659131992 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1240077a0 con 0x7fd12c13fc10 2024-09-15T22:08:54.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd13296d640 1 -- 172.21.15.175:0/659131992 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd12c143770 con 0x7fd12c13fc10 2024-09-15T22:08:54.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd128ff9640 1 -- 172.21.15.175:0/659131992 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124036040 con 0x7fd12c13fc10 2024-09-15T22:08:54.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd13296d640 1 -- 172.21.15.175:0/659131992 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd12c1df4b0 con 0x7fd12c13fc10 2024-09-15T22:08:54.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd128ff9640 1 -- 172.21.15.175:0/659131992 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd124044020 con 0x7fd12c13fc10 2024-09-15T22:08:54.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.822+0000 7fd128ff9640 1 -- 172.21.15.175:0/659131992 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fd12403cb10 con 0x7fd12c13fc10 2024-09-15T22:08:54.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.823+0000 7fd13296d640 1 -- 172.21.15.175:0/659131992 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd12c0b5d20 con 0x7fd12c13fc10 2024-09-15T22:08:54.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.827+0000 7fd128ff9640 1 -- 172.21.15.175:0/659131992 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd12404b030 con 0x7fd12c13fc10 2024-09-15T22:08:54.855 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:54.854+0000 7fede6130040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:08:54.874 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:54.872+0000 7f56da720040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:08:54.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.897+0000 7fd13296d640 1 -- 172.21.15.175:0/659131992 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6d9c91c7-2c8a-48f9-9bef-67ea7320980e", "id": 2} v 0) -- 0x7fd12c073990 con 0x7fd12c13fc10 2024-09-15T22:08:54.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.900+0000 7fd128ff9640 1 -- 172.21.15.175:0/659131992 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6d9c91c7-2c8a-48f9-9bef-67ea7320980e", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fd12403cdb0 con 0x7fd12c13fc10 2024-09-15T22:08:54.902 INFO:teuthology.orchestra.run.smithi175.stdout:2 2024-09-15T22:08:54.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.901+0000 7fd13296d640 1 -- 172.21.15.175:0/659131992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd12c13fc10 msgr2=0x7fd12c138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:54.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.901+0000 7fd13296d640 1 --2- 172.21.15.175:0/659131992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd12c13fc10 0x7fd12c138230 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd12402abe0 tx=0x7fd124004a40 comp rx=0 tx=0).stop 2024-09-15T22:08:54.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.901+0000 7fd13296d640 1 -- 172.21.15.175:0/659131992 shutdown_connections 2024-09-15T22:08:54.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.901+0000 7fd13296d640 1 --2- 172.21.15.175:0/659131992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd12c13fc10 0x7fd12c138230 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.901+0000 7fd13296d640 1 --2- 172.21.15.175:0/659131992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd12c0b6670 0x7fd12c137cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.901+0000 7fd13296d640 1 --2- 172.21.15.175:0/659131992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd12c0b39b0 0x7fd12c1de9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:54.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.901+0000 7fd13296d640 1 -- 172.21.15.175:0/659131992 >> 172.21.15.175:0/659131992 conn(0x7fd12c0ba2a0 msgr2=0x7fd12c13d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:54.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.902+0000 7fd13296d640 1 -- 172.21.15.175:0/659131992 shutdown_connections 2024-09-15T22:08:54.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:54.902+0000 7fd13296d640 1 -- 172.21.15.175:0/659131992 wait complete. 2024-09-15T22:08:54.907 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:54.906+0000 7fede6130040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:08:54.913 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 943e38fb-b450-48c0-8f01-d381b0b8e313 3 2024-09-15T22:08:55.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.010+0000 7fa5bec42640 1 Processor -- start 2024-09-15T22:08:55.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.010+0000 7fa5bec42640 1 -- start start 2024-09-15T22:08:55.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.011+0000 7fa5bec42640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5b80b3280 0x7fa5b8073d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.011+0000 7fa5bec42640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5b80b6680 0x7fa5b813e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.011+0000 7fa5bec42640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5b80b3660 con 0x7fa5b80b17a0 2024-09-15T22:08:55.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.011+0000 7fa5bec42640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fa5b81446b0 con 0x7fa5b80b3280 2024-09-15T22:08:55.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.011+0000 7fa5bec42640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa5b80b45e0 con 0x7fa5b80b6680 2024-09-15T22:08:55.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.011+0000 7fa5b7fff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa5b80b17a0 0x7fa5b80b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:55078/0 (socket says 172.21.15.175:55078) 2024-09-15T22:08:55.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.011+0000 7fa5b7fff640 1 -- 172.21.15.175:0/733221285 learned_addr learned my addr 172.21.15.175:0/733221285 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-09-15T22:08:55.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.011+0000 7fa5bd1df640 1 --2- 172.21.15.175:0/733221285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5b80b6680 0x7fa5b813e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.011+0000 7fa5bc9de640 1 --2- 172.21.15.175:0/733221285 >> v2:172.21.15.78:3300/0 conn(0x7fa5b80b3280 0x7fa5b8073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.011+0000 7fa5b77fe640 1 -- 172.21.15.175:0/733221285 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2758980564 0 0) 0x7fa5b80b3660 con 0x7fa5b80b17a0 2024-09-15T22:08:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.011+0000 7fa5b77fe640 1 -- 172.21.15.175:0/733221285 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5a8003520 con 0x7fa5b80b17a0 2024-09-15T22:08:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.011+0000 7fa5bd1df640 1 -- 172.21.15.175:0/733221285 >> v2:172.21.15.78:3300/0 conn(0x7fa5b80b3280 msgr2=0x7fa5b8073d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:08:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.011+0000 7fa5bd1df640 1 --2- 172.21.15.175:0/733221285 >> v2:172.21.15.78:3300/0 conn(0x7fa5b80b3280 0x7fa5b8073d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.011+0000 7fa5bd1df640 1 -- 172.21.15.175:0/733221285 >> v1:172.21.15.175:6789/0 conn(0x7fa5b80b17a0 legacy=0x7fa5b80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.011+0000 7fa5bd1df640 1 -- 172.21.15.175:0/733221285 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b8144970 con 0x7fa5b80b6680 2024-09-15T22:08:55.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.012+0000 7fa5bd1df640 1 --2- 172.21.15.175:0/733221285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5b80b6680 0x7fa5b813e040 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009d90 tx=0x7fa5b002e9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9b7a6b809691477 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:55.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.013+0000 7fa5b77fe640 1 -- 172.21.15.175:0/733221285 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0037070 con 0x7fa5b80b6680 2024-09-15T22:08:55.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.013+0000 7fa5b77fe640 1 -- 172.21.15.175:0/733221285 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b0033840 con 0x7fa5b80b6680 2024-09-15T22:08:55.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.013+0000 7fa5b77fe640 1 -- 172.21.15.175:0/733221285 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0033c10 con 0x7fa5b80b6680 2024-09-15T22:08:55.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.013+0000 7fa5bec42640 1 -- 172.21.15.175:0/733221285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5b80b6680 msgr2=0x7fa5b813e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.013+0000 7fa5bec42640 1 --2- 172.21.15.175:0/733221285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5b80b6680 0x7fa5b813e040 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009d90 tx=0x7fa5b002e9e0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.013+0000 7fa5bec42640 1 -- 172.21.15.175:0/733221285 shutdown_connections 2024-09-15T22:08:55.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.013+0000 7fa5bec42640 1 --2- 172.21.15.175:0/733221285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5b80b6680 0x7fa5b813e040 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.013+0000 7fa5bec42640 1 --2- 172.21.15.175:0/733221285 >> v2:172.21.15.78:3300/0 conn(0x7fa5b80b3280 0x7fa5b8073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.013+0000 7fa5bec42640 1 -- 172.21.15.175:0/733221285 >> 172.21.15.175:0/733221285 conn(0x7fa5b80ba2a0 msgr2=0x7fa5b80ba6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:55.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.013+0000 7fa5bec42640 1 -- 172.21.15.175:0/733221285 shutdown_connections 2024-09-15T22:08:55.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.013+0000 7fa5bec42640 1 -- 172.21.15.175:0/733221285 wait complete. 2024-09-15T22:08:55.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.014+0000 7fa5bec42640 1 Processor -- start 2024-09-15T22:08:55.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.014+0000 7fa5bec42640 1 -- start start 2024-09-15T22:08:55.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5bec42640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5b80b17a0 0x7fa5b8138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5bec42640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5b80b3280 0x7fa5b8070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5bec42640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5b80b6680 0x7fa5b8071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5bec42640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b80b41b0 con 0x7fa5b80b17a0 2024-09-15T22:08:55.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5bec42640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b8144f30 con 0x7fa5b80b3280 2024-09-15T22:08:55.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5bec42640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa5b8072580 con 0x7fa5b80b6680 2024-09-15T22:08:55.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5b7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5b80b3280 0x7fa5b8070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5bd1df640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5b80b6680 0x7fa5b8071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5b7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5b80b3280 0x7fa5b8070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41934/0 (socket says 172.21.15.175:41934) 2024-09-15T22:08:55.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5b7fff640 1 -- 172.21.15.175:0/2106730305 learned_addr learned my addr 172.21.15.175:0/2106730305 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-15T22:08:55.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5bc9de640 1 --2- 172.21.15.175:0/2106730305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5b80b17a0 0x7fa5b8138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5b7fff640 1 -- 172.21.15.175:0/2106730305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5b80b6680 msgr2=0x7fa5b8071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5b7fff640 1 --2- 172.21.15.175:0/2106730305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5b80b6680 0x7fa5b8071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5b7fff640 1 -- 172.21.15.175:0/2106730305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5b80b17a0 msgr2=0x7fa5b8138ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5b7fff640 1 --2- 172.21.15.175:0/2106730305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5b80b17a0 0x7fa5b8138ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.015+0000 7fa5b7fff640 1 -- 172.21.15.175:0/2106730305 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b813f780 con 0x7fa5b80b3280 2024-09-15T22:08:55.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.016+0000 7fa5bc9de640 1 --2- 172.21.15.175:0/2106730305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5b80b17a0 0x7fa5b8138ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:08:55.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.016+0000 7fa5b7fff640 1 --2- 172.21.15.175:0/2106730305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5b80b3280 0x7fa5b8070ac0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa5a400c430 tx=0x7fa5a400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:55.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.016+0000 7fa5b57fa640 1 -- 172.21.15.175:0/2106730305 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4017070 con 0x7fa5b80b3280 2024-09-15T22:08:55.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.016+0000 7fa5b57fa640 1 -- 172.21.15.175:0/2106730305 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a4005ce0 con 0x7fa5b80b3280 2024-09-15T22:08:55.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.016+0000 7fa5bec42640 1 -- 172.21.15.175:0/2106730305 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5b813fa60 con 0x7fa5b80b3280 2024-09-15T22:08:55.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.016+0000 7fa5b57fa640 1 -- 172.21.15.175:0/2106730305 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40072f0 con 0x7fa5b80b3280 2024-09-15T22:08:55.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.016+0000 7fa5bec42640 1 -- 172.21.15.175:0/2106730305 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5b813f400 con 0x7fa5b80b3280 2024-09-15T22:08:55.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.016+0000 7fa5b57fa640 1 -- 172.21.15.175:0/2106730305 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa5a401a070 con 0x7fa5b80b3280 2024-09-15T22:08:55.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.016+0000 7fa5b57fa640 1 -- 172.21.15.175:0/2106730305 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fa5a4012890 con 0x7fa5b80b3280 2024-09-15T22:08:55.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.017+0000 7fa5bec42640 1 -- 172.21.15.175:0/2106730305 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5b81454e0 con 0x7fa5b80b3280 2024-09-15T22:08:55.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.021+0000 7fa5b57fa640 1 -- 172.21.15.175:0/2106730305 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa5a4021070 con 0x7fa5b80b3280 2024-09-15T22:08:55.022 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:55.020+0000 7f56da720040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:08:55.067 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:55.066+0000 7fede6130040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:08:55.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.090+0000 7fa5bec42640 1 -- 172.21.15.175:0/2106730305 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "943e38fb-b450-48c0-8f01-d381b0b8e313", "id": 3} v 0) -- 0x7fa5b8139de0 con 0x7fa5b80b3280 2024-09-15T22:08:55.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.094+0000 7fa5b57fa640 1 -- 172.21.15.175:0/2106730305 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "943e38fb-b450-48c0-8f01-d381b0b8e313", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fa5a4012400 con 0x7fa5b80b3280 2024-09-15T22:08:55.096 INFO:teuthology.orchestra.run.smithi175.stdout:3 2024-09-15T22:08:55.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.095+0000 7fa5bec42640 1 -- 172.21.15.175:0/2106730305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5b80b3280 msgr2=0x7fa5b8070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.095+0000 7fa5bec42640 1 --2- 172.21.15.175:0/2106730305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5b80b3280 0x7fa5b8070ac0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa5a400c430 tx=0x7fa5a400c8f0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.095+0000 7fa5bec42640 1 -- 172.21.15.175:0/2106730305 shutdown_connections 2024-09-15T22:08:55.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.095+0000 7fa5bec42640 1 --2- 172.21.15.175:0/2106730305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5b80b6680 0x7fa5b8071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.095+0000 7fa5bec42640 1 --2- 172.21.15.175:0/2106730305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5b80b3280 0x7fa5b8070ac0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.095+0000 7fa5bec42640 1 --2- 172.21.15.175:0/2106730305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5b80b17a0 0x7fa5b8138ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.095+0000 7fa5bec42640 1 -- 172.21.15.175:0/2106730305 >> 172.21.15.175:0/2106730305 conn(0x7fa5b80ba2a0 msgr2=0x7fa5b8074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:55.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.095+0000 7fa5bec42640 1 -- 172.21.15.175:0/2106730305 shutdown_connections 2024-09-15T22:08:55.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.095+0000 7fa5bec42640 1 -- 172.21.15.175:0/2106730305 wait complete. 2024-09-15T22:08:55.107 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 259f50f8-3223-450d-8cd1-d0d333c278dd 4 2024-09-15T22:08:55.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.202+0000 7fd7afcba640 1 Processor -- start 2024-09-15T22:08:55.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.203+0000 7fd7afcba640 1 -- start start 2024-09-15T22:08:55.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.203+0000 7fd7afcba640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a80b3280 0x7fd7a8073d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.203+0000 7fd7afcba640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7a80b17a0 0x7fd7a80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.203+0000 7fd7afcba640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd7a80b64b0 0x7fd7a813e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.203+0000 7fd7afcba640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fd7a80b6940 con 0x7fd7a80b64b0 2024-09-15T22:08:55.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.203+0000 7fd7afcba640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd7a80b3660 con 0x7fd7a80b17a0 2024-09-15T22:08:55.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.203+0000 7fd7afcba640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a81446b0 con 0x7fd7a80b3280 2024-09-15T22:08:55.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.203+0000 7fd7ada56640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a80b3280 0x7fd7a8073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.203+0000 7fd7ad255640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7a80b17a0 0x7fd7a80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.203+0000 7fd7ad255640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7a80b17a0 0x7fd7a80b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41944/0 (socket says 172.21.15.175:41944) 2024-09-15T22:08:55.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.203+0000 7fd7ad255640 1 -- 172.21.15.175:0/350146631 learned_addr learned my addr 172.21.15.175:0/350146631 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-15T22:08:55.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.204+0000 7fd7ae257640 1 --2- 172.21.15.175:0/350146631 >> v2:172.21.15.78:3300/0 conn(0x7fd7a80b64b0 0x7fd7a813e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.204+0000 7fd7ada56640 1 -- 172.21.15.175:0/350146631 >> v2:172.21.15.175:3300/0 conn(0x7fd7a80b17a0 msgr2=0x7fd7a80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:08:55.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.204+0000 7fd7ada56640 1 --2- 172.21.15.175:0/350146631 >> v2:172.21.15.175:3300/0 conn(0x7fd7a80b17a0 0x7fd7a80b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.204+0000 7fd7ada56640 1 -- 172.21.15.175:0/350146631 >> v2:172.21.15.78:3300/0 conn(0x7fd7a80b64b0 msgr2=0x7fd7a813e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:08:55.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.204+0000 7fd7ada56640 1 --2- 172.21.15.175:0/350146631 >> v2:172.21.15.78:3300/0 conn(0x7fd7a80b64b0 0x7fd7a813e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.204+0000 7fd7ada56640 1 -- 172.21.15.175:0/350146631 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a80b45e0 con 0x7fd7a80b3280 2024-09-15T22:08:55.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.204+0000 7fd7ad255640 1 --2- 172.21.15.175:0/350146631 >> v2:172.21.15.175:3300/0 conn(0x7fd7a80b17a0 0x7fd7a80b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:08:55.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.204+0000 7fd7ae257640 1 --2- 172.21.15.175:0/350146631 >> v2:172.21.15.78:3300/0 conn(0x7fd7a80b64b0 0x7fd7a813e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:08:55.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.204+0000 7fd7ada56640 1 --2- 172.21.15.175:0/350146631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a80b3280 0x7fd7a8073d90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80bb090 tx=0x7fd7a402a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f391b659f893a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:55.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.205+0000 7fd7aca54640 1 -- 172.21.15.175:0/350146631 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4037070 con 0x7fd7a80b3280 2024-09-15T22:08:55.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.205+0000 7fd7aca54640 1 -- 172.21.15.175:0/350146631 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a402add0 con 0x7fd7a80b3280 2024-09-15T22:08:55.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.205+0000 7fd7aca54640 1 -- 172.21.15.175:0/350146631 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4032660 con 0x7fd7a80b3280 2024-09-15T22:08:55.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.205+0000 7fd7afcba640 1 -- 172.21.15.175:0/350146631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a80b3280 msgr2=0x7fd7a8073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.205+0000 7fd7afcba640 1 --2- 172.21.15.175:0/350146631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a80b3280 0x7fd7a8073d90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80bb090 tx=0x7fd7a402a080 comp rx=0 tx=0).stop 2024-09-15T22:08:55.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.205+0000 7fd7afcba640 1 -- 172.21.15.175:0/350146631 shutdown_connections 2024-09-15T22:08:55.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.205+0000 7fd7afcba640 1 --2- 172.21.15.175:0/350146631 >> v2:172.21.15.78:3300/0 conn(0x7fd7a80b64b0 0x7fd7a813e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.205+0000 7fd7afcba640 1 --2- 172.21.15.175:0/350146631 >> v2:172.21.15.175:3300/0 conn(0x7fd7a80b17a0 0x7fd7a80b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.205+0000 7fd7afcba640 1 --2- 172.21.15.175:0/350146631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a80b3280 0x7fd7a8073d90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.205+0000 7fd7afcba640 1 -- 172.21.15.175:0/350146631 >> 172.21.15.175:0/350146631 conn(0x7fd7a80ba2a0 msgr2=0x7fd7a80ba6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:55.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.205+0000 7fd7afcba640 1 -- 172.21.15.175:0/350146631 shutdown_connections 2024-09-15T22:08:55.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.205+0000 7fd7afcba640 1 -- 172.21.15.175:0/350146631 wait complete. 2024-09-15T22:08:55.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.206+0000 7fd7afcba640 1 Processor -- start 2024-09-15T22:08:55.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.206+0000 7fd7afcba640 1 -- start start 2024-09-15T22:08:55.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7afcba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a80b17a0 0x7fd7a80af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7afcba640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a80b3280 0x7fd7a8074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7afcba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a80b64b0 0x7fd7a81df020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7afcba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a8144f30 con 0x7fd7a80b17a0 2024-09-15T22:08:55.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7afcba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a8144c50 con 0x7fd7a80b64b0 2024-09-15T22:08:55.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7afcba640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a80b41b0 con 0x7fd7a80b3280 2024-09-15T22:08:55.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7ad255640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a80b3280 0x7fd7a8074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7ae257640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a80b64b0 0x7fd7a81df020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7ad255640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a80b3280 0x7fd7a8074e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:33222/0 (socket says 172.21.15.175:33222) 2024-09-15T22:08:55.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7ad255640 1 -- 172.21.15.175:0/2430548871 learned_addr learned my addr 172.21.15.175:0/2430548871 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-15T22:08:55.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7ada56640 1 --2- 172.21.15.175:0/2430548871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a80b17a0 0x7fd7a80af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7ad255640 1 -- 172.21.15.175:0/2430548871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a80b64b0 msgr2=0x7fd7a81df020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7ad255640 1 --2- 172.21.15.175:0/2430548871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a80b64b0 0x7fd7a81df020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7ad255640 1 -- 172.21.15.175:0/2430548871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a80b17a0 msgr2=0x7fd7a80af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7ad255640 1 --2- 172.21.15.175:0/2430548871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a80b17a0 0x7fd7a80af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.207+0000 7fd7ad255640 1 -- 172.21.15.175:0/2430548871 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a81de540 con 0x7fd7a80b3280 2024-09-15T22:08:55.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.208+0000 7fd7ad255640 1 --2- 172.21.15.175:0/2430548871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a80b3280 0x7fd7a8074e10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd79800e9b0 tx=0x7fd79800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:55.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.208+0000 7fd79e7fc640 1 -- 172.21.15.175:0/2430548871 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798017070 con 0x7fd7a80b3280 2024-09-15T22:08:55.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.208+0000 7fd79e7fc640 1 -- 172.21.15.175:0/2430548871 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79800ca00 con 0x7fd7a80b3280 2024-09-15T22:08:55.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.208+0000 7fd79e7fc640 1 -- 172.21.15.175:0/2430548871 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79800cdf0 con 0x7fd7a80b3280 2024-09-15T22:08:55.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.208+0000 7fd7afcba640 1 -- 172.21.15.175:0/2430548871 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a81de820 con 0x7fd7a80b3280 2024-09-15T22:08:55.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.208+0000 7fd7afcba640 1 -- 172.21.15.175:0/2430548871 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a813b010 con 0x7fd7a80b3280 2024-09-15T22:08:55.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.208+0000 7fd79e7fc640 1 -- 172.21.15.175:0/2430548871 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd79801a070 con 0x7fd7a80b3280 2024-09-15T22:08:55.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.208+0000 7fd79e7fc640 1 -- 172.21.15.175:0/2430548871 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fd79801c960 con 0x7fd7a80b3280 2024-09-15T22:08:55.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.209+0000 7fd7afcba640 1 -- 172.21.15.175:0/2430548871 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a8145450 con 0x7fd7a80b3280 2024-09-15T22:08:55.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.211+0000 7fd79e7fc640 1 -- 172.21.15.175:0/2430548871 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd79801cc00 con 0x7fd7a80b3280 2024-09-15T22:08:55.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.280+0000 7fd7afcba640 1 -- 172.21.15.175:0/2430548871 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "259f50f8-3223-450d-8cd1-d0d333c278dd", "id": 4} v 0) -- 0x7fd7a80b8790 con 0x7fd7a80b3280 2024-09-15T22:08:55.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.285+0000 7fd79e7fc640 1 -- 172.21.15.175:0/2430548871 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "259f50f8-3223-450d-8cd1-d0d333c278dd", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fd79801c450 con 0x7fd7a80b3280 2024-09-15T22:08:55.287 INFO:teuthology.orchestra.run.smithi175.stdout:4 2024-09-15T22:08:55.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.286+0000 7fd7afcba640 1 -- 172.21.15.175:0/2430548871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a80b3280 msgr2=0x7fd7a8074e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.286+0000 7fd7afcba640 1 --2- 172.21.15.175:0/2430548871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a80b3280 0x7fd7a8074e10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd79800e9b0 tx=0x7fd79800ee70 comp rx=0 tx=0).stop 2024-09-15T22:08:55.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.286+0000 7fd7afcba640 1 -- 172.21.15.175:0/2430548871 shutdown_connections 2024-09-15T22:08:55.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.286+0000 7fd7afcba640 1 --2- 172.21.15.175:0/2430548871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a80b64b0 0x7fd7a81df020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.286+0000 7fd7afcba640 1 --2- 172.21.15.175:0/2430548871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a80b3280 0x7fd7a8074e10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.286+0000 7fd7afcba640 1 --2- 172.21.15.175:0/2430548871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a80b17a0 0x7fd7a80af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.286+0000 7fd7afcba640 1 -- 172.21.15.175:0/2430548871 >> 172.21.15.175:0/2430548871 conn(0x7fd7a80ba2a0 msgr2=0x7fd7a80b9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:55.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.286+0000 7fd7afcba640 1 -- 172.21.15.175:0/2430548871 shutdown_connections 2024-09-15T22:08:55.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.286+0000 7fd7afcba640 1 -- 172.21.15.175:0/2430548871 wait complete. 2024-09-15T22:08:55.298 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new d70426cd-a39b-4a20-8c7b-bedc8352e303 5 2024-09-15T22:08:55.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.394+0000 7fee1767b640 1 Processor -- start 2024-09-15T22:08:55.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.394+0000 7fee1767b640 1 -- start start 2024-09-15T22:08:55.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.395+0000 7fee1767b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fee100b5870 0x7fee1014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.395+0000 7fee1767b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee100b66f0 0x7fee10141540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.395+0000 7fee1767b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee100b5c50 con 0x7fee101479b0 2024-09-15T22:08:55.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.395+0000 7fee1767b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fee100b7a60 con 0x7fee100b5870 2024-09-15T22:08:55.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.395+0000 7fee1767b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fee1014be10 con 0x7fee100b66f0 2024-09-15T22:08:55.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.395+0000 7fee15417640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fee100b5870 0x7fee1014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.395+0000 7fee14c16640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee100b66f0 0x7fee10141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.395+0000 7fee14c16640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee100b66f0 0x7fee10141540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:33228/0 (socket says 172.21.15.175:33228) 2024-09-15T22:08:55.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.395+0000 7fee15417640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fee100b5870 0x7fee1014b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41958/0 (socket says 172.21.15.175:41958) 2024-09-15T22:08:55.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.395+0000 7fee14c16640 1 -- 172.21.15.175:0/4100283591 learned_addr learned my addr 172.21.15.175:0/4100283591 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-15T22:08:55.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.395+0000 7fee14c16640 1 -- 172.21.15.175:0/4100283591 >> v2:172.21.15.175:3300/0 conn(0x7fee100b5870 msgr2=0x7fee1014b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:08:55.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.395+0000 7fee14c16640 1 --2- 172.21.15.175:0/4100283591 >> v2:172.21.15.175:3300/0 conn(0x7fee100b5870 0x7fee1014b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.395+0000 7fee14c16640 1 -- 172.21.15.175:0/4100283591 >> v1:172.21.15.78:6789/0 conn(0x7fee101479b0 legacy=0x7fee100b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.395+0000 7fee14c16640 1 -- 172.21.15.175:0/4100283591 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee100b6c40 con 0x7fee100b66f0 2024-09-15T22:08:55.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.395+0000 7fee15417640 1 --2- 172.21.15.175:0/4100283591 >> v2:172.21.15.175:3300/0 conn(0x7fee100b5870 0x7fee1014b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:08:55.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.396+0000 7fee14c16640 1 --2- 172.21.15.175:0/4100283591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee100b66f0 0x7fee10141540 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee04009870 tx=0x7fee0402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed5602b79e45ff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:55.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.396+0000 7fee0ffff640 1 -- 172.21.15.175:0/4100283591 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04037070 con 0x7fee100b66f0 2024-09-15T22:08:55.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.396+0000 7fee0ffff640 1 -- 172.21.15.175:0/4100283591 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee04032440 con 0x7fee100b66f0 2024-09-15T22:08:55.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.396+0000 7fee0ffff640 1 -- 172.21.15.175:0/4100283591 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04032810 con 0x7fee100b66f0 2024-09-15T22:08:55.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.397+0000 7fee1767b640 1 -- 172.21.15.175:0/4100283591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee100b66f0 msgr2=0x7fee10141540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.397+0000 7fee1767b640 1 --2- 172.21.15.175:0/4100283591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee100b66f0 0x7fee10141540 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee04009870 tx=0x7fee0402a1c0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.397+0000 7fee1767b640 1 -- 172.21.15.175:0/4100283591 shutdown_connections 2024-09-15T22:08:55.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.397+0000 7fee1767b640 1 --2- 172.21.15.175:0/4100283591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee100b66f0 0x7fee10141540 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.397+0000 7fee1767b640 1 --2- 172.21.15.175:0/4100283591 >> v2:172.21.15.175:3300/0 conn(0x7fee100b5870 0x7fee1014b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.397+0000 7fee1767b640 1 -- 172.21.15.175:0/4100283591 >> 172.21.15.175:0/4100283591 conn(0x7fee100740d0 msgr2=0x7fee10074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:55.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.397+0000 7fee1767b640 1 -- 172.21.15.175:0/4100283591 shutdown_connections 2024-09-15T22:08:55.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.397+0000 7fee1767b640 1 -- 172.21.15.175:0/4100283591 wait complete. 2024-09-15T22:08:55.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.398+0000 7fee1767b640 1 Processor -- start 2024-09-15T22:08:55.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.398+0000 7fee1767b640 1 -- start start 2024-09-15T22:08:55.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.398+0000 7fee1767b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee100b5870 0x7fee101dd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.398+0000 7fee1767b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee100b66f0 0x7fee100b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.398+0000 7fee1767b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee101479b0 0x7fee101d44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.398+0000 7fee1767b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fee1014b3b0 con 0x7fee101479b0 2024-09-15T22:08:55.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.398+0000 7fee1767b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fee1014b0d0 con 0x7fee100b66f0 2024-09-15T22:08:55.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.398+0000 7fee1767b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fee100b4a70 con 0x7fee100b5870 2024-09-15T22:08:55.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee15417640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee100b5870 0x7fee101dd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee14c16640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee100b66f0 0x7fee100b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee15417640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee100b5870 0x7fee101dd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:33238/0 (socket says 172.21.15.175:33238) 2024-09-15T22:08:55.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee15417640 1 -- 172.21.15.175:0/1720776452 learned_addr learned my addr 172.21.15.175:0/1720776452 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-15T22:08:55.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee14c16640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee100b66f0 0x7fee100b3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41970/0 (socket says 172.21.15.175:41970) 2024-09-15T22:08:55.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee15c18640 1 --2- 172.21.15.175:0/1720776452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee101479b0 0x7fee101d44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee15417640 1 -- 172.21.15.175:0/1720776452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee100b66f0 msgr2=0x7fee100b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee15417640 1 --2- 172.21.15.175:0/1720776452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee100b66f0 0x7fee100b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee15417640 1 -- 172.21.15.175:0/1720776452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee101479b0 msgr2=0x7fee101d44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee15417640 1 --2- 172.21.15.175:0/1720776452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee101479b0 0x7fee101d44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee15417640 1 -- 172.21.15.175:0/1720776452 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee100aae20 con 0x7fee100b5870 2024-09-15T22:08:55.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee15417640 1 --2- 172.21.15.175:0/1720776452 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee100b5870 0x7fee101dd670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fee0800e990 tx=0x7fee0800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:55.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee0dffb640 1 -- 172.21.15.175:0/1720776452 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee08017070 con 0x7fee100b5870 2024-09-15T22:08:55.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee0dffb640 1 -- 172.21.15.175:0/1720776452 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee0800c9e0 con 0x7fee100b5870 2024-09-15T22:08:55.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee1767b640 1 -- 172.21.15.175:0/1720776452 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee101e0be0 con 0x7fee100b5870 2024-09-15T22:08:55.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee0dffb640 1 -- 172.21.15.175:0/1720776452 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0800cdb0 con 0x7fee100b5870 2024-09-15T22:08:55.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.399+0000 7fee1767b640 1 -- 172.21.15.175:0/1720776452 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fee101e1160 con 0x7fee100b5870 2024-09-15T22:08:55.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.400+0000 7fee0dffb640 1 -- 172.21.15.175:0/1720776452 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fee0801a070 con 0x7fee100b5870 2024-09-15T22:08:55.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.400+0000 7fee0dffb640 1 -- 172.21.15.175:0/1720776452 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fee080064d0 con 0x7fee100b5870 2024-09-15T22:08:55.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.400+0000 7fee1767b640 1 -- 172.21.15.175:0/1720776452 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee1014b8d0 con 0x7fee100b5870 2024-09-15T22:08:55.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.402+0000 7fee0dffb640 1 -- 172.21.15.175:0/1720776452 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fee080067b0 con 0x7fee100b5870 2024-09-15T22:08:55.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.472+0000 7fee1767b640 1 -- 172.21.15.175:0/1720776452 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d70426cd-a39b-4a20-8c7b-bedc8352e303", "id": 5} v 0) -- 0x7fee100ab090 con 0x7fee100b5870 2024-09-15T22:08:55.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.476+0000 7fee0dffb640 1 -- 172.21.15.175:0/1720776452 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d70426cd-a39b-4a20-8c7b-bedc8352e303", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fee08005990 con 0x7fee100b5870 2024-09-15T22:08:55.477 INFO:teuthology.orchestra.run.smithi175.stdout:5 2024-09-15T22:08:55.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.477+0000 7fee1767b640 1 -- 172.21.15.175:0/1720776452 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee100b5870 msgr2=0x7fee101dd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.477+0000 7fee1767b640 1 --2- 172.21.15.175:0/1720776452 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee100b5870 0x7fee101dd670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fee0800e990 tx=0x7fee0800ee50 comp rx=0 tx=0).stop 2024-09-15T22:08:55.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.477+0000 7fee1767b640 1 -- 172.21.15.175:0/1720776452 shutdown_connections 2024-09-15T22:08:55.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.477+0000 7fee1767b640 1 --2- 172.21.15.175:0/1720776452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee101479b0 0x7fee101d44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.477+0000 7fee1767b640 1 --2- 172.21.15.175:0/1720776452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee100b66f0 0x7fee100b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.477+0000 7fee1767b640 1 --2- 172.21.15.175:0/1720776452 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee100b5870 0x7fee101dd670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.477+0000 7fee1767b640 1 -- 172.21.15.175:0/1720776452 >> 172.21.15.175:0/1720776452 conn(0x7fee100740d0 msgr2=0x7fee100b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:55.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.477+0000 7fee1767b640 1 -- 172.21.15.175:0/1720776452 shutdown_connections 2024-09-15T22:08:55.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.477+0000 7fee1767b640 1 -- 172.21.15.175:0/1720776452 wait complete. 2024-09-15T22:08:55.489 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 95b9ed3a-cbfc-45a5-8967-88db9da099ee 6 2024-09-15T22:08:55.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.586+0000 7f3601d91640 1 Processor -- start 2024-09-15T22:08:55.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.586+0000 7f3601d91640 1 -- start start 2024-09-15T22:08:55.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.587+0000 7f3601d91640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f35fc0b5660 0x7f35fc147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.587+0000 7f3601d91640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35fc141ed0 0x7f35fc1481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.587+0000 7f3601d91640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35fc0b5a40 con 0x7f35fc0b0040 2024-09-15T22:08:55.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.587+0000 7f3601d91640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f35fc0af6b0 con 0x7f35fc0b5660 2024-09-15T22:08:55.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.587+0000 7f3601d91640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f35fc0b0590 con 0x7f35fc141ed0 2024-09-15T22:08:55.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.587+0000 7f35fbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35fc141ed0 0x7f35fc1481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.587+0000 7f35f2ffd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f35fc0b0040 0x7f35fc1417c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:55082/0 (socket says 172.21.15.175:55082) 2024-09-15T22:08:55.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.587+0000 7f35f2ffd640 1 -- 172.21.15.175:0/3825919816 learned_addr learned my addr 172.21.15.175:0/3825919816 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-09-15T22:08:55.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.587+0000 7f35fb7fe640 1 --2- 172.21.15.175:0/3825919816 >> v2:172.21.15.78:3300/0 conn(0x7f35fc0b5660 0x7f35fc147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.587+0000 7f35fbfff640 1 -- 172.21.15.175:0/3825919816 >> v2:172.21.15.78:3300/0 conn(0x7f35fc0b5660 msgr2=0x7f35fc147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:08:55.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.587+0000 7f35fbfff640 1 --2- 172.21.15.175:0/3825919816 >> v2:172.21.15.78:3300/0 conn(0x7f35fc0b5660 0x7f35fc147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.587+0000 7f35fbfff640 1 -- 172.21.15.175:0/3825919816 >> v1:172.21.15.175:6789/0 conn(0x7f35fc0b0040 legacy=0x7f35fc1417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.587+0000 7f35fbfff640 1 -- 172.21.15.175:0/3825919816 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35fc0af060 con 0x7f35fc141ed0 2024-09-15T22:08:55.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.588+0000 7f35fbfff640 1 --2- 172.21.15.175:0/3825919816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35fc141ed0 0x7f35fc1481a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009d90 tx=0x7f35f402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f66676e7a89e07d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:55.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.588+0000 7f35faffd640 1 -- 172.21.15.175:0/3825919816 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4031600 con 0x7f35fc141ed0 2024-09-15T22:08:55.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.588+0000 7f35faffd640 1 -- 172.21.15.175:0/3825919816 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f40317a0 con 0x7f35fc141ed0 2024-09-15T22:08:55.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.588+0000 7f35faffd640 1 -- 172.21.15.175:0/3825919816 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4031b70 con 0x7f35fc141ed0 2024-09-15T22:08:55.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.589+0000 7f3601d91640 1 -- 172.21.15.175:0/3825919816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35fc141ed0 msgr2=0x7f35fc1481a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.589+0000 7f3601d91640 1 --2- 172.21.15.175:0/3825919816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35fc141ed0 0x7f35fc1481a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009d90 tx=0x7f35f402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.589+0000 7f3601d91640 1 -- 172.21.15.175:0/3825919816 shutdown_connections 2024-09-15T22:08:55.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.589+0000 7f3601d91640 1 --2- 172.21.15.175:0/3825919816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35fc141ed0 0x7f35fc1481a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.589+0000 7f3601d91640 1 --2- 172.21.15.175:0/3825919816 >> v2:172.21.15.78:3300/0 conn(0x7f35fc0b5660 0x7f35fc147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.589+0000 7f3601d91640 1 -- 172.21.15.175:0/3825919816 >> 172.21.15.175:0/3825919816 conn(0x7f35fc0b66c0 msgr2=0x7f35fc0b6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:55.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.589+0000 7f3601d91640 1 -- 172.21.15.175:0/3825919816 shutdown_connections 2024-09-15T22:08:55.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.589+0000 7f3601d91640 1 -- 172.21.15.175:0/3825919816 wait complete. 2024-09-15T22:08:55.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.590+0000 7f3601d91640 1 Processor -- start 2024-09-15T22:08:55.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.590+0000 7f3601d91640 1 -- start start 2024-09-15T22:08:55.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.590+0000 7f3601d91640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35fc0b0040 0x7f35fc1438e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f3601d91640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35fc0b5660 0x7f35fc144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f3601d91640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35fc141ed0 0x7f35fc1e0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f3601d91640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc0737b0 con 0x7f35fc141ed0 2024-09-15T22:08:55.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f3601d91640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc073630 con 0x7f35fc0b0040 2024-09-15T22:08:55.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f3601d91640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f35fc073930 con 0x7f35fc0b5660 2024-09-15T22:08:55.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f35f2ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35fc0b5660 0x7f35fc144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f35fb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35fc0b0040 0x7f35fc1438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f35fb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35fc0b0040 0x7f35fc1438e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41980/0 (socket says 172.21.15.175:41980) 2024-09-15T22:08:55.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f35f2ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35fc0b5660 0x7f35fc144ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:33262/0 (socket says 172.21.15.175:33262) 2024-09-15T22:08:55.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f35fb7fe640 1 -- 172.21.15.175:0/2659918242 learned_addr learned my addr 172.21.15.175:0/2659918242 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-15T22:08:55.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f35fb7fe640 1 -- 172.21.15.175:0/2659918242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35fc0b5660 msgr2=0x7f35fc144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f35fb7fe640 1 --2- 172.21.15.175:0/2659918242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35fc0b5660 0x7f35fc144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f35fb7fe640 1 -- 172.21.15.175:0/2659918242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35fc141ed0 msgr2=0x7f35fc1e0870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:08:55.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f35fb7fe640 1 --2- 172.21.15.175:0/2659918242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35fc141ed0 0x7f35fc1e0870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f35fb7fe640 1 -- 172.21.15.175:0/2659918242 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35fc0722f0 con 0x7f35fc0b0040 2024-09-15T22:08:55.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f35f2ffd640 1 --2- 172.21.15.175:0/2659918242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35fc0b5660 0x7f35fc144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:08:55.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f35fb7fe640 1 --2- 172.21.15.175:0/2659918242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35fc0b0040 0x7f35fc1438e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00d800 tx=0x7f35ec00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:55.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f35f8ff9640 1 -- 172.21.15.175:0/2659918242 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec00b6c0 con 0x7f35fc0b0040 2024-09-15T22:08:55.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f35f8ff9640 1 -- 172.21.15.175:0/2659918242 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ec019070 con 0x7f35fc0b0040 2024-09-15T22:08:55.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f3601d91640 1 -- 172.21.15.175:0/2659918242 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35fc144060 con 0x7f35fc0b0040 2024-09-15T22:08:55.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f35f8ff9640 1 -- 172.21.15.175:0/2659918242 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec00ba80 con 0x7f35fc0b0040 2024-09-15T22:08:55.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.591+0000 7f3601d91640 1 -- 172.21.15.175:0/2659918242 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35fc072570 con 0x7f35fc0b0040 2024-09-15T22:08:55.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.592+0000 7f35f8ff9640 1 -- 172.21.15.175:0/2659918242 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f35ec00bc20 con 0x7f35fc0b0040 2024-09-15T22:08:55.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.592+0000 7f35f8ff9640 1 -- 172.21.15.175:0/2659918242 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f35ec014ac0 con 0x7f35fc0b0040 2024-09-15T22:08:55.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.592+0000 7f3601d91640 1 -- 172.21.15.175:0/2659918242 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35fc1417c0 con 0x7f35fc0b0040 2024-09-15T22:08:55.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.594+0000 7f35f8ff9640 1 -- 172.21.15.175:0/2659918242 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f35fc0722f0 con 0x7f35fc0b0040 2024-09-15T22:08:55.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.663+0000 7f3601d91640 1 -- 172.21.15.175:0/2659918242 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "95b9ed3a-cbfc-45a5-8967-88db9da099ee", "id": 6} v 0) -- 0x7f35fc145be0 con 0x7f35fc0b0040 2024-09-15T22:08:55.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.669+0000 7f35f8ff9640 1 -- 172.21.15.175:0/2659918242 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "95b9ed3a-cbfc-45a5-8967-88db9da099ee", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f35ec0144d0 con 0x7f35fc0b0040 2024-09-15T22:08:55.671 INFO:teuthology.orchestra.run.smithi175.stdout:6 2024-09-15T22:08:55.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.671+0000 7f3601d91640 1 -- 172.21.15.175:0/2659918242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35fc0b0040 msgr2=0x7f35fc1438e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.671+0000 7f3601d91640 1 --2- 172.21.15.175:0/2659918242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35fc0b0040 0x7f35fc1438e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00d800 tx=0x7f35ec00dcc0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.671+0000 7f3601d91640 1 -- 172.21.15.175:0/2659918242 shutdown_connections 2024-09-15T22:08:55.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.671+0000 7f3601d91640 1 --2- 172.21.15.175:0/2659918242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35fc141ed0 0x7f35fc1e0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.671+0000 7f3601d91640 1 --2- 172.21.15.175:0/2659918242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35fc0b5660 0x7f35fc144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.671+0000 7f3601d91640 1 --2- 172.21.15.175:0/2659918242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35fc0b0040 0x7f35fc1438e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.671+0000 7f3601d91640 1 -- 172.21.15.175:0/2659918242 >> 172.21.15.175:0/2659918242 conn(0x7f35fc0b66c0 msgr2=0x7f35fc14b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:55.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.671+0000 7f3601d91640 1 -- 172.21.15.175:0/2659918242 shutdown_connections 2024-09-15T22:08:55.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.671+0000 7f3601d91640 1 -- 172.21.15.175:0/2659918242 wait complete. 2024-09-15T22:08:55.686 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 5fc56286-91e9-4a13-b161-ad7d30fc0119 7 2024-09-15T22:08:55.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.782+0000 7ff5441be640 1 Processor -- start 2024-09-15T22:08:55.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.782+0000 7ff5441be640 1 -- start start 2024-09-15T22:08:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.783+0000 7ff5441be640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff53c0704b0 0x7ff53c1432a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.783+0000 7ff5441be640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff53c06d900 0x7ff53c148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.783+0000 7ff5441be640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff53c0b0910 con 0x7ff53c0b3360 2024-09-15T22:08:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.783+0000 7ff5441be640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7ff53c0b3740 con 0x7ff53c06d900 2024-09-15T22:08:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.783+0000 7ff5441be640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff53c0709e0 con 0x7ff53c0704b0 2024-09-15T22:08:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.783+0000 7ff541759640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff53c0704b0 0x7ff53c1432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.783+0000 7ff541759640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff53c0704b0 0x7ff53c1432a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41992/0 (socket says 172.21.15.175:41992) 2024-09-15T22:08:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.783+0000 7ff541759640 1 -- 172.21.15.175:0/2596752919 learned_addr learned my addr 172.21.15.175:0/2596752919 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-15T22:08:55.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.783+0000 7ff54275b640 1 --2- 172.21.15.175:0/2596752919 >> v2:172.21.15.78:3300/0 conn(0x7ff53c06d900 0x7ff53c148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.783+0000 7ff541759640 1 -- 172.21.15.175:0/2596752919 >> v2:172.21.15.78:3300/0 conn(0x7ff53c06d900 msgr2=0x7ff53c148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:08:55.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.783+0000 7ff541759640 1 --2- 172.21.15.175:0/2596752919 >> v2:172.21.15.78:3300/0 conn(0x7ff53c06d900 0x7ff53c148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.783+0000 7ff541759640 1 -- 172.21.15.175:0/2596752919 >> v1:172.21.15.78:6789/0 conn(0x7ff53c0b3360 legacy=0x7ff53c142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.783+0000 7ff541759640 1 -- 172.21.15.175:0/2596752919 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53c070cc0 con 0x7ff53c0704b0 2024-09-15T22:08:55.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.784+0000 7ff541759640 1 --2- 172.21.15.175:0/2596752919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff53c0704b0 0x7ff53c1432a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff53c06d3a0 tx=0x7ff53802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e158f25327ba3e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:55.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.784+0000 7ff540f58640 1 -- 172.21.15.175:0/2596752919 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538037070 con 0x7ff53c0704b0 2024-09-15T22:08:55.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.784+0000 7ff540f58640 1 -- 172.21.15.175:0/2596752919 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff538032440 con 0x7ff53c0704b0 2024-09-15T22:08:55.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.784+0000 7ff540f58640 1 -- 172.21.15.175:0/2596752919 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538032810 con 0x7ff53c0704b0 2024-09-15T22:08:55.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.785+0000 7ff5441be640 1 -- 172.21.15.175:0/2596752919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff53c0704b0 msgr2=0x7ff53c1432a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.785+0000 7ff5441be640 1 --2- 172.21.15.175:0/2596752919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff53c0704b0 0x7ff53c1432a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff53c06d3a0 tx=0x7ff53802a1e0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.785+0000 7ff5441be640 1 -- 172.21.15.175:0/2596752919 shutdown_connections 2024-09-15T22:08:55.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.785+0000 7ff5441be640 1 --2- 172.21.15.175:0/2596752919 >> v2:172.21.15.78:3300/0 conn(0x7ff53c06d900 0x7ff53c148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.785+0000 7ff5441be640 1 --2- 172.21.15.175:0/2596752919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff53c0704b0 0x7ff53c1432a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.785+0000 7ff5441be640 1 -- 172.21.15.175:0/2596752919 >> 172.21.15.175:0/2596752919 conn(0x7ff53c0b66c0 msgr2=0x7ff53c0b6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:55.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.785+0000 7ff5441be640 1 -- 172.21.15.175:0/2596752919 shutdown_connections 2024-09-15T22:08:55.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.785+0000 7ff5441be640 1 -- 172.21.15.175:0/2596752919 wait complete. 2024-09-15T22:08:55.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.786+0000 7ff5441be640 1 Processor -- start 2024-09-15T22:08:55.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.786+0000 7ff5441be640 1 -- start start 2024-09-15T22:08:55.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff5441be640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff53c06d900 0x7ff53c14d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff5441be640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff53c0704b0 0x7ff53c14ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff5441be640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff53c0b3360 0x7ff53c14b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:55.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff5441be640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c150210 con 0x7ff53c0b3360 2024-09-15T22:08:55.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff5441be640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c06be10 con 0x7ff53c06d900 2024-09-15T22:08:55.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff5441be640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff53c150390 con 0x7ff53c0704b0 2024-09-15T22:08:55.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff541f5a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff53c06d900 0x7ff53c14d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff541759640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff53c0704b0 0x7ff53c14ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff541759640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff53c0704b0 0x7ff53c14ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:33276/0 (socket says 172.21.15.175:33276) 2024-09-15T22:08:55.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff541759640 1 -- 172.21.15.175:0/1096671322 learned_addr learned my addr 172.21.15.175:0/1096671322 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-15T22:08:55.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff54275b640 1 --2- 172.21.15.175:0/1096671322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff53c0b3360 0x7ff53c14b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:55.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff541759640 1 -- 172.21.15.175:0/1096671322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff53c06d900 msgr2=0x7ff53c14d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff541759640 1 --2- 172.21.15.175:0/1096671322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff53c06d900 0x7ff53c14d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff541759640 1 -- 172.21.15.175:0/1096671322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff53c0b3360 msgr2=0x7ff53c14b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff541759640 1 --2- 172.21.15.175:0/1096671322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff53c0b3360 0x7ff53c14b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff541759640 1 -- 172.21.15.175:0/1096671322 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53c14b150 con 0x7ff53c0704b0 2024-09-15T22:08:55.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff541f5a640 1 --2- 172.21.15.175:0/1096671322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff53c06d900 0x7ff53c14d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:08:55.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff541759640 1 --2- 172.21.15.175:0/1096671322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff53c0704b0 0x7ff53c14ea30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff538000c00 tx=0x7ff5380046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:55.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.787+0000 7ff5327fc640 1 -- 172.21.15.175:0/1096671322 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538041020 con 0x7ff53c0704b0 2024-09-15T22:08:55.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.788+0000 7ff5327fc640 1 -- 172.21.15.175:0/1096671322 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5380306c0 con 0x7ff53c0704b0 2024-09-15T22:08:55.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.788+0000 7ff5441be640 1 -- 172.21.15.175:0/1096671322 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53c14e160 con 0x7ff53c0704b0 2024-09-15T22:08:55.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.788+0000 7ff5327fc640 1 -- 172.21.15.175:0/1096671322 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538037040 con 0x7ff53c0704b0 2024-09-15T22:08:55.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.788+0000 7ff5441be640 1 -- 172.21.15.175:0/1096671322 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff53c14de30 con 0x7ff53c0704b0 2024-09-15T22:08:55.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.788+0000 7ff5327fc640 1 -- 172.21.15.175:0/1096671322 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff538044020 con 0x7ff53c0704b0 2024-09-15T22:08:55.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.788+0000 7ff5327fc640 1 -- 172.21.15.175:0/1096671322 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff53803dc90 con 0x7ff53c0704b0 2024-09-15T22:08:55.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.789+0000 7ff5441be640 1 -- 172.21.15.175:0/1096671322 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff53c148ee0 con 0x7ff53c0704b0 2024-09-15T22:08:55.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.792+0000 7ff5327fc640 1 -- 172.21.15.175:0/1096671322 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff53804b030 con 0x7ff53c0704b0 2024-09-15T22:08:55.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.862+0000 7ff5441be640 1 -- 172.21.15.175:0/1096671322 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5fc56286-91e9-4a13-b161-ad7d30fc0119", "id": 7} v 0) -- 0x7ff53c070140 con 0x7ff53c0704b0 2024-09-15T22:08:55.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.868+0000 7ff5327fc640 1 -- 172.21.15.175:0/1096671322 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5fc56286-91e9-4a13-b161-ad7d30fc0119", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff53803d420 con 0x7ff53c0704b0 2024-09-15T22:08:55.869 INFO:teuthology.orchestra.run.smithi175.stdout:7 2024-09-15T22:08:55.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.869+0000 7ff5441be640 1 -- 172.21.15.175:0/1096671322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff53c0704b0 msgr2=0x7ff53c14ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.869+0000 7ff5441be640 1 --2- 172.21.15.175:0/1096671322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff53c0704b0 0x7ff53c14ea30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff538000c00 tx=0x7ff5380046c0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.869+0000 7ff5441be640 1 -- 172.21.15.175:0/1096671322 shutdown_connections 2024-09-15T22:08:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.869+0000 7ff5441be640 1 --2- 172.21.15.175:0/1096671322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff53c0b3360 0x7ff53c14b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.869+0000 7ff5441be640 1 --2- 172.21.15.175:0/1096671322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff53c0704b0 0x7ff53c14ea30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.869+0000 7ff5441be640 1 --2- 172.21.15.175:0/1096671322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff53c06d900 0x7ff53c14d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.869+0000 7ff5441be640 1 -- 172.21.15.175:0/1096671322 >> 172.21.15.175:0/1096671322 conn(0x7ff53c0b66c0 msgr2=0x7ff53c0b77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.869+0000 7ff5441be640 1 -- 172.21.15.175:0/1096671322 shutdown_connections 2024-09-15T22:08:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-15T22:08:55.869+0000 7ff5441be640 1 -- 172.21.15.175:0/1096671322 wait complete. 2024-09-15T22:08:55.880 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-15T22:08:55.880 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-15T22:08:55.882 INFO:tasks.ceph.osd.0:Started 2024-09-15T22:08:55.883 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-15T22:08:55.883 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-15T22:08:55.885 INFO:tasks.ceph.osd.1:Started 2024-09-15T22:08:55.885 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-15T22:08:55.885 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-15T22:08:55.887 INFO:tasks.ceph.osd.2:Started 2024-09-15T22:08:55.887 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-15T22:08:55.887 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-15T22:08:55.889 INFO:tasks.ceph.osd.3:Started 2024-09-15T22:08:55.889 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-15T22:08:55.889 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-15T22:08:55.892 INFO:tasks.ceph.osd.4:Started 2024-09-15T22:08:55.892 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-15T22:08:55.892 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-15T22:08:55.894 INFO:tasks.ceph.osd.5:Started 2024-09-15T22:08:55.894 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-15T22:08:55.894 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-15T22:08:55.896 INFO:tasks.ceph.osd.6:Started 2024-09-15T22:08:55.896 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-15T22:08:55.896 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-15T22:08:55.899 INFO:tasks.ceph.osd.7:Started 2024-09-15T22:08:55.899 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:08:56.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.027+0000 7f6ff207b640 1 Processor -- start 2024-09-15T22:08:56.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.027+0000 7f6ff207b640 1 -- start start 2024-09-15T22:08:56.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.027+0000 7f6ff207b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6fec0b3150 0x7f6fec0b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:56.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.028+0000 7f6ff207b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fec0b1950 0x7f6fec0b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:56.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.028+0000 7f6ff207b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fec0b4690 con 0x7f6fec145370 2024-09-15T22:08:56.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.028+0000 7f6ff207b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f6fec1457a0 con 0x7f6fec0b3150 2024-09-15T22:08:56.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.028+0000 7f6ff207b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6fec0b1dc0 con 0x7f6fec0b1950 2024-09-15T22:08:56.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.028+0000 7f6feb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6fec0b3150 0x7f6fec0b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:56.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.028+0000 7f6feb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6fec0b3150 0x7f6fec0b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40560/0 (socket says 172.21.15.78:40560) 2024-09-15T22:08:56.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.028+0000 7f6feb7fe640 1 -- 172.21.15.78:0/2886891015 learned_addr learned my addr 172.21.15.78:0/2886891015 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:08:56.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.028+0000 7f6febfff640 1 --2- 172.21.15.78:0/2886891015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fec0b1950 0x7f6fec0b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:56.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.028+0000 7f6feb7fe640 1 -- 172.21.15.78:0/2886891015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fec0b1950 msgr2=0x7f6fec0b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:08:56.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.028+0000 7f6feb7fe640 1 --2- 172.21.15.78:0/2886891015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fec0b1950 0x7f6fec0b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:56.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.028+0000 7f6feb7fe640 1 -- 172.21.15.78:0/2886891015 >> v1:172.21.15.175:6789/0 conn(0x7f6fec145370 legacy=0x7f6fec073c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:56.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.028+0000 7f6feb7fe640 1 -- 172.21.15.78:0/2886891015 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fec1448d0 con 0x7f6fec0b3150 2024-09-15T22:08:56.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.029+0000 7f6feb7fe640 1 --2- 172.21.15.78:0/2886891015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec0b3150 0x7f6fec0b3530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00bb10 tx=0x7f6fdc02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0b7a0ae4c6a047 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:56.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.029+0000 7f6fea7fc640 1 -- 172.21.15.78:0/2886891015 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc032790 con 0x7f6fec0b3150 2024-09-15T22:08:56.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.029+0000 7f6fea7fc640 1 -- 172.21.15.78:0/2886891015 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fdc038070 con 0x7f6fec0b3150 2024-09-15T22:08:56.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.029+0000 7f6fea7fc640 1 -- 172.21.15.78:0/2886891015 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc032b50 con 0x7f6fec0b3150 2024-09-15T22:08:56.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.029+0000 7f6ff207b640 1 -- 172.21.15.78:0/2886891015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec0b3150 msgr2=0x7f6fec0b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:56.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.029+0000 7f6ff207b640 1 --2- 172.21.15.78:0/2886891015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec0b3150 0x7f6fec0b3530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00bb10 tx=0x7f6fdc02c890 comp rx=0 tx=0).stop 2024-09-15T22:08:56.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.030+0000 7f6ff207b640 1 -- 172.21.15.78:0/2886891015 shutdown_connections 2024-09-15T22:08:56.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.030+0000 7f6ff207b640 1 --2- 172.21.15.78:0/2886891015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fec0b1950 0x7f6fec0b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:56.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.030+0000 7f6ff207b640 1 --2- 172.21.15.78:0/2886891015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec0b3150 0x7f6fec0b3530 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:56.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.030+0000 7f6ff207b640 1 -- 172.21.15.78:0/2886891015 >> 172.21.15.78:0/2886891015 conn(0x7f6fec06c3d0 msgr2=0x7f6fec0ba380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:56.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.030+0000 7f6ff207b640 1 -- 172.21.15.78:0/2886891015 shutdown_connections 2024-09-15T22:08:56.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.030+0000 7f6ff207b640 1 -- 172.21.15.78:0/2886891015 wait complete. 2024-09-15T22:08:56.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.031+0000 7f6ff207b640 1 Processor -- start 2024-09-15T22:08:56.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.031+0000 7f6ff207b640 1 -- start start 2024-09-15T22:08:56.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.031+0000 7f6ff207b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec0b1950 0x7f6fec13c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:56.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.031+0000 7f6ff207b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fec0b3150 0x7f6fec1d8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:56.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.031+0000 7f6ff207b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fec145370 0x7f6fec1d9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:56.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.031+0000 7f6ff207b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec0b2840 con 0x7f6fec0b1950 2024-09-15T22:08:56.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.031+0000 7f6ff207b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec144ee0 con 0x7f6fec0b3150 2024-09-15T22:08:56.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.031+0000 7f6ff207b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6fec0b29c0 con 0x7f6fec145370 2024-09-15T22:08:56.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.031+0000 7f6feb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec0b1950 0x7f6fec13c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:56.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.031+0000 7f6feb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec0b1950 0x7f6fec13c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40576/0 (socket says 172.21.15.78:40576) 2024-09-15T22:08:56.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.031+0000 7f6feb7fe640 1 -- 172.21.15.78:0/4193062747 learned_addr learned my addr 172.21.15.78:0/4193062747 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:08:56.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.032+0000 7f6feaffd640 1 --2- 172.21.15.78:0/4193062747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fec0b3150 0x7f6fec1d8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:56.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.032+0000 7f6febfff640 1 --2- 172.21.15.78:0/4193062747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fec145370 0x7f6fec1d9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:56.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.032+0000 7f6feb7fe640 1 -- 172.21.15.78:0/4193062747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fec145370 msgr2=0x7f6fec1d9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:56.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.032+0000 7f6feb7fe640 1 --2- 172.21.15.78:0/4193062747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fec145370 0x7f6fec1d9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:56.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.032+0000 7f6feb7fe640 1 -- 172.21.15.78:0/4193062747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fec0b3150 msgr2=0x7f6fec1d8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:56.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.032+0000 7f6feb7fe640 1 --2- 172.21.15.78:0/4193062747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fec0b3150 0x7f6fec1d8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:56.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.032+0000 7f6feb7fe640 1 -- 172.21.15.78:0/4193062747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fec13b860 con 0x7f6fec0b1950 2024-09-15T22:08:56.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.032+0000 7f6febfff640 1 --2- 172.21.15.78:0/4193062747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fec145370 0x7f6fec1d9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:08:56.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.032+0000 7f6feb7fe640 1 --2- 172.21.15.78:0/4193062747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec0b1950 0x7f6fec13c2d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc02c8d0 tx=0x7f6fdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:56.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.032+0000 7f6fd3fff640 1 -- 172.21.15.78:0/4193062747 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc033620 con 0x7f6fec0b1950 2024-09-15T22:08:56.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.032+0000 7f6fd3fff640 1 -- 172.21.15.78:0/4193062747 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fdc0337e0 con 0x7f6fec0b1950 2024-09-15T22:08:56.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.032+0000 7f6fd3fff640 1 -- 172.21.15.78:0/4193062747 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc033bd0 con 0x7f6fec0b1950 2024-09-15T22:08:56.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.032+0000 7f6ff207b640 1 -- 172.21.15.78:0/4193062747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fec140dc0 con 0x7f6fec0b1950 2024-09-15T22:08:56.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.032+0000 7f6ff207b640 1 -- 172.21.15.78:0/4193062747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fec13b580 con 0x7f6fec0b1950 2024-09-15T22:08:56.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.032+0000 7f6fd3fff640 1 -- 172.21.15.78:0/4193062747 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6fdc04d060 con 0x7f6fec0b1950 2024-09-15T22:08:56.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.033+0000 7f6fd3fff640 1 -- 172.21.15.78:0/4193062747 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6fdc033d70 con 0x7f6fec0b1950 2024-09-15T22:08:56.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.033+0000 7f6ff207b640 1 -- 172.21.15.78:0/4193062747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fec0b2300 con 0x7f6fec0b1950 2024-09-15T22:08:56.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.035+0000 7f6fd3fff640 1 -- 172.21.15.78:0/4193062747 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6fdc041070 con 0x7f6fec0b1950 2024-09-15T22:08:56.043 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:56.042+0000 7f56da720040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:08:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.093+0000 7f6ff207b640 1 -- 172.21.15.78:0/4193062747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6fec141d10 con 0x7f6fec0b1950 2024-09-15T22:08:56.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.094+0000 7f6fd3fff640 1 -- 172.21.15.78:0/4193062747 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6fdc053020 con 0x7f6fec0b1950 2024-09-15T22:08:56.096 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:08:56.096 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":10,"fsid":"34e44e87-1d1a-416f-b208-c16e07980ff5","created":"2024-09-15T22:08:53.842443+0000","modified":"2024-09-15T22:08:55.864039+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T22:08:55.864039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"71eb9af6-bf66-4450-a5d1-d4a81f71f95b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f0070f6d-7998-4ad3-b597-e5777e61d503","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6d9c91c7-2c8a-48f9-9bef-67ea7320980e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"943e38fb-b450-48c0-8f01-d381b0b8e313","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"259f50f8-3223-450d-8cd1-d0d333c278dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d70426cd-a39b-4a20-8c7b-bedc8352e303","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"95b9ed3a-cbfc-45a5-8967-88db9da099ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fc56286-91e9-4a13-b161-ad7d30fc0119","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:08:56.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.095+0000 7f6ff207b640 1 -- 172.21.15.78:0/4193062747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec0b1950 msgr2=0x7f6fec13c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:56.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.095+0000 7f6ff207b640 1 --2- 172.21.15.78:0/4193062747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec0b1950 0x7f6fec13c2d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc02c8d0 tx=0x7f6fdc0046c0 comp rx=0 tx=0).stop 2024-09-15T22:08:56.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.095+0000 7f6ff207b640 1 -- 172.21.15.78:0/4193062747 shutdown_connections 2024-09-15T22:08:56.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.095+0000 7f6ff207b640 1 --2- 172.21.15.78:0/4193062747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fec145370 0x7f6fec1d9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:56.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.095+0000 7f6ff207b640 1 --2- 172.21.15.78:0/4193062747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fec0b3150 0x7f6fec1d8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:56.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.095+0000 7f6ff207b640 1 --2- 172.21.15.78:0/4193062747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec0b1950 0x7f6fec13c2d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:56.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.095+0000 7f6ff207b640 1 -- 172.21.15.78:0/4193062747 >> 172.21.15.78:0/4193062747 conn(0x7f6fec06c3d0 msgr2=0x7f6fec070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:56.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.095+0000 7f6ff207b640 1 -- 172.21.15.78:0/4193062747 shutdown_connections 2024-09-15T22:08:56.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:08:56.095+0000 7f6ff207b640 1 -- 172.21.15.78:0/4193062747 wait complete. 2024-09-15T22:08:56.098 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:56.096+0000 7f56da720040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:08:56.105 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:56.104+0000 7fede6130040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:08:56.107 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-15T22:08:56.107 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-15T22:08:56.157 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:56.156+0000 7fede6130040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:08:56.467 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:56.465+0000 7f56da720040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:08:56.520 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:56.519+0000 7fede6130040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:08:56.552 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:56.550+0000 7f56da720040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:08:56.605 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:56.604+0000 7fede6130040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:08:56.661 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:56.659+0000 7f56da720040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:08:56.706 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:56.705+0000 7f56da720040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:08:56.710 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:56.709+0000 7fede6130040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:08:56.755 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:56.754+0000 7fede6130040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:08:56.819 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:56.818+0000 7f56da720040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:08:56.871 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:56.870+0000 7fede6130040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:08:56.875 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:56.873+0000 7f56da720040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:08:56.914 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T22:08:56.920 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:56.919+0000 7f56da720040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:08:56.924 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:56.923+0000 7fede6130040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:08:56.968 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:56.967+0000 7fede6130040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:08:57.004 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.002+0000 7ff9b70a5640 1 Processor -- start 2024-09-15T22:08:57.004 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.002+0000 7ff9b70a5640 1 -- start start 2024-09-15T22:08:57.006 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.003+0000 7ff9b70a5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff9b00b32e0 0x7ff9b00b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:57.006 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.003+0000 7ff9b70a5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b00b2880 0x7ff9b01487a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:57.006 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.003+0000 7ff9b70a5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b00b36c0 con 0x7ff9b00b2140 2024-09-15T22:08:57.006 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.003+0000 7ff9b70a5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff9b0148310 con 0x7ff9b00b32e0 2024-09-15T22:08:57.006 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.003+0000 7ff9b70a5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b00b4590 con 0x7ff9b00b2880 2024-09-15T22:08:57.006 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.003+0000 7ff9affff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b00b2880 0x7ff9b01487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:57.006 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.003+0000 7ff9b4e41640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff9b00b32e0 0x7ff9b00b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:57.006 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.003+0000 7ff9affff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b00b2880 0x7ff9b01487a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.78:33554/0 (socket says 172.21.15.78:33554) 2024-09-15T22:08:57.006 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.003+0000 7ff9b4e41640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff9b00b32e0 0x7ff9b00b4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.78:35714/0 (socket says 172.21.15.78:35714) 2024-09-15T22:08:57.006 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.003+0000 7ff9affff640 1 -- 172.21.15.78:0/4194501515 learned_addr learned my addr 172.21.15.78:0/4194501515 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:08:57.006 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.004+0000 7ff9b4e41640 1 -- 172.21.15.78:0/4194501515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b00b2880 msgr2=0x7ff9b01487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:08:57.007 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.004+0000 7ff9b4e41640 1 --2- 172.21.15.78:0/4194501515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b00b2880 0x7ff9b01487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.007 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.004+0000 7ff9b4e41640 1 -- 172.21.15.78:0/4194501515 >> v1:172.21.15.175:6789/0 conn(0x7ff9b00b2140 legacy=0x7ff9b013e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:57.007 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.004+0000 7ff9b4e41640 1 -- 172.21.15.78:0/4194501515 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b0147cc0 con 0x7ff9b00b32e0 2024-09-15T22:08:57.007 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.004+0000 7ff9affff640 1 --2- 172.21.15.78:0/4194501515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b00b2880 0x7ff9b01487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:08:57.008 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.004+0000 7ff9b4e41640 1 --2- 172.21.15.78:0/4194501515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9b00b32e0 0x7ff9b00b4c10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40097a0 tx=0x7ff9a402c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ec08dba0c2fd905 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:57.008 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.005+0000 7ff9af7fe640 1 -- 172.21.15.78:0/4194501515 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4039070 con 0x7ff9b00b32e0 2024-09-15T22:08:57.008 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.005+0000 7ff9af7fe640 1 -- 172.21.15.78:0/4194501515 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a4034640 con 0x7ff9b00b32e0 2024-09-15T22:08:57.008 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.005+0000 7ff9af7fe640 1 -- 172.21.15.78:0/4194501515 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a402ce60 con 0x7ff9b00b32e0 2024-09-15T22:08:57.009 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.005+0000 7ff9b70a5640 1 -- 172.21.15.78:0/4194501515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9b00b32e0 msgr2=0x7ff9b00b4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:57.009 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.005+0000 7ff9b70a5640 1 --2- 172.21.15.78:0/4194501515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9b00b32e0 0x7ff9b00b4c10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40097a0 tx=0x7ff9a402c310 comp rx=0 tx=0).stop 2024-09-15T22:08:57.009 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.005+0000 7ff9b70a5640 1 -- 172.21.15.78:0/4194501515 shutdown_connections 2024-09-15T22:08:57.009 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.005+0000 7ff9b70a5640 1 --2- 172.21.15.78:0/4194501515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b00b2880 0x7ff9b01487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.009 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.005+0000 7ff9b70a5640 1 --2- 172.21.15.78:0/4194501515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9b00b32e0 0x7ff9b00b4c10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.009 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.005+0000 7ff9b70a5640 1 -- 172.21.15.78:0/4194501515 >> 172.21.15.78:0/4194501515 conn(0x7ff9b00bacb0 msgr2=0x7ff9b00b6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:57.009 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.005+0000 7ff9b70a5640 1 -- 172.21.15.78:0/4194501515 shutdown_connections 2024-09-15T22:08:57.009 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.005+0000 7ff9b70a5640 1 -- 172.21.15.78:0/4194501515 wait complete. 2024-09-15T22:08:57.009 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.006+0000 7ff9b70a5640 1 Processor -- start 2024-09-15T22:08:57.009 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.006+0000 7ff9b70a5640 1 -- start start 2024-09-15T22:08:57.011 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9b70a5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9b00b2140 0x7ff9b01469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:57.011 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9b70a5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b00b2880 0x7ff9b01e0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:57.011 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9b70a5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9b00b32e0 0x7ff9b00ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:57.011 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9b70a5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b013ed20 con 0x7ff9b00b32e0 2024-09-15T22:08:57.011 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9b70a5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b013eba0 con 0x7ff9b00b2140 2024-09-15T22:08:57.011 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9b70a5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b006bbc0 con 0x7ff9b00b2880 2024-09-15T22:08:57.012 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9b5642640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9b00b32e0 0x7ff9b00ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:57.012 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9b5642640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9b00b32e0 0x7ff9b00ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40584/0 (socket says 172.21.15.78:40584) 2024-09-15T22:08:57.012 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9b5642640 1 -- 172.21.15.78:0/906912481 learned_addr learned my addr 172.21.15.78:0/906912481 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:08:57.012 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9b4e41640 1 --2- 172.21.15.78:0/906912481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9b00b2140 0x7ff9b01469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:57.012 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9affff640 1 --2- 172.21.15.78:0/906912481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b00b2880 0x7ff9b01e0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:57.012 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9b5642640 1 -- 172.21.15.78:0/906912481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b00b2880 msgr2=0x7ff9b01e0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:57.012 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9b5642640 1 --2- 172.21.15.78:0/906912481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b00b2880 0x7ff9b01e0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.012 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9b5642640 1 -- 172.21.15.78:0/906912481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9b00b2140 msgr2=0x7ff9b01469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:57.012 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9b5642640 1 --2- 172.21.15.78:0/906912481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9b00b2140 0x7ff9b01469d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.012 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.007+0000 7ff9b5642640 1 -- 172.21.15.78:0/906912481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b0142660 con 0x7ff9b00b32e0 2024-09-15T22:08:57.012 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.008+0000 7ff9b5642640 1 --2- 172.21.15.78:0/906912481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9b00b32e0 0x7ff9b00ae8f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800c7d0 tx=0x7ff9a800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:57.012 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.008+0000 7ff9ad7fa640 1 -- 172.21.15.78:0/906912481 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8003b70 con 0x7ff9b00b32e0 2024-09-15T22:08:57.012 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.008+0000 7ff9ad7fa640 1 -- 172.21.15.78:0/906912481 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a8003d30 con 0x7ff9b00b32e0 2024-09-15T22:08:57.013 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.008+0000 7ff9ad7fa640 1 -- 172.21.15.78:0/906912481 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a800aa90 con 0x7ff9b00b32e0 2024-09-15T22:08:57.013 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.008+0000 7ff9b70a5640 1 -- 172.21.15.78:0/906912481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b00b1280 con 0x7ff9b00b32e0 2024-09-15T22:08:57.013 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.008+0000 7ff9b70a5640 1 -- 172.21.15.78:0/906912481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b0147260 con 0x7ff9b00b32e0 2024-09-15T22:08:57.013 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.008+0000 7ff9ad7fa640 1 -- 172.21.15.78:0/906912481 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff9a800ac30 con 0x7ff9b00b32e0 2024-09-15T22:08:57.013 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.008+0000 7ff9ad7fa640 1 -- 172.21.15.78:0/906912481 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff9a8012cd0 con 0x7ff9b00b32e0 2024-09-15T22:08:57.013 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.009+0000 7ff9b70a5640 1 -- 172.21.15.78:0/906912481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b0148780 con 0x7ff9b00b32e0 2024-09-15T22:08:57.014 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.013+0000 7ff9ad7fa640 1 -- 172.21.15.78:0/906912481 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff9a8012600 con 0x7ff9b00b32e0 2024-09-15T22:08:57.040 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:57.039+0000 7f56da720040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:08:57.073 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.072+0000 7ff9b70a5640 1 -- 172.21.15.78:0/906912481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9b0142830 con 0x7ff9b00b32e0 2024-09-15T22:08:57.074 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.072+0000 7ff9ad7fa640 1 -- 172.21.15.78:0/906912481 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff9a80127e0 con 0x7ff9b00b32e0 2024-09-15T22:08:57.074 INFO:teuthology.misc.health.smithi078.stdout: 2024-09-15T22:08:57.074 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":10,"fsid":"34e44e87-1d1a-416f-b208-c16e07980ff5","created":"2024-09-15T22:08:53.842443+0000","modified":"2024-09-15T22:08:55.864039+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T22:08:55.864039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"71eb9af6-bf66-4450-a5d1-d4a81f71f95b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f0070f6d-7998-4ad3-b597-e5777e61d503","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6d9c91c7-2c8a-48f9-9bef-67ea7320980e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"943e38fb-b450-48c0-8f01-d381b0b8e313","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"259f50f8-3223-450d-8cd1-d0d333c278dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d70426cd-a39b-4a20-8c7b-bedc8352e303","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"95b9ed3a-cbfc-45a5-8967-88db9da099ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fc56286-91e9-4a13-b161-ad7d30fc0119","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:08:57.075 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.073+0000 7ff9b70a5640 1 -- 172.21.15.78:0/906912481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9b00b32e0 msgr2=0x7ff9b00ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:57.075 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.073+0000 7ff9b70a5640 1 --2- 172.21.15.78:0/906912481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9b00b32e0 0x7ff9b00ae8f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800c7d0 tx=0x7ff9a800cc90 comp rx=0 tx=0).stop 2024-09-15T22:08:57.076 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.073+0000 7ff9b70a5640 1 -- 172.21.15.78:0/906912481 shutdown_connections 2024-09-15T22:08:57.076 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.073+0000 7ff9b70a5640 1 --2- 172.21.15.78:0/906912481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9b00b32e0 0x7ff9b00ae8f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.076 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.073+0000 7ff9b70a5640 1 --2- 172.21.15.78:0/906912481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b00b2880 0x7ff9b01e0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.076 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.073+0000 7ff9b70a5640 1 --2- 172.21.15.78:0/906912481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9b00b2140 0x7ff9b01469d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.076 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.073+0000 7ff9b70a5640 1 -- 172.21.15.78:0/906912481 >> 172.21.15.78:0/906912481 conn(0x7ff9b00bacb0 msgr2=0x7ff9b013e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:57.076 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.073+0000 7ff9b70a5640 1 -- 172.21.15.78:0/906912481 shutdown_connections 2024-09-15T22:08:57.076 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:08:57.073+0000 7ff9b70a5640 1 -- 172.21.15.78:0/906912481 wait complete. 2024-09-15T22:08:57.081 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:57.080+0000 7fede6130040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:08:57.084 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-15T22:08:57.093 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:57.091+0000 7f56da720040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:08:57.121 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-15T22:08:57.119+0000 7f4b9ee20640 -1 Falling back to public interface 2024-09-15T22:08:57.132 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:57.131+0000 7fede6130040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:08:57.146 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:57.144+0000 7f56da720040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:08:57.183 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:57.182+0000 7fede6130040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:08:57.213 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:57.211+0000 7f56da720040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:08:57.250 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:57.249+0000 7fede6130040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:08:57.256 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:57.255+0000 7f56da720040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:08:57.294 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:57.292+0000 7fede6130040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:08:57.299 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:57.298+0000 7f56da720040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:08:57.338 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:57.336+0000 7fede6130040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:08:57.338 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-09-15T22:08:57.337+0000 7faba4ce6640 -1 Falling back to public interface 2024-09-15T22:08:57.356 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-15T22:08:57.354+0000 7f2ddb060640 -1 Falling back to public interface 2024-09-15T22:08:57.364 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-15T22:08:57.362+0000 7fee5dfa4640 -1 Falling back to public interface 2024-09-15T22:08:57.380 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-09-15T22:08:57.378+0000 7fd011411640 -1 Falling back to public interface 2024-09-15T22:08:57.597 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-09-15T22:08:57.595+0000 7fdc2e958640 -1 Falling back to public interface 2024-09-15T22:08:57.611 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-09-15T22:08:57.610+0000 7fe743e83640 -1 Falling back to public interface 2024-09-15T22:08:57.865 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-15T22:08:57.863+0000 7f21b1215640 -1 Falling back to public interface 2024-09-15T22:08:57.960 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:57.958+0000 7f56da720040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:08:57.999 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-15T22:08:57.998+0000 7fede6130040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:08:58.976 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:58.974+0000 7f567a6f6640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-15T22:08:58.976 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-15T22:08:58.975+0000 7f567a6f6640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-15T22:09:00.903 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-15T22:09:00.902+0000 7f2ddb060640 -1 osd.1 0 log_to_monitors true 2024-09-15T22:09:01.140 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-09-15T22:09:01.139+0000 7faba4ce6640 -1 osd.6 0 log_to_monitors true 2024-09-15T22:09:01.192 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-15T22:09:01.190+0000 7fee5dfa4640 -1 osd.0 0 log_to_monitors true 2024-09-15T22:09:01.350 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-09-15T22:09:01.349+0000 7fdc2e958640 -1 osd.4 0 log_to_monitors true 2024-09-15T22:09:01.442 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-09-15T22:09:01.440+0000 7fe743e83640 -1 osd.5 0 log_to_monitors true 2024-09-15T22:09:01.450 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-15T22:09:01.448+0000 7f4b9ee20640 -1 osd.3 0 log_to_monitors true 2024-09-15T22:09:01.636 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-15T22:09:01.634+0000 7f21b1215640 -1 osd.2 0 log_to_monitors true 2024-09-15T22:09:01.685 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-09-15T22:09:01.683+0000 7fd011411640 -1 osd.7 0 log_to_monitors true 2024-09-15T22:09:02.530 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-15T22:09:02.529+0000 7f2dd6fef640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T22:09:02.545 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-15T22:09:02.543+0000 7f2dcee0f640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:09:03.828 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-15T22:09:03.826+0000 7f4b9a711640 -1 osd.3 0 waiting for initial osdmap 2024-09-15T22:09:03.837 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-15T22:09:03.836+0000 7f4b92531640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:09:03.860 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-15T22:09:03.858+0000 7f21acaf5640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T22:09:03.865 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-15T22:09:03.864+0000 7fee59f33640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T22:09:03.868 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-15T22:09:03.867+0000 7f21a4915640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:09:03.877 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-15T22:09:03.875+0000 7fee51d53640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:09:03.890 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T22:09:03.981 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.979+0000 7f25803cf640 1 Processor -- start 2024-09-15T22:09:03.981 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.979+0000 7f25803cf640 1 -- start start 2024-09-15T22:09:03.983 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f25803cf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2578141750 0x7f2578141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:03.983 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f25803cf640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2578150300 0x7f25781526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:03.983 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f25803cf640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25780b68c0 con 0x7f25780b75a0 2024-09-15T22:09:03.983 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f25803cf640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f2578142100 con 0x7f2578141750 2024-09-15T22:09:03.983 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f25803cf640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f25780b7980 con 0x7f2578150300 2024-09-15T22:09:03.983 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f257d96a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2578141750 0x7f2578141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:03.983 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f257d96a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2578141750 0x7f2578141bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59110/0 (socket says 172.21.15.78:59110) 2024-09-15T22:09:03.983 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f257e16b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f25780b75a0 0x7f25780b96b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43798/0 (socket says 172.21.15.78:43798) 2024-09-15T22:09:03.983 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f257d96a640 1 -- 172.21.15.78:0/1235766658 learned_addr learned my addr 172.21.15.78:0/1235766658 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:03.983 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f257e96c640 1 --2- 172.21.15.78:0/1235766658 >> v2:172.21.15.175:3300/0 conn(0x7f2578150300 0x7f25781526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:03.983 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f257d96a640 1 -- 172.21.15.78:0/1235766658 >> v2:172.21.15.175:3300/0 conn(0x7f2578150300 msgr2=0x7f25781526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:03.983 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f257d96a640 1 --2- 172.21.15.78:0/1235766658 >> v2:172.21.15.175:3300/0 conn(0x7f2578150300 0x7f25781526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.984 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f257d96a640 1 -- 172.21.15.78:0/1235766658 >> v1:172.21.15.78:6789/0 conn(0x7f25780b75a0 legacy=0x7f25780b96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:03.984 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f257d169640 1 -- 172.21.15.78:0/1235766658 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 435892191 0 0) 0x7f25780b68c0 con 0x7f25780b75a0 2024-09-15T22:09:03.984 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f257d96a640 1 -- 172.21.15.78:0/1235766658 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25780b6b30 con 0x7f2578141750 2024-09-15T22:09:03.984 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.980+0000 7f257e96c640 1 --2- 172.21.15.78:0/1235766658 >> v2:172.21.15.175:3300/0 conn(0x7f2578150300 0x7f25781526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:03.984 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.981+0000 7f257d96a640 1 --2- 172.21.15.78:0/1235766658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578141750 0x7f2578141bc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f25780b9120 tx=0x7f256802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf33e3d2d2bf233 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:03.984 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.981+0000 7f257d169640 1 -- 172.21.15.78:0/1235766658 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2568037070 con 0x7f2578141750 2024-09-15T22:09:03.984 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.981+0000 7f257d169640 1 -- 172.21.15.78:0/1235766658 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2568032440 con 0x7f2578141750 2024-09-15T22:09:03.984 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.981+0000 7f257d169640 1 -- 172.21.15.78:0/1235766658 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2568032810 con 0x7f2578141750 2024-09-15T22:09:03.985 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-09-15T22:09:03.982+0000 7faba0c75640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T22:09:03.987 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.981+0000 7f25803cf640 1 -- 172.21.15.78:0/1235766658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578141750 msgr2=0x7f2578141bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:03.987 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.981+0000 7f25803cf640 1 --2- 172.21.15.78:0/1235766658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578141750 0x7f2578141bc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f25780b9120 tx=0x7f256802a1e0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.987 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.981+0000 7f25803cf640 1 -- 172.21.15.78:0/1235766658 shutdown_connections 2024-09-15T22:09:03.987 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.982+0000 7f25803cf640 1 --2- 172.21.15.78:0/1235766658 >> v2:172.21.15.175:3300/0 conn(0x7f2578150300 0x7f25781526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.987 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.982+0000 7f25803cf640 1 --2- 172.21.15.78:0/1235766658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578141750 0x7f2578141bc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.987 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.982+0000 7f25803cf640 1 -- 172.21.15.78:0/1235766658 >> 172.21.15.78:0/1235766658 conn(0x7f257806ea40 msgr2=0x7f25780bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:03.987 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.982+0000 7f25803cf640 1 -- 172.21.15.78:0/1235766658 shutdown_connections 2024-09-15T22:09:03.987 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.982+0000 7f25803cf640 1 -- 172.21.15.78:0/1235766658 wait complete. 2024-09-15T22:09:03.987 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.983+0000 7f25803cf640 1 Processor -- start 2024-09-15T22:09:03.987 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.983+0000 7f25803cf640 1 -- start start 2024-09-15T22:09:03.987 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.983+0000 7f25803cf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25780b75a0 0x7f25781407b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:03.987 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.983+0000 7f25803cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578141750 0x7f2578142280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:03.987 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.983+0000 7f25803cf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2578150300 0x7f25781e0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:03.988 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.983+0000 7f25803cf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f25780ba310 con 0x7f2578141750 2024-09-15T22:09:03.988 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.983+0000 7f25803cf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25780ba030 con 0x7f25780b75a0 2024-09-15T22:09:03.988 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.983+0000 7f25803cf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f25780ba5f0 con 0x7f2578150300 2024-09-15T22:09:03.988 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.983+0000 7f257d96a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578141750 0x7f2578142280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:03.988 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.983+0000 7f257d96a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578141750 0x7f2578142280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59120/0 (socket says 172.21.15.78:59120) 2024-09-15T22:09:03.988 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.984+0000 7f257d96a640 1 -- 172.21.15.78:0/520415832 learned_addr learned my addr 172.21.15.78:0/520415832 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:03.988 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.984+0000 7f257e16b640 1 --2- 172.21.15.78:0/520415832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25780b75a0 0x7f25781407b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:03.988 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.984+0000 7f257d96a640 1 -- 172.21.15.78:0/520415832 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2578150300 msgr2=0x7f25781e0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:03.988 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.984+0000 7f257d96a640 1 --2- 172.21.15.78:0/520415832 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2578150300 0x7f25781e0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.988 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.984+0000 7f257d96a640 1 -- 172.21.15.78:0/520415832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25780b75a0 msgr2=0x7f25781407b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:03.988 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.984+0000 7f257d96a640 1 --2- 172.21.15.78:0/520415832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25780b75a0 0x7f25781407b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.989 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.984+0000 7f257d96a640 1 -- 172.21.15.78:0/520415832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2578143150 con 0x7f2578141750 2024-09-15T22:09:03.989 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.984+0000 7f257d96a640 1 --2- 172.21.15.78:0/520415832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578141750 0x7f2578142280 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2568000c00 tx=0x7f25680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:03.991 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.986+0000 7f256effd640 1 -- 172.21.15.78:0/520415832 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2568041020 con 0x7f2578141750 2024-09-15T22:09:03.991 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.986+0000 7f25803cf640 1 -- 172.21.15.78:0/520415832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2578143430 con 0x7f2578141750 2024-09-15T22:09:03.991 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.986+0000 7f256effd640 1 -- 172.21.15.78:0/520415832 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25680306c0 con 0x7f2578141750 2024-09-15T22:09:03.991 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.986+0000 7f256effd640 1 -- 172.21.15.78:0/520415832 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2568037040 con 0x7f2578141750 2024-09-15T22:09:03.991 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.986+0000 7f25803cf640 1 -- 172.21.15.78:0/520415832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f257813f240 con 0x7f2578141750 2024-09-15T22:09:03.991 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.987+0000 7f25803cf640 1 -- 172.21.15.78:0/520415832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2578142f40 con 0x7f2578141750 2024-09-15T22:09:03.991 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.988+0000 7f256effd640 1 -- 172.21.15.78:0/520415832 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) ==== 90790+0+0 (secure 0 0 0) 0x7f2568044020 con 0x7f2578141750 2024-09-15T22:09:03.991 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.988+0000 7f256effd640 1 --2- 172.21.15.78:0/520415832 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f255c06c220 0x7f255c06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:03.991 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.988+0000 7f257e16b640 1 --2- 172.21.15.78:0/520415832 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f255c06c220 0x7f255c06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:03.991 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.989+0000 7f256effd640 1 -- 172.21.15.78:0/520415832 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7f25680aafa0 con 0x7f2578141750 2024-09-15T22:09:03.991 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.989+0000 7f257e16b640 1 --2- 172.21.15.78:0/520415832 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f255c06c220 0x7f255c06e6e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2574000f60 tx=0x7f2574007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:03.992 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-09-15T22:09:03.991+0000 7fe73fe12640 -1 osd.5 0 waiting for initial osdmap 2024-09-15T22:09:03.995 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:03.994+0000 7f256effd640 1 -- 172.21.15.78:0/520415832 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f256804b030 con 0x7f2578141750 2024-09-15T22:09:04.000 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-09-15T22:09:03.999+0000 7fdc2a8e7640 -1 osd.4 0 waiting for initial osdmap 2024-09-15T22:09:04.000 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-09-15T22:09:03.999+0000 7fab98a95640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:09:04.007 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-09-15T22:09:04.006+0000 7fdc22707640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:09:04.007 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-09-15T22:09:04.006+0000 7fe737c32640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:09:04.013 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-09-15T22:09:04.012+0000 7fd00cced640 -1 osd.7 0 waiting for initial osdmap 2024-09-15T22:09:04.026 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-09-15T22:09:04.025+0000 7fd004b0d640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:09:04.163 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:04.162+0000 7f25803cf640 1 -- 172.21.15.78:0/520415832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25780b7f90 con 0x7f2578141750 2024-09-15T22:09:04.164 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:04.162+0000 7f256effd640 1 -- 172.21.15.78:0/520415832 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7555 (secure 0 0 0) 0x7f256807a3f0 con 0x7f2578141750 2024-09-15T22:09:04.164 INFO:teuthology.misc.health.smithi078.stdout: 2024-09-15T22:09:04.164 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":13,"fsid":"34e44e87-1d1a-416f-b208-c16e07980ff5","created":"2024-09-15T22:08:53.842443+0000","modified":"2024-09-15T22:09:02.982845+0000","last_up_change":"2024-09-15T22:09:02.982845+0000","last_in_change":"2024-09-15T22:08:55.864039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"71eb9af6-bf66-4450-a5d1-d4a81f71f95b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f0070f6d-7998-4ad3-b597-e5777e61d503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6809","nonce":1233827941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6811","nonce":1233827941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6815","nonce":1233827941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6813","nonce":1233827941}]},"public_addr":"172.21.15.78:6809/1233827941","cluster_addr":"172.21.15.78:6811/1233827941","heartbeat_back_addr":"172.21.15.78:6815/1233827941","heartbeat_front_addr":"172.21.15.78:6813/1233827941","state":["exists","up"]},{"osd":2,"uuid":"6d9c91c7-2c8a-48f9-9bef-67ea7320980e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"943e38fb-b450-48c0-8f01-d381b0b8e313","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"259f50f8-3223-450d-8cd1-d0d333c278dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d70426cd-a39b-4a20-8c7b-bedc8352e303","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"95b9ed3a-cbfc-45a5-8967-88db9da099ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fc56286-91e9-4a13-b161-ad7d30fc0119","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:09:04.167 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:04.164+0000 7f25803cf640 1 -- 172.21.15.78:0/520415832 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f255c06c220 msgr2=0x7f255c06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:04.167 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:04.164+0000 7f25803cf640 1 --2- 172.21.15.78:0/520415832 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f255c06c220 0x7f255c06e6e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2574000f60 tx=0x7f2574007c00 comp rx=0 tx=0).stop 2024-09-15T22:09:04.167 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:04.164+0000 7f25803cf640 1 -- 172.21.15.78:0/520415832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578141750 msgr2=0x7f2578142280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:04.167 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:04.164+0000 7f25803cf640 1 --2- 172.21.15.78:0/520415832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578141750 0x7f2578142280 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2568000c00 tx=0x7f25680046c0 comp rx=0 tx=0).stop 2024-09-15T22:09:04.167 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:04.164+0000 7f25803cf640 1 -- 172.21.15.78:0/520415832 shutdown_connections 2024-09-15T22:09:04.167 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:04.164+0000 7f25803cf640 1 --2- 172.21.15.78:0/520415832 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f255c06c220 0x7f255c06e6e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:04.167 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:04.164+0000 7f25803cf640 1 --2- 172.21.15.78:0/520415832 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2578150300 0x7f25781e0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:04.167 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:04.164+0000 7f25803cf640 1 --2- 172.21.15.78:0/520415832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578141750 0x7f2578142280 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:04.167 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:04.164+0000 7f25803cf640 1 --2- 172.21.15.78:0/520415832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25780b75a0 0x7f25781407b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:04.167 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:04.164+0000 7f25803cf640 1 -- 172.21.15.78:0/520415832 >> 172.21.15.78:0/520415832 conn(0x7f257806ea40 msgr2=0x7f2578146a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:04.167 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:04.164+0000 7f25803cf640 1 -- 172.21.15.78:0/520415832 shutdown_connections 2024-09-15T22:09:04.167 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:04.164+0000 7f25803cf640 1 -- 172.21.15.78:0/520415832 wait complete. 2024-09-15T22:09:04.175 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-15T22:09:10.982 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T22:09:11.090 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.088+0000 7f1627a53640 1 Processor -- start 2024-09-15T22:09:11.090 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.088+0000 7f1627a53640 1 -- start start 2024-09-15T22:09:11.091 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.089+0000 7f1627a53640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1620072d60 0x7f16200b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:11.091 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.089+0000 7f1627a53640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1620073140 0x7f1620146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:11.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.089+0000 7f1627a53640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16200b5920 con 0x7f162013f3d0 2024-09-15T22:09:11.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.089+0000 7f1627a53640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f16200b4a50 con 0x7f1620072d60 2024-09-15T22:09:11.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.089+0000 7f1627a53640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f16200b2b10 con 0x7f1620073140 2024-09-15T22:09:11.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.089+0000 7f16257ef640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1620072d60 0x7f16200b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:11.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.089+0000 7f16257ef640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1620072d60 0x7f16200b52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42974/0 (socket says 172.21.15.78:42974) 2024-09-15T22:09:11.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.089+0000 7f16257ef640 1 -- 172.21.15.78:0/1023693137 learned_addr learned my addr 172.21.15.78:0/1023693137 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:11.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.090+0000 7f1624fee640 1 --2- 172.21.15.78:0/1023693137 >> v2:172.21.15.175:3300/0 conn(0x7f1620073140 0x7f1620146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:11.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.090+0000 7f16257ef640 1 -- 172.21.15.78:0/1023693137 >> v2:172.21.15.175:3300/0 conn(0x7f1620073140 msgr2=0x7f1620146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:11.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.090+0000 7f16257ef640 1 --2- 172.21.15.78:0/1023693137 >> v2:172.21.15.175:3300/0 conn(0x7f1620073140 0x7f1620146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.090+0000 7f16257ef640 1 -- 172.21.15.78:0/1023693137 >> v1:172.21.15.175:6789/0 conn(0x7f162013f3d0 legacy=0x7f1620148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:11.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.090+0000 7f16257ef640 1 -- 172.21.15.78:0/1023693137 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1620145860 con 0x7f1620072d60 2024-09-15T22:09:11.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.090+0000 7f1624fee640 1 --2- 172.21.15.78:0/1023693137 >> v2:172.21.15.175:3300/0 conn(0x7f1620073140 0x7f1620146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:11.094 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.090+0000 7f16257ef640 1 --2- 172.21.15.78:0/1023693137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1620072d60 0x7f16200b52d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f16200743f0 tx=0x7f161c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1207d8a4ba2162d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:11.094 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.091+0000 7f1617fff640 1 -- 172.21.15.78:0/1023693137 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c037070 con 0x7f1620072d60 2024-09-15T22:09:11.094 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.091+0000 7f1617fff640 1 -- 172.21.15.78:0/1023693137 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f161c032440 con 0x7f1620072d60 2024-09-15T22:09:11.094 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.091+0000 7f1617fff640 1 -- 172.21.15.78:0/1023693137 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c032810 con 0x7f1620072d60 2024-09-15T22:09:11.094 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.091+0000 7f1627a53640 1 -- 172.21.15.78:0/1023693137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1620072d60 msgr2=0x7f16200b52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:11.094 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.091+0000 7f1627a53640 1 --2- 172.21.15.78:0/1023693137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1620072d60 0x7f16200b52d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f16200743f0 tx=0x7f161c02a1c0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.094 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.091+0000 7f1627a53640 1 -- 172.21.15.78:0/1023693137 shutdown_connections 2024-09-15T22:09:11.094 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.091+0000 7f1627a53640 1 --2- 172.21.15.78:0/1023693137 >> v2:172.21.15.175:3300/0 conn(0x7f1620073140 0x7f1620146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.094 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.091+0000 7f1627a53640 1 --2- 172.21.15.78:0/1023693137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1620072d60 0x7f16200b52d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.094 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.091+0000 7f1627a53640 1 -- 172.21.15.78:0/1023693137 >> 172.21.15.78:0/1023693137 conn(0x7f1620075400 msgr2=0x7f16200bb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:11.094 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.091+0000 7f1627a53640 1 -- 172.21.15.78:0/1023693137 shutdown_connections 2024-09-15T22:09:11.094 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.091+0000 7f1627a53640 1 -- 172.21.15.78:0/1023693137 wait complete. 2024-09-15T22:09:11.097 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.093+0000 7f1627a53640 1 Processor -- start 2024-09-15T22:09:11.097 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.093+0000 7f1627a53640 1 -- start start 2024-09-15T22:09:11.097 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.093+0000 7f1627a53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1620072d60 0x7f16200b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:11.097 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.093+0000 7f1627a53640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1620073140 0x7f16201de180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:11.097 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.093+0000 7f1627a53640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162013f3d0 0x7f16201cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:11.097 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.093+0000 7f1627a53640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f16200714a0 con 0x7f1620072d60 2024-09-15T22:09:11.098 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.093+0000 7f1627a53640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f16201465a0 con 0x7f162013f3d0 2024-09-15T22:09:11.098 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.093+0000 7f1627a53640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1620071620 con 0x7f1620073140 2024-09-15T22:09:11.098 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.093+0000 7f16257ef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1620072d60 0x7f16200b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:11.098 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.093+0000 7f16257ef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1620072d60 0x7f16200b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42990/0 (socket says 172.21.15.78:42990) 2024-09-15T22:09:11.098 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.093+0000 7f16257ef640 1 -- 172.21.15.78:0/2363345798 learned_addr learned my addr 172.21.15.78:0/2363345798 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:11.098 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.093+0000 7f1625ff0640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162013f3d0 0x7f16201cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:11.098 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.093+0000 7f1624fee640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1620073140 0x7f16201de180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:11.098 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.094+0000 7f16257ef640 1 -- 172.21.15.78:0/2363345798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1620073140 msgr2=0x7f16201de180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:11.098 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.094+0000 7f16257ef640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1620073140 0x7f16201de180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.098 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.094+0000 7f16257ef640 1 -- 172.21.15.78:0/2363345798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162013f3d0 msgr2=0x7f16201cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:11.098 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.094+0000 7f16257ef640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162013f3d0 0x7f16201cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.098 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.094+0000 7f16257ef640 1 -- 172.21.15.78:0/2363345798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16201d0c10 con 0x7f1620072d60 2024-09-15T22:09:11.099 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.094+0000 7f1625ff0640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162013f3d0 0x7f16201cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:11.099 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.094+0000 7f1624fee640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1620073140 0x7f16201de180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:11.099 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.094+0000 7f16257ef640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1620072d60 0x7f16200b1d20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f161c000c00 tx=0x7f161c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:11.099 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.094+0000 7f1615ffb640 1 -- 172.21.15.78:0/2363345798 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c037040 con 0x7f1620072d60 2024-09-15T22:09:11.099 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.094+0000 7f1615ffb640 1 -- 172.21.15.78:0/2363345798 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f161c004230 con 0x7f1620072d60 2024-09-15T22:09:11.099 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.094+0000 7f1627a53640 1 -- 172.21.15.78:0/2363345798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1620139b10 con 0x7f1620072d60 2024-09-15T22:09:11.099 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.094+0000 7f1615ffb640 1 -- 172.21.15.78:0/2363345798 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c030620 con 0x7f1620072d60 2024-09-15T22:09:11.100 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.094+0000 7f1627a53640 1 -- 172.21.15.78:0/2363345798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f162013a6d0 con 0x7f1620072d60 2024-09-15T22:09:11.100 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.095+0000 7f1627a53640 1 -- 172.21.15.78:0/2363345798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1620146060 con 0x7f1620072d60 2024-09-15T22:09:11.100 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.096+0000 7f1615ffb640 1 -- 172.21.15.78:0/2363345798 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f161c0307c0 con 0x7f1620072d60 2024-09-15T22:09:11.101 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.096+0000 7f1615ffb640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f160406c2b0 0x7f160406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:11.101 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.096+0000 7f1615ffb640 1 -- 172.21.15.78:0/2363345798 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f161c0abed0 con 0x7f1620072d60 2024-09-15T22:09:11.101 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.096+0000 7f1624fee640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f160406c2b0 0x7f160406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:11.101 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.097+0000 7f1624fee640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f160406c2b0 0x7f160406e770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f162013ecf0 tx=0x7f1610008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:11.103 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.101+0000 7f1615ffb640 1 -- 172.21.15.78:0/2363345798 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f161c07aa20 con 0x7f1620072d60 2024-09-15T22:09:11.270 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.269+0000 7f1627a53640 1 -- 172.21.15.78:0/2363345798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1620073d90 con 0x7f1620072d60 2024-09-15T22:09:11.271 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.270+0000 7f1615ffb640 1 -- 172.21.15.78:0/2363345798 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12908 (secure 0 0 0) 0x7f161c07a320 con 0x7f1620072d60 2024-09-15T22:09:11.272 INFO:teuthology.misc.health.smithi078.stdout: 2024-09-15T22:09:11.272 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":17,"fsid":"34e44e87-1d1a-416f-b208-c16e07980ff5","created":"2024-09-15T22:08:53.842443+0000","modified":"2024-09-15T22:09:08.021396+0000","last_up_change":"2024-09-15T22:09:04.830042+0000","last_in_change":"2024-09-15T22:08:55.864039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:05.999373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71eb9af6-bf66-4450-a5d1-d4a81f71f95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6817","nonce":3548923409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6819","nonce":3548923409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6823","nonce":3548923409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6821","nonce":3548923409}]},"public_addr":"172.21.15.78:6817/3548923409","cluster_addr":"172.21.15.78:6819/3548923409","heartbeat_back_addr":"172.21.15.78:6823/3548923409","heartbeat_front_addr":"172.21.15.78:6821/3548923409","state":["exists","up"]},{"osd":1,"uuid":"f0070f6d-7998-4ad3-b597-e5777e61d503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6809","nonce":1233827941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6811","nonce":1233827941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6815","nonce":1233827941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6813","nonce":1233827941}]},"public_addr":"172.21.15.78:6809/1233827941","cluster_addr":"172.21.15.78:6811/1233827941","heartbeat_back_addr":"172.21.15.78:6815/1233827941","heartbeat_front_addr":"172.21.15.78:6813/1233827941","state":["exists","up"]},{"osd":2,"uuid":"6d9c91c7-2c8a-48f9-9bef-67ea7320980e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6825","nonce":636523247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6827","nonce":636523247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6831","nonce":636523247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6829","nonce":636523247}]},"public_addr":"172.21.15.78:6825/636523247","cluster_addr":"172.21.15.78:6827/636523247","heartbeat_back_addr":"172.21.15.78:6831/636523247","heartbeat_front_addr":"172.21.15.78:6829/636523247","state":["exists","up"]},{"osd":3,"uuid":"943e38fb-b450-48c0-8f01-d381b0b8e313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6801","nonce":1841812488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6803","nonce":1841812488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6807","nonce":1841812488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6805","nonce":1841812488}]},"public_addr":"172.21.15.78:6801/1841812488","cluster_addr":"172.21.15.78:6803/1841812488","heartbeat_back_addr":"172.21.15.78:6807/1841812488","heartbeat_front_addr":"172.21.15.78:6805/1841812488","state":["exists","up"]},{"osd":4,"uuid":"259f50f8-3223-450d-8cd1-d0d333c278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6817","nonce":1803357070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6819","nonce":1803357070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6823","nonce":1803357070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6821","nonce":1803357070}]},"public_addr":"172.21.15.175:6817/1803357070","cluster_addr":"172.21.15.175:6819/1803357070","heartbeat_back_addr":"172.21.15.175:6823/1803357070","heartbeat_front_addr":"172.21.15.175:6821/1803357070","state":["exists","up"]},{"osd":5,"uuid":"d70426cd-a39b-4a20-8c7b-bedc8352e303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6825","nonce":2221415707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6827","nonce":2221415707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6831","nonce":2221415707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6829","nonce":2221415707}]},"public_addr":"172.21.15.175:6825/2221415707","cluster_addr":"172.21.15.175:6827/2221415707","heartbeat_back_addr":"172.21.15.175:6831/2221415707","heartbeat_front_addr":"172.21.15.175:6829/2221415707","state":["exists","up"]},{"osd":6,"uuid":"95b9ed3a-cbfc-45a5-8967-88db9da099ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6801","nonce":1974018373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6803","nonce":1974018373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6807","nonce":1974018373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6805","nonce":1974018373}]},"public_addr":"172.21.15.175:6801/1974018373","cluster_addr":"172.21.15.175:6803/1974018373","heartbeat_back_addr":"172.21.15.175:6807/1974018373","heartbeat_front_addr":"172.21.15.175:6805/1974018373","state":["exists","up"]},{"osd":7,"uuid":"5fc56286-91e9-4a13-b161-ad7d30fc0119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6809","nonce":2386415083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6811","nonce":2386415083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6815","nonce":2386415083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6813","nonce":2386415083}]},"public_addr":"172.21.15.175:6809/2386415083","cluster_addr":"172.21.15.175:6811/2386415083","heartbeat_back_addr":"172.21.15.175:6815/2386415083","heartbeat_front_addr":"172.21.15.175:6813/2386415083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.191845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.871482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.594323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.463568+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.398880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.490112+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.119097+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.677350+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:09:11.274 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.272+0000 7f1627a53640 1 -- 172.21.15.78:0/2363345798 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f160406c2b0 msgr2=0x7f160406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:11.274 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.272+0000 7f1627a53640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f160406c2b0 0x7f160406e770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f162013ecf0 tx=0x7f1610008040 comp rx=0 tx=0).stop 2024-09-15T22:09:11.274 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.272+0000 7f1627a53640 1 -- 172.21.15.78:0/2363345798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1620072d60 msgr2=0x7f16200b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:11.274 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.272+0000 7f1627a53640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1620072d60 0x7f16200b1d20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f161c000c00 tx=0x7f161c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.274 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.272+0000 7f1627a53640 1 -- 172.21.15.78:0/2363345798 shutdown_connections 2024-09-15T22:09:11.274 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.272+0000 7f1627a53640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f160406c2b0 0x7f160406e770 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.274 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.272+0000 7f1627a53640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162013f3d0 0x7f16201cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.274 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.272+0000 7f1627a53640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1620073140 0x7f16201de180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.274 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.272+0000 7f1627a53640 1 --2- 172.21.15.78:0/2363345798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1620072d60 0x7f16200b1d20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.274 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.272+0000 7f1627a53640 1 -- 172.21.15.78:0/2363345798 >> 172.21.15.78:0/2363345798 conn(0x7f1620075400 msgr2=0x7f16200b7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:11.275 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.272+0000 7f1627a53640 1 -- 172.21.15.78:0/2363345798 shutdown_connections 2024-09-15T22:09:11.275 INFO:teuthology.misc.health.smithi078.stderr:2024-09-15T22:09:11.272+0000 7f1627a53640 1 -- 172.21.15.78:0/2363345798 wait complete. 2024-09-15T22:09:11.283 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-15T22:09:11.283 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-15T22:09:11.283 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:09:11.283 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:09:11.285 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:09:11.285 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:09:11.286 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:09:11.288 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:09:11.288 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-15T22:09:11.289 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:09:11.360 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-09-15T22:09:11.371 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2024-09-15T22:09:11.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.387+0000 7f6e96366640 1 Processor -- start 2024-09-15T22:09:11.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.387+0000 7f6e96366640 1 -- start start 2024-09-15T22:09:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.387+0000 7f6e96366640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e900b6110 0x7f6e900b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.387+0000 7f6e96366640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e90144db0 0x7f6e9014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.387+0000 7f6e96366640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e90075950 con 0x7f6e90145200 2024-09-15T22:09:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.387+0000 7f6e96366640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f6e900750b0 con 0x7f6e900b6110 2024-09-15T22:09:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.387+0000 7f6e96366640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f6e90075390 con 0x7f6e90144db0 2024-09-15T22:09:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.388+0000 7f6e8ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e900b6110 0x7f6e900b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.388+0000 7f6e8ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e900b6110 0x7f6e900b64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43022/0 (socket says 172.21.15.78:43022) 2024-09-15T22:09:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.388+0000 7f6e94903640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6e90145200 0x7f6e9009be20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43880/0 (socket says 172.21.15.78:43880) 2024-09-15T22:09:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.388+0000 7f6e8ffff640 1 -- 172.21.15.78:0/1835006582 learned_addr learned my addr 172.21.15.78:0/1835006582 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.388+0000 7f6e87fff640 1 --2- 172.21.15.78:0/1835006582 >> v2:172.21.15.175:3300/0 conn(0x7f6e90144db0 0x7f6e9014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.388+0000 7f6e8ffff640 1 -- 172.21.15.78:0/1835006582 >> v2:172.21.15.175:3300/0 conn(0x7f6e90144db0 msgr2=0x7f6e9014b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.388+0000 7f6e8ffff640 1 --2- 172.21.15.78:0/1835006582 >> v2:172.21.15.175:3300/0 conn(0x7f6e90144db0 0x7f6e9014b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.388+0000 7f6e8ffff640 1 -- 172.21.15.78:0/1835006582 >> v1:172.21.15.78:6789/0 conn(0x7f6e90145200 legacy=0x7f6e9009be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:11.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.388+0000 7f6e8f7fe640 1 -- 172.21.15.78:0/1835006582 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3533743504 0 0) 0x7f6e90075950 con 0x7f6e90145200 2024-09-15T22:09:11.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.388+0000 7f6e8ffff640 1 -- 172.21.15.78:0/1835006582 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e90075670 con 0x7f6e900b6110 2024-09-15T22:09:11.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.389+0000 7f6e8ffff640 1 --2- 172.21.15.78:0/1835006582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e900b6110 0x7f6e900b64f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e900b5550 tx=0x7f6e8002a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f5c85b68952357 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:11.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.389+0000 7f6e8f7fe640 1 -- 172.21.15.78:0/1835006582 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80037070 con 0x7f6e900b6110 2024-09-15T22:09:11.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.389+0000 7f6e8f7fe640 1 -- 172.21.15.78:0/1835006582 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e80032440 con 0x7f6e900b6110 2024-09-15T22:09:11.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.389+0000 7f6e8f7fe640 1 -- 172.21.15.78:0/1835006582 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80032810 con 0x7f6e900b6110 2024-09-15T22:09:11.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.389+0000 7f6e96366640 1 -- 172.21.15.78:0/1835006582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e900b6110 msgr2=0x7f6e900b64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:11.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.389+0000 7f6e96366640 1 --2- 172.21.15.78:0/1835006582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e900b6110 0x7f6e900b64f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e900b5550 tx=0x7f6e8002a150 comp rx=0 tx=0).stop 2024-09-15T22:09:11.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.389+0000 7f6e96366640 1 -- 172.21.15.78:0/1835006582 shutdown_connections 2024-09-15T22:09:11.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.389+0000 7f6e96366640 1 --2- 172.21.15.78:0/1835006582 >> v2:172.21.15.175:3300/0 conn(0x7f6e90144db0 0x7f6e9014b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.389+0000 7f6e96366640 1 --2- 172.21.15.78:0/1835006582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e900b6110 0x7f6e900b64f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.389+0000 7f6e96366640 1 -- 172.21.15.78:0/1835006582 >> 172.21.15.78:0/1835006582 conn(0x7f6e900ba2d0 msgr2=0x7f6e900ba6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:11.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.389+0000 7f6e96366640 1 -- 172.21.15.78:0/1835006582 shutdown_connections 2024-09-15T22:09:11.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.389+0000 7f6e96366640 1 -- 172.21.15.78:0/1835006582 wait complete. 2024-09-15T22:09:11.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.390+0000 7f6e96366640 1 Processor -- start 2024-09-15T22:09:11.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.390+0000 7f6e96366640 1 -- start start 2024-09-15T22:09:11.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e96366640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e900b6110 0x7f6e900b98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:11.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e96366640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e90144db0 0x7f6e901e0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:11.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e96366640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e90145200 0x7f6e90142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:11.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e96366640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9014b830 con 0x7f6e90144db0 2024-09-15T22:09:11.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e96366640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e900badf0 con 0x7f6e90145200 2024-09-15T22:09:11.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e96366640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9014b9b0 con 0x7f6e900b6110 2024-09-15T22:09:11.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e87fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e90144db0 0x7f6e901e0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:11.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e87fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e90144db0 0x7f6e901e0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43034/0 (socket says 172.21.15.78:43034) 2024-09-15T22:09:11.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e87fff640 1 -- 172.21.15.78:0/2814187387 learned_addr learned my addr 172.21.15.78:0/2814187387 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:11.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e94903640 1 --2- 172.21.15.78:0/2814187387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e90145200 0x7f6e90142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:11.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e8ffff640 1 --2- 172.21.15.78:0/2814187387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e900b6110 0x7f6e900b98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:11.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e87fff640 1 -- 172.21.15.78:0/2814187387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e900b6110 msgr2=0x7f6e900b98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:11.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e87fff640 1 --2- 172.21.15.78:0/2814187387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e900b6110 0x7f6e900b98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e87fff640 1 -- 172.21.15.78:0/2814187387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e90145200 msgr2=0x7f6e90142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:11.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e87fff640 1 --2- 172.21.15.78:0/2814187387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e90145200 0x7f6e90142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e87fff640 1 -- 172.21.15.78:0/2814187387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e901d1340 con 0x7f6e90144db0 2024-09-15T22:09:11.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.391+0000 7f6e8ffff640 1 --2- 172.21.15.78:0/2814187387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e900b6110 0x7f6e900b98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:11.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.392+0000 7f6e87fff640 1 --2- 172.21.15.78:0/2814187387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e90144db0 0x7f6e901e0a20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800e9e0 tx=0x7f6e7800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:11.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.392+0000 7f6e8d7fa640 1 -- 172.21.15.78:0/2814187387 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78017070 con 0x7f6e90144db0 2024-09-15T22:09:11.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.392+0000 7f6e8d7fa640 1 -- 172.21.15.78:0/2814187387 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7800c9d0 con 0x7f6e90144db0 2024-09-15T22:09:11.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.392+0000 7f6e96366640 1 -- 172.21.15.78:0/2814187387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e901d1620 con 0x7f6e90144db0 2024-09-15T22:09:11.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.392+0000 7f6e8d7fa640 1 -- 172.21.15.78:0/2814187387 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800cdc0 con 0x7f6e90144db0 2024-09-15T22:09:11.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.392+0000 7f6e96366640 1 -- 172.21.15.78:0/2814187387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e90148d10 con 0x7f6e90144db0 2024-09-15T22:09:11.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.393+0000 7f6e96366640 1 -- 172.21.15.78:0/2814187387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e900742c0 con 0x7f6e90144db0 2024-09-15T22:09:11.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.393+0000 7f6e8d7fa640 1 -- 172.21.15.78:0/2814187387 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6e7801a070 con 0x7f6e90144db0 2024-09-15T22:09:11.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.394+0000 7f6e8d7fa640 1 --2- 172.21.15.78:0/2814187387 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f6e7006c2b0 0x7f6e7006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:11.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.394+0000 7f6e8ffff640 1 --2- 172.21.15.78:0/2814187387 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f6e7006c2b0 0x7f6e7006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:11.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.394+0000 7f6e8d7fa640 1 -- 172.21.15.78:0/2814187387 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f6e7808b370 con 0x7f6e90144db0 2024-09-15T22:09:11.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.394+0000 7f6e8ffff640 1 --2- 172.21.15.78:0/2814187387 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f6e7006c2b0 0x7f6e7006e770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6e80034000 tx=0x7f6e8002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:11.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.398+0000 7f6e8d7fa640 1 -- 172.21.15.78:0/2814187387 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e900742c0 con 0x7f6e90144db0 2024-09-15T22:09:11.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.597+0000 7f6e96366640 1 -- 172.21.15.78:0/2814187387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e9014b2f0 con 0x7f6e90144db0 2024-09-15T22:09:11.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.598+0000 7f6e8d7fa640 1 -- 172.21.15.78:0/2814187387 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f6e78059870 con 0x7f6e90144db0 2024-09-15T22:09:11.600 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:11.600 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":2,"btime":"2024-09-15T22:09:11:363010+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1036052633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1036052633},{"type":"v1","addr":"172.21.15.78:6835","nonce":1036052633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:09:11.600 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 2 2024-09-15T22:09:11.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.600+0000 7f6e96366640 1 -- 172.21.15.78:0/2814187387 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f6e7006c2b0 msgr2=0x7f6e7006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:11.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.600+0000 7f6e96366640 1 --2- 172.21.15.78:0/2814187387 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f6e7006c2b0 0x7f6e7006e770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6e80034000 tx=0x7f6e8002e000 comp rx=0 tx=0).stop 2024-09-15T22:09:11.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.600+0000 7f6e96366640 1 -- 172.21.15.78:0/2814187387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e90144db0 msgr2=0x7f6e901e0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:11.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.600+0000 7f6e96366640 1 --2- 172.21.15.78:0/2814187387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e90144db0 0x7f6e901e0a20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800e9e0 tx=0x7f6e7800eea0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.600+0000 7f6e96366640 1 -- 172.21.15.78:0/2814187387 shutdown_connections 2024-09-15T22:09:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.600+0000 7f6e96366640 1 --2- 172.21.15.78:0/2814187387 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f6e7006c2b0 0x7f6e7006e770 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.600+0000 7f6e96366640 1 --2- 172.21.15.78:0/2814187387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e90145200 0x7f6e90142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.600+0000 7f6e96366640 1 --2- 172.21.15.78:0/2814187387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e90144db0 0x7f6e901e0a20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.600+0000 7f6e96366640 1 --2- 172.21.15.78:0/2814187387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e900b6110 0x7f6e900b98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.600+0000 7f6e96366640 1 -- 172.21.15.78:0/2814187387 >> 172.21.15.78:0/2814187387 conn(0x7f6e900ba2d0 msgr2=0x7f6e9006df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.600+0000 7f6e96366640 1 -- 172.21.15.78:0/2814187387 shutdown_connections 2024-09-15T22:09:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:11.600+0000 7f6e96366640 1 -- 172.21.15.78:0/2814187387 wait complete. 2024-09-15T22:09:13.613 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:09:13.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.719+0000 7f30329c0640 1 Processor -- start 2024-09-15T22:09:13.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.719+0000 7f30329c0640 1 -- start start 2024-09-15T22:09:13.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.720+0000 7f30329c0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f302c144b40 0x7f302c144f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.720+0000 7f30329c0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f302c1503c0 0x7f302c1527b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.720+0000 7f30329c0640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f302c0af8f0 con 0x7f302c0630c0 2024-09-15T22:09:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.720+0000 7f30329c0640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f302c0af460 con 0x7f302c1503c0 2024-09-15T22:09:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.720+0000 7f30329c0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f302c0634a0 con 0x7f302c144b40 2024-09-15T22:09:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.720+0000 7f3030f5d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f302c1503c0 0x7f302c1527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.720+0000 7f302bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f302c0630c0 0x7f302c0b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43888/0 (socket says 172.21.15.78:43888) 2024-09-15T22:09:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.720+0000 7f302bfff640 1 -- 172.21.15.78:0/2336746027 learned_addr learned my addr 172.21.15.78:0/2336746027 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.720+0000 7f302b7fe640 1 --2- 172.21.15.78:0/2336746027 >> v2:172.21.15.175:3300/0 conn(0x7f302c144b40 0x7f302c144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.721+0000 7f3030f5d640 1 -- 172.21.15.78:0/2336746027 >> v2:172.21.15.175:3300/0 conn(0x7f302c144b40 msgr2=0x7f302c144f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.721+0000 7f3030f5d640 1 --2- 172.21.15.78:0/2336746027 >> v2:172.21.15.175:3300/0 conn(0x7f302c144b40 0x7f302c144f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.721+0000 7f3030f5d640 1 -- 172.21.15.78:0/2336746027 >> v1:172.21.15.78:6789/0 conn(0x7f302c0630c0 legacy=0x7f302c0b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.721+0000 7f3030f5d640 1 -- 172.21.15.78:0/2336746027 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302c0b05d0 con 0x7f302c1503c0 2024-09-15T22:09:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.721+0000 7f302affd640 1 -- 172.21.15.78:0/2336746027 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3775486007 0 0) 0x7f302c0af8f0 con 0x7f302c0630c0 2024-09-15T22:09:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.721+0000 7f3030f5d640 1 --2- 172.21.15.78:0/2336746027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c1503c0 0x7f302c1527b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f302c0b60d0 tx=0x7f302402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0782ab1e0b4d7e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.721+0000 7f302affd640 1 -- 172.21.15.78:0/2336746027 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024007740 con 0x7f302c1503c0 2024-09-15T22:09:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.721+0000 7f302affd640 1 -- 172.21.15.78:0/2336746027 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30240078e0 con 0x7f302c1503c0 2024-09-15T22:09:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.721+0000 7f302affd640 1 -- 172.21.15.78:0/2336746027 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024007cb0 con 0x7f302c1503c0 2024-09-15T22:09:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.722+0000 7f30329c0640 1 -- 172.21.15.78:0/2336746027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c1503c0 msgr2=0x7f302c1527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.722+0000 7f30329c0640 1 --2- 172.21.15.78:0/2336746027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c1503c0 0x7f302c1527b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f302c0b60d0 tx=0x7f302402a5f0 comp rx=0 tx=0).stop 2024-09-15T22:09:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.722+0000 7f30329c0640 1 -- 172.21.15.78:0/2336746027 shutdown_connections 2024-09-15T22:09:13.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.722+0000 7f30329c0640 1 --2- 172.21.15.78:0/2336746027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c1503c0 0x7f302c1527b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:13.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.722+0000 7f30329c0640 1 --2- 172.21.15.78:0/2336746027 >> v2:172.21.15.175:3300/0 conn(0x7f302c144b40 0x7f302c144f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:13.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.722+0000 7f30329c0640 1 -- 172.21.15.78:0/2336746027 >> 172.21.15.78:0/2336746027 conn(0x7f302c0ba2d0 msgr2=0x7f302c0b6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:13.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.722+0000 7f30329c0640 1 -- 172.21.15.78:0/2336746027 shutdown_connections 2024-09-15T22:09:13.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.722+0000 7f30329c0640 1 -- 172.21.15.78:0/2336746027 wait complete. 2024-09-15T22:09:13.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.723+0000 7f30329c0640 1 Processor -- start 2024-09-15T22:09:13.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.723+0000 7f30329c0640 1 -- start start 2024-09-15T22:09:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f30329c0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c0630c0 0x7f302c1e0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:13.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f30329c0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f302c144b40 0x7f302c06fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:13.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f30329c0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f302c1503c0 0x7f302c13aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:13.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f30329c0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f302c0b6200 con 0x7f302c0630c0 2024-09-15T22:09:13.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f30329c0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f302c0af0f0 con 0x7f302c144b40 2024-09-15T22:09:13.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f30329c0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f302c1454d0 con 0x7f302c1503c0 2024-09-15T22:09:13.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f302bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c0630c0 0x7f302c1e0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:13.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f302bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c0630c0 0x7f302c1e0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43050/0 (socket says 172.21.15.78:43050) 2024-09-15T22:09:13.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f302bfff640 1 -- 172.21.15.78:0/2733999473 learned_addr learned my addr 172.21.15.78:0/2733999473 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:13.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f302b7fe640 1 --2- 172.21.15.78:0/2733999473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f302c144b40 0x7f302c06fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:13.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f3030f5d640 1 --2- 172.21.15.78:0/2733999473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f302c1503c0 0x7f302c13aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:13.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f302bfff640 1 -- 172.21.15.78:0/2733999473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f302c1503c0 msgr2=0x7f302c13aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:13.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f302bfff640 1 --2- 172.21.15.78:0/2733999473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f302c1503c0 0x7f302c13aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:13.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f302bfff640 1 -- 172.21.15.78:0/2733999473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f302c144b40 msgr2=0x7f302c06fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:13.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f302bfff640 1 --2- 172.21.15.78:0/2733999473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f302c144b40 0x7f302c06fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:13.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f302bfff640 1 -- 172.21.15.78:0/2733999473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302c0723a0 con 0x7f302c0630c0 2024-09-15T22:09:13.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f302b7fe640 1 --2- 172.21.15.78:0/2733999473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f302c144b40 0x7f302c06fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:13.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.724+0000 7f302bfff640 1 --2- 172.21.15.78:0/2733999473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c0630c0 0x7f302c1e0b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c4d0 tx=0x7f301c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:13.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.725+0000 7f3028ff9640 1 -- 172.21.15.78:0/2733999473 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c018070 con 0x7f302c0630c0 2024-09-15T22:09:13.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.725+0000 7f3028ff9640 1 -- 172.21.15.78:0/2733999473 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f301c007500 con 0x7f302c0630c0 2024-09-15T22:09:13.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.725+0000 7f3028ff9640 1 -- 172.21.15.78:0/2733999473 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c004a20 con 0x7f302c0630c0 2024-09-15T22:09:13.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.725+0000 7f30329c0640 1 -- 172.21.15.78:0/2733999473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302c0b2e80 con 0x7f302c0630c0 2024-09-15T22:09:13.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.725+0000 7f30329c0640 1 -- 172.21.15.78:0/2733999473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f302c0701f0 con 0x7f302c0630c0 2024-09-15T22:09:13.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.726+0000 7f30329c0640 1 -- 172.21.15.78:0/2733999473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f302c073600 con 0x7f302c0630c0 2024-09-15T22:09:13.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.726+0000 7f3028ff9640 1 -- 172.21.15.78:0/2733999473 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f301c01b070 con 0x7f302c0630c0 2024-09-15T22:09:13.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.727+0000 7f3028ff9640 1 --2- 172.21.15.78:0/2733999473 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f301806c2b0 0x7f301806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.727+0000 7f3028ff9640 1 -- 172.21.15.78:0/2733999473 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f301c08a3e0 con 0x7f302c0630c0 2024-09-15T22:09:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.727+0000 7f302b7fe640 1 --2- 172.21.15.78:0/2733999473 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f301806c2b0 0x7f301806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.727+0000 7f302b7fe640 1 --2- 172.21.15.78:0/2733999473 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f301806c2b0 0x7f301806e770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f302c0b39d0 tx=0x7f3020008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:13.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.731+0000 7f3028ff9640 1 -- 172.21.15.78:0/2733999473 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f301c058ea0 con 0x7f302c0630c0 2024-09-15T22:09:13.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.931+0000 7f30329c0640 1 -- 172.21.15.78:0/2733999473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f302c0b4e30 con 0x7f302c0630c0 2024-09-15T22:09:13.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.931+0000 7f3028ff9640 1 -- 172.21.15.78:0/2733999473 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2261 (secure 0 0 0) 0x7f301c0587a0 con 0x7f302c0630c0 2024-09-15T22:09:13.933 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:13.933 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":3,"btime":"2024-09-15T22:09:12:364339+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1036052633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1036052633},{"type":"v1","addr":"172.21.15.78:6835","nonce":1036052633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/4038139714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":4038139714},{"type":"v1","addr":"172.21.15.175:6833","nonce":4038139714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-15T22:09:13.933 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 3 2024-09-15T22:09:13.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.933+0000 7f30329c0640 1 -- 172.21.15.78:0/2733999473 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f301806c2b0 msgr2=0x7f301806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:13.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.933+0000 7f30329c0640 1 --2- 172.21.15.78:0/2733999473 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f301806c2b0 0x7f301806e770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f302c0b39d0 tx=0x7f3020008040 comp rx=0 tx=0).stop 2024-09-15T22:09:13.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.933+0000 7f30329c0640 1 -- 172.21.15.78:0/2733999473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c0630c0 msgr2=0x7f302c1e0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:13.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.933+0000 7f30329c0640 1 --2- 172.21.15.78:0/2733999473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c0630c0 0x7f302c1e0b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c4d0 tx=0x7f301c00c990 comp rx=0 tx=0).stop 2024-09-15T22:09:13.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.933+0000 7f30329c0640 1 -- 172.21.15.78:0/2733999473 shutdown_connections 2024-09-15T22:09:13.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.933+0000 7f30329c0640 1 --2- 172.21.15.78:0/2733999473 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f301806c2b0 0x7f301806e770 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:13.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.933+0000 7f30329c0640 1 --2- 172.21.15.78:0/2733999473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f302c1503c0 0x7f302c13aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:13.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.933+0000 7f30329c0640 1 --2- 172.21.15.78:0/2733999473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f302c144b40 0x7f302c06fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:13.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.933+0000 7f30329c0640 1 --2- 172.21.15.78:0/2733999473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c0630c0 0x7f302c1e0b50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:13.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.933+0000 7f30329c0640 1 -- 172.21.15.78:0/2733999473 >> 172.21.15.78:0/2733999473 conn(0x7f302c0ba2d0 msgr2=0x7f302c0b5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:13.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.933+0000 7f30329c0640 1 -- 172.21.15.78:0/2733999473 shutdown_connections 2024-09-15T22:09:13.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:13.933+0000 7f30329c0640 1 -- 172.21.15.78:0/2733999473 wait complete. 2024-09-15T22:09:13.945 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:09:14.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.041+0000 7f975b3f6640 1 Processor -- start 2024-09-15T22:09:14.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.041+0000 7f975b3f6640 1 -- start start 2024-09-15T22:09:14.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.042+0000 7f975b3f6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97540ba270 0x7f97540b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.042+0000 7f975b3f6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9754141c30 0x7f97540b8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.042+0000 7f975b3f6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97540b6c90 con 0x7f97541417f0 2024-09-15T22:09:14.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.042+0000 7f975b3f6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f97541420e0 con 0x7f9754141c30 2024-09-15T22:09:14.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.042+0000 7f975b3f6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f97540b6f00 con 0x7f97540ba270 2024-09-15T22:09:14.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.042+0000 7f9759993640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9754141c30 0x7f97540b8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.042+0000 7f9758991640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f97541417f0 0x7f97540b7f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43902/0 (socket says 172.21.15.78:43902) 2024-09-15T22:09:14.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.042+0000 7f9758991640 1 -- 172.21.15.78:0/2395774877 learned_addr learned my addr 172.21.15.78:0/2395774877 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:14.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.042+0000 7f9759192640 1 --2- 172.21.15.78:0/2395774877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97540ba270 0x7f97540b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.042+0000 7f9759993640 1 -- 172.21.15.78:0/2395774877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97540ba270 msgr2=0x7f97540b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:14.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.042+0000 7f9759993640 1 --2- 172.21.15.78:0/2395774877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97540ba270 0x7f97540b97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.042+0000 7f9759993640 1 -- 172.21.15.78:0/2395774877 >> v1:172.21.15.78:6789/0 conn(0x7f97541417f0 legacy=0x7f97540b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:14.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.042+0000 7f9759993640 1 -- 172.21.15.78:0/2395774877 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97540b7a80 con 0x7f9754141c30 2024-09-15T22:09:14.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.042+0000 7f9753fff640 1 -- 172.21.15.78:0/2395774877 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1599540110 0 0) 0x7f97540b6c90 con 0x7f97541417f0 2024-09-15T22:09:14.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.042+0000 7f9759192640 1 --2- 172.21.15.78:0/2395774877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97540ba270 0x7f97540b97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:14.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.043+0000 7f9759993640 1 --2- 172.21.15.78:0/2395774877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754141c30 0x7f97540b8680 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f974c0097a0 tx=0x7f974c02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee5186329b76c63 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:14.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.043+0000 7f9753fff640 1 -- 172.21.15.78:0/2395774877 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c037070 con 0x7f9754141c30 2024-09-15T22:09:14.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.043+0000 7f9753fff640 1 -- 172.21.15.78:0/2395774877 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f974c02adb0 con 0x7f9754141c30 2024-09-15T22:09:14.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.043+0000 7f9753fff640 1 -- 172.21.15.78:0/2395774877 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c032660 con 0x7f9754141c30 2024-09-15T22:09:14.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.044+0000 7f975b3f6640 1 -- 172.21.15.78:0/2395774877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754141c30 msgr2=0x7f97540b8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:14.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.044+0000 7f975b3f6640 1 --2- 172.21.15.78:0/2395774877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754141c30 0x7f97540b8680 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f974c0097a0 tx=0x7f974c02a060 comp rx=0 tx=0).stop 2024-09-15T22:09:14.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.044+0000 7f975b3f6640 1 -- 172.21.15.78:0/2395774877 shutdown_connections 2024-09-15T22:09:14.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.044+0000 7f975b3f6640 1 --2- 172.21.15.78:0/2395774877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754141c30 0x7f97540b8680 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.044+0000 7f975b3f6640 1 --2- 172.21.15.78:0/2395774877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97540ba270 0x7f97540b97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.044+0000 7f975b3f6640 1 -- 172.21.15.78:0/2395774877 >> 172.21.15.78:0/2395774877 conn(0x7f9754074ba0 msgr2=0x7f9754074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:14.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.044+0000 7f975b3f6640 1 -- 172.21.15.78:0/2395774877 shutdown_connections 2024-09-15T22:09:14.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.044+0000 7f975b3f6640 1 -- 172.21.15.78:0/2395774877 wait complete. 2024-09-15T22:09:14.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.045+0000 7f975b3f6640 1 Processor -- start 2024-09-15T22:09:14.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.045+0000 7f975b3f6640 1 -- start start 2024-09-15T22:09:14.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.045+0000 7f975b3f6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97540ba270 0x7f97541dd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.045+0000 7f975b3f6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97541417f0 0x7f97541408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.045+0000 7f975b3f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754141c30 0x7f9754140e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.045+0000 7f975b3f6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f97540b74c0 con 0x7f9754141c30 2024-09-15T22:09:14.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.045+0000 7f975b3f6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f97540b5190 con 0x7f97541417f0 2024-09-15T22:09:14.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.045+0000 7f975b3f6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f97540b77a0 con 0x7f97540ba270 2024-09-15T22:09:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f9759993640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754141c30 0x7f9754140e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f9759993640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754141c30 0x7f9754140e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43058/0 (socket says 172.21.15.78:43058) 2024-09-15T22:09:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f9759993640 1 -- 172.21.15.78:0/1321207185 learned_addr learned my addr 172.21.15.78:0/1321207185 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f9759192640 1 --2- 172.21.15.78:0/1321207185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97540ba270 0x7f97541dd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f9758991640 1 --2- 172.21.15.78:0/1321207185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97541417f0 0x7f97541408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f9759993640 1 -- 172.21.15.78:0/1321207185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97540ba270 msgr2=0x7f97541dd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f9759993640 1 --2- 172.21.15.78:0/1321207185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97540ba270 0x7f97541dd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f9759993640 1 -- 172.21.15.78:0/1321207185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97541417f0 msgr2=0x7f97541408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f9759993640 1 --2- 172.21.15.78:0/1321207185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97541417f0 0x7f97541408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f9759993640 1 -- 172.21.15.78:0/1321207185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97540ac9d0 con 0x7f9754141c30 2024-09-15T22:09:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f9759993640 1 --2- 172.21.15.78:0/1321207185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754141c30 0x7f9754140e30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f974c035040 tx=0x7f974c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f9751ffb640 1 -- 172.21.15.78:0/1321207185 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c042020 con 0x7f9754141c30 2024-09-15T22:09:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f9751ffb640 1 -- 172.21.15.78:0/1321207185 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f974c03d470 con 0x7f9754141c30 2024-09-15T22:09:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f975b3f6640 1 -- 172.21.15.78:0/1321207185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9754145c60 con 0x7f9754141c30 2024-09-15T22:09:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f9751ffb640 1 -- 172.21.15.78:0/1321207185 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c037040 con 0x7f9754141c30 2024-09-15T22:09:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.046+0000 7f975b3f6640 1 -- 172.21.15.78:0/1321207185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97541478f0 con 0x7f9754141c30 2024-09-15T22:09:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.047+0000 7f975b3f6640 1 -- 172.21.15.78:0/1321207185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97540b7c60 con 0x7f9754141c30 2024-09-15T22:09:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.048+0000 7f9751ffb640 1 -- 172.21.15.78:0/1321207185 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f974c045020 con 0x7f9754141c30 2024-09-15T22:09:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.048+0000 7f9751ffb640 1 --2- 172.21.15.78:0/1321207185 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f974006c2b0 0x7f974006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.048+0000 7f9751ffb640 1 -- 172.21.15.78:0/1321207185 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f974c0ab8a0 con 0x7f9754141c30 2024-09-15T22:09:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.048+0000 7f9759192640 1 --2- 172.21.15.78:0/1321207185 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f974006c2b0 0x7f974006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.049+0000 7f9759192640 1 --2- 172.21.15.78:0/1321207185 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f974006c2b0 0x7f974006e770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9744009f70 tx=0x7f974400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.053+0000 7f9751ffb640 1 -- 172.21.15.78:0/1321207185 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f974c04c030 con 0x7f9754141c30 2024-09-15T22:09:14.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.217+0000 7f975b3f6640 1 -- 172.21.15.78:0/1321207185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9754145390 con 0x7f9754141c30 2024-09-15T22:09:14.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.217+0000 7f9751ffb640 1 -- 172.21.15.78:0/1321207185 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f97540b7a80 con 0x7f9754141c30 2024-09-15T22:09:14.219 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:14.219 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-09-15T22:09:14.219 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-15T22:09:14.220 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2024-09-15T22:09:14.220 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2024-09-15T22:09:14.220 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-15T22:09:14.220 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-09-15T22:09:14.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.219+0000 7f975b3f6640 1 -- 172.21.15.78:0/1321207185 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f974006c2b0 msgr2=0x7f974006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:14.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.219+0000 7f975b3f6640 1 --2- 172.21.15.78:0/1321207185 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f974006c2b0 0x7f974006e770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9744009f70 tx=0x7f974400b040 comp rx=0 tx=0).stop 2024-09-15T22:09:14.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.219+0000 7f975b3f6640 1 -- 172.21.15.78:0/1321207185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754141c30 msgr2=0x7f9754140e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:14.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.219+0000 7f975b3f6640 1 --2- 172.21.15.78:0/1321207185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754141c30 0x7f9754140e30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f974c035040 tx=0x7f974c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.219+0000 7f975b3f6640 1 -- 172.21.15.78:0/1321207185 shutdown_connections 2024-09-15T22:09:14.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.219+0000 7f975b3f6640 1 --2- 172.21.15.78:0/1321207185 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f974006c2b0 0x7f974006e770 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.219+0000 7f975b3f6640 1 --2- 172.21.15.78:0/1321207185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754141c30 0x7f9754140e30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.219+0000 7f975b3f6640 1 --2- 172.21.15.78:0/1321207185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97541417f0 0x7f97541408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.219+0000 7f975b3f6640 1 --2- 172.21.15.78:0/1321207185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97540ba270 0x7f97541dd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.219+0000 7f975b3f6640 1 -- 172.21.15.78:0/1321207185 >> 172.21.15.78:0/1321207185 conn(0x7f9754074ba0 msgr2=0x7f9754149890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:14.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.219+0000 7f975b3f6640 1 -- 172.21.15.78:0/1321207185 shutdown_connections 2024-09-15T22:09:14.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.219+0000 7f975b3f6640 1 -- 172.21.15.78:0/1321207185 wait complete. 2024-09-15T22:09:14.231 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:09:14.232 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:09:14.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.332+0000 7f79b92f1640 1 Processor -- start 2024-09-15T22:09:14.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.332+0000 7f79b92f1640 1 -- start start 2024-09-15T22:09:14.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.333+0000 7f79b92f1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f79b406cb00 0x7f79b409c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.333+0000 7f79b92f1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f79b4144cb0 0x7f79b4145120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.333+0000 7f79b92f1640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79b40be4c0 con 0x7f79b40be0e0 2024-09-15T22:09:14.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.333+0000 7f79b92f1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f79b40bbd10 con 0x7f79b406cb00 2024-09-15T22:09:14.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.333+0000 7f79b92f1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f79b406c670 con 0x7f79b4144cb0 2024-09-15T22:09:14.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.333+0000 7f79b27fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f79b406cb00 0x7f79b409c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.333+0000 7f79b2ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f79b40be0e0 0x7f79b4147c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43910/0 (socket says 172.21.15.78:43910) 2024-09-15T22:09:14.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.333+0000 7f79b2ffd640 1 -- 172.21.15.78:0/1240036200 learned_addr learned my addr 172.21.15.78:0/1240036200 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:14.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.333+0000 7f79b37fe640 1 --2- 172.21.15.78:0/1240036200 >> v2:172.21.15.175:3300/0 conn(0x7f79b4144cb0 0x7f79b4145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.333+0000 7f79b27fc640 1 -- 172.21.15.78:0/1240036200 >> v2:172.21.15.175:3300/0 conn(0x7f79b4144cb0 msgr2=0x7f79b4145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:14.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.333+0000 7f79b27fc640 1 --2- 172.21.15.78:0/1240036200 >> v2:172.21.15.175:3300/0 conn(0x7f79b4144cb0 0x7f79b4145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.333+0000 7f79b27fc640 1 -- 172.21.15.78:0/1240036200 >> v1:172.21.15.78:6789/0 conn(0x7f79b40be0e0 legacy=0x7f79b4147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:14.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.333+0000 7f79b27fc640 1 -- 172.21.15.78:0/1240036200 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b406d1d0 con 0x7f79b406cb00 2024-09-15T22:09:14.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.333+0000 7f79b1ffb640 1 -- 172.21.15.78:0/1240036200 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3147203791 0 0) 0x7f79b40be4c0 con 0x7f79b40be0e0 2024-09-15T22:09:14.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.334+0000 7f79b27fc640 1 --2- 172.21.15.78:0/1240036200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79b406cb00 0x7f79b409c680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f79b40b4b10 tx=0x7f79a802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ad9fc946f76762 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:14.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.334+0000 7f79b1ffb640 1 -- 172.21.15.78:0/1240036200 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a8037070 con 0x7f79b406cb00 2024-09-15T22:09:14.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.334+0000 7f79b1ffb640 1 -- 172.21.15.78:0/1240036200 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a8032440 con 0x7f79b406cb00 2024-09-15T22:09:14.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.334+0000 7f79b1ffb640 1 -- 172.21.15.78:0/1240036200 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a802ae60 con 0x7f79b406cb00 2024-09-15T22:09:14.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.334+0000 7f79b92f1640 1 -- 172.21.15.78:0/1240036200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79b406cb00 msgr2=0x7f79b409c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:14.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.334+0000 7f79b92f1640 1 --2- 172.21.15.78:0/1240036200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79b406cb00 0x7f79b409c680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f79b40b4b10 tx=0x7f79a802a110 comp rx=0 tx=0).stop 2024-09-15T22:09:14.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.334+0000 7f79b92f1640 1 -- 172.21.15.78:0/1240036200 shutdown_connections 2024-09-15T22:09:14.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.334+0000 7f79b92f1640 1 --2- 172.21.15.78:0/1240036200 >> v2:172.21.15.175:3300/0 conn(0x7f79b4144cb0 0x7f79b4145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.334+0000 7f79b92f1640 1 --2- 172.21.15.78:0/1240036200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79b406cb00 0x7f79b409c680 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.334+0000 7f79b92f1640 1 -- 172.21.15.78:0/1240036200 >> 172.21.15.78:0/1240036200 conn(0x7f79b40751d0 msgr2=0x7f79b40bd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.335+0000 7f79b92f1640 1 -- 172.21.15.78:0/1240036200 shutdown_connections 2024-09-15T22:09:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.335+0000 7f79b92f1640 1 -- 172.21.15.78:0/1240036200 wait complete. 2024-09-15T22:09:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.336+0000 7f79b92f1640 1 Processor -- start 2024-09-15T22:09:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.336+0000 7f79b92f1640 1 -- start start 2024-09-15T22:09:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.336+0000 7f79b92f1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79b406cb00 0x7f79b40b7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.336+0000 7f79b92f1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79b40be0e0 0x7f79b41dd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.336+0000 7f79b92f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79b4144cb0 0x7f79b41dd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.336+0000 7f79b92f1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f79b4145660 con 0x7f79b4144cb0 2024-09-15T22:09:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.336+0000 7f79b92f1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f79b40bbf60 con 0x7f79b406cb00 2024-09-15T22:09:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.336+0000 7f79b92f1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f79b406db00 con 0x7f79b40be0e0 2024-09-15T22:09:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.336+0000 7f79b37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79b4144cb0 0x7f79b41dd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.336+0000 7f79b37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79b4144cb0 0x7f79b41dd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43070/0 (socket says 172.21.15.78:43070) 2024-09-15T22:09:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.336+0000 7f79b37fe640 1 -- 172.21.15.78:0/4130242458 learned_addr learned my addr 172.21.15.78:0/4130242458 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.336+0000 7f79b27fc640 1 --2- 172.21.15.78:0/4130242458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79b40be0e0 0x7f79b41dd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.336+0000 7f79b2ffd640 1 --2- 172.21.15.78:0/4130242458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79b406cb00 0x7f79b40b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.337+0000 7f79b37fe640 1 -- 172.21.15.78:0/4130242458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79b40be0e0 msgr2=0x7f79b41dd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.337+0000 7f79b37fe640 1 --2- 172.21.15.78:0/4130242458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79b40be0e0 0x7f79b41dd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.337+0000 7f79b37fe640 1 -- 172.21.15.78:0/4130242458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79b406cb00 msgr2=0x7f79b40b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.337+0000 7f79b37fe640 1 --2- 172.21.15.78:0/4130242458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79b406cb00 0x7f79b40b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.337+0000 7f79b37fe640 1 -- 172.21.15.78:0/4130242458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b40ba0c0 con 0x7f79b4144cb0 2024-09-15T22:09:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.337+0000 7f79b2ffd640 1 --2- 172.21.15.78:0/4130242458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79b406cb00 0x7f79b40b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.337+0000 7f79b37fe640 1 --2- 172.21.15.78:0/4130242458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79b4144cb0 0x7f79b41dd8e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00d5d0 tx=0x7f79ac00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.337+0000 7f799b7fe640 1 -- 172.21.15.78:0/4130242458 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0125f0 con 0x7f79b4144cb0 2024-09-15T22:09:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.337+0000 7f799b7fe640 1 -- 172.21.15.78:0/4130242458 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79ac019070 con 0x7f79b4144cb0 2024-09-15T22:09:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.337+0000 7f799b7fe640 1 -- 172.21.15.78:0/4130242458 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0129f0 con 0x7f79b4144cb0 2024-09-15T22:09:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.337+0000 7f79b92f1640 1 -- 172.21.15.78:0/4130242458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b40ba3a0 con 0x7f79b4144cb0 2024-09-15T22:09:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.337+0000 7f79b92f1640 1 -- 172.21.15.78:0/4130242458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b40bab10 con 0x7f79b4144cb0 2024-09-15T22:09:14.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.338+0000 7f79b92f1640 1 -- 172.21.15.78:0/4130242458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79b41dd080 con 0x7f79b4144cb0 2024-09-15T22:09:14.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.338+0000 7f799b7fe640 1 -- 172.21.15.78:0/4130242458 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f79ac012b90 con 0x7f79b4144cb0 2024-09-15T22:09:14.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.339+0000 7f799b7fe640 1 --2- 172.21.15.78:0/4130242458 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f79a006c2b0 0x7f79a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.339+0000 7f799b7fe640 1 -- 172.21.15.78:0/4130242458 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f79ac08b440 con 0x7f79b4144cb0 2024-09-15T22:09:14.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.339+0000 7f79b2ffd640 1 --2- 172.21.15.78:0/4130242458 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f79a006c2b0 0x7f79a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.339+0000 7f79b2ffd640 1 --2- 172.21.15.78:0/4130242458 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f79a006c2b0 0x7f79a006e770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f79a40012e0 tx=0x7f79a4007f90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:14.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.343+0000 7f799b7fe640 1 -- 172.21.15.78:0/4130242458 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79b41dd080 con 0x7f79b4144cb0 2024-09-15T22:09:14.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:14.513+0000 7f79b92f1640 1 -- 172.21.15.78:0/4130242458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f79b4145120 con 0x7f79b4144cb0 2024-09-15T22:09:15.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.381+0000 7f799b7fe640 1 -- 172.21.15.78:0/4130242458 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f79ac059f10 con 0x7f79b4144cb0 2024-09-15T22:09:15.383 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2024-09-15T22:09:15.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.384+0000 7f79b92f1640 1 -- 172.21.15.78:0/4130242458 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f79a006c2b0 msgr2=0x7f79a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:15.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.384+0000 7f79b92f1640 1 --2- 172.21.15.78:0/4130242458 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f79a006c2b0 0x7f79a006e770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f79a40012e0 tx=0x7f79a4007f90 comp rx=0 tx=0).stop 2024-09-15T22:09:15.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.384+0000 7f79b92f1640 1 -- 172.21.15.78:0/4130242458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79b4144cb0 msgr2=0x7f79b41dd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:15.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.384+0000 7f79b92f1640 1 --2- 172.21.15.78:0/4130242458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79b4144cb0 0x7f79b41dd8e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00d5d0 tx=0x7f79ac00da90 comp rx=0 tx=0).stop 2024-09-15T22:09:15.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.384+0000 7f79b92f1640 1 -- 172.21.15.78:0/4130242458 shutdown_connections 2024-09-15T22:09:15.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.384+0000 7f79b92f1640 1 --2- 172.21.15.78:0/4130242458 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f79a006c2b0 0x7f79a006e770 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:15.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.384+0000 7f79b92f1640 1 --2- 172.21.15.78:0/4130242458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79b4144cb0 0x7f79b41dd8e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:15.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.384+0000 7f79b92f1640 1 --2- 172.21.15.78:0/4130242458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79b40be0e0 0x7f79b41dd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:15.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.384+0000 7f79b92f1640 1 --2- 172.21.15.78:0/4130242458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79b406cb00 0x7f79b40b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:15.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.384+0000 7f79b92f1640 1 -- 172.21.15.78:0/4130242458 >> 172.21.15.78:0/4130242458 conn(0x7f79b40751d0 msgr2=0x7f79b409f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:15.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.385+0000 7f79b92f1640 1 -- 172.21.15.78:0/4130242458 shutdown_connections 2024-09-15T22:09:15.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.385+0000 7f79b92f1640 1 -- 172.21.15.78:0/4130242458 wait complete. 2024-09-15T22:09:15.404 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-15T22:09:15.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.512+0000 7f8d904e4640 1 Processor -- start 2024-09-15T22:09:15.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.512+0000 7f8d904e4640 1 -- start start 2024-09-15T22:09:15.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d904e4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8d880ba300 0x7f8d880b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:15.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d904e4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d880ba6e0 con 0x7f8d880b61e0 2024-09-15T22:09:15.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d904e4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d880b5e20 con 0x7f8d88141cc0 2024-09-15T22:09:15.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d904e4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f8d880b6cd0 con 0x7f8d880ba300 2024-09-15T22:09:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8da7f640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8d880b61e0 0x7f8d881415b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43920/0 (socket says 172.21.15.78:43920) 2024-09-15T22:09:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8da7f640 1 -- 172.21.15.78:0/3778234942 learned_addr learned my addr 172.21.15.78:0/3778234942 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8e280640 1 --2- 172.21.15.78:0/3778234942 >> v2:172.21.15.175:3300/0 conn(0x7f8d880ba300 0x7f8d880b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8d27e640 1 -- 172.21.15.78:0/3778234942 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4040495595 0 0) 0x7f8d880ba6e0 con 0x7f8d880b61e0 2024-09-15T22:09:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8d27e640 1 -- 172.21.15.78:0/3778234942 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d74003520 con 0x7f8d880b61e0 2024-09-15T22:09:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8d27e640 1 -- 172.21.15.78:0/3778234942 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3218191498 0 0) 0x7f8d74003520 con 0x7f8d880b61e0 2024-09-15T22:09:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8d27e640 1 -- 172.21.15.78:0/3778234942 >> v2:172.21.15.175:3300/0 conn(0x7f8d880ba300 msgr2=0x7f8d880b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8d27e640 1 --2- 172.21.15.78:0/3778234942 >> v2:172.21.15.175:3300/0 conn(0x7f8d880ba300 0x7f8d880b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8d27e640 1 -- 172.21.15.78:0/3778234942 >> v1:172.21.15.175:6789/0 conn(0x7f8d88141cc0 legacy=0x7f8d881522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8d27e640 1 -- 172.21.15.78:0/3778234942 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d880b7570 con 0x7f8d880b61e0 2024-09-15T22:09:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8d27e640 1 -- 172.21.15.78:0/3778234942 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3961011974 0 0) 0x7f8d78001670 con 0x7f8d880b61e0 2024-09-15T22:09:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8d27e640 1 -- 172.21.15.78:0/3778234942 >> v1:172.21.15.78:6789/0 conn(0x7f8d880b61e0 legacy=0x7f8d881415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8d27e640 1 --2- 172.21.15.78:0/3778234942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d740039b0 0x7f8d74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8d27e640 1 --2- 172.21.15.78:0/3778234942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d74004800 0x7f8d74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8d27e640 1 --2- 172.21.15.78:0/3778234942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d740052e0 0x7f8d7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8d27e640 1 -- 172.21.15.78:0/3778234942 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8d880b6cd0 con 0x7f8d740052e0 2024-09-15T22:09:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8d27e640 1 -- 172.21.15.78:0/3778234942 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7400c1b0 con 0x7f8d740039b0 2024-09-15T22:09:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8d27e640 1 -- 172.21.15.78:0/3778234942 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7400c3b0 con 0x7f8d74004800 2024-09-15T22:09:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8ea81640 1 --2- 172.21.15.78:0/3778234942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d740052e0 0x7f8d7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.513+0000 7f8d8e280640 1 --2- 172.21.15.78:0/3778234942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d740039b0 0x7f8d74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.514+0000 7f8d8da7f640 1 --2- 172.21.15.78:0/3778234942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d74004800 0x7f8d74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.514+0000 7f8d8ea81640 1 -- 172.21.15.78:0/3778234942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d74004800 msgr2=0x7f8d74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.514+0000 7f8d8ea81640 1 --2- 172.21.15.78:0/3778234942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d74004800 0x7f8d74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.514+0000 7f8d8ea81640 1 -- 172.21.15.78:0/3778234942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d740039b0 msgr2=0x7f8d74003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.514+0000 7f8d8ea81640 1 --2- 172.21.15.78:0/3778234942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d740039b0 0x7f8d74003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.514+0000 7f8d8ea81640 1 -- 172.21.15.78:0/3778234942 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d74003520 con 0x7f8d740052e0 2024-09-15T22:09:15.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.514+0000 7f8d8da7f640 1 --2- 172.21.15.78:0/3778234942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d74004800 0x7f8d74004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:15.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.514+0000 7f8d8ea81640 1 -- 172.21.15.78:0/3778234942 reap_dead start 2024-09-15T22:09:15.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.514+0000 7f8d8ea81640 1 --2- 172.21.15.78:0/3778234942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d740052e0 0x7f8d7400b9c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8d80001e20 tx=0x7f8d74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784666a9cae46ec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:15.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.514+0000 7f8d8d27e640 1 -- 172.21.15.78:0/3778234942 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80001a70 con 0x7f8d740052e0 2024-09-15T22:09:15.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.515+0000 7f8d8d27e640 1 -- 172.21.15.78:0/3778234942 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d8002ae40 con 0x7f8d740052e0 2024-09-15T22:09:15.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.515+0000 7f8d8d27e640 1 -- 172.21.15.78:0/3778234942 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80003b90 con 0x7f8d740052e0 2024-09-15T22:09:15.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.515+0000 7f8d904e4640 1 -- 172.21.15.78:0/3778234942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d740052e0 msgr2=0x7f8d7400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:15.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.515+0000 7f8d904e4640 1 --2- 172.21.15.78:0/3778234942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d740052e0 0x7f8d7400b9c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8d80001e20 tx=0x7f8d74005830 comp rx=0 tx=0).stop 2024-09-15T22:09:15.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.515+0000 7f8d904e4640 1 -- 172.21.15.78:0/3778234942 shutdown_connections 2024-09-15T22:09:15.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.515+0000 7f8d904e4640 1 --2- 172.21.15.78:0/3778234942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d740052e0 0x7f8d7400b9c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:15.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.515+0000 7f8d904e4640 1 -- 172.21.15.78:0/3778234942 >> 172.21.15.78:0/3778234942 conn(0x7f8d880bd600 msgr2=0x7f8d880bda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:15.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.515+0000 7f8d904e4640 1 -- 172.21.15.78:0/3778234942 shutdown_connections 2024-09-15T22:09:15.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.515+0000 7f8d904e4640 1 -- 172.21.15.78:0/3778234942 wait complete. 2024-09-15T22:09:15.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.516+0000 7f8d904e4640 1 Processor -- start 2024-09-15T22:09:15.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.516+0000 7f8d904e4640 1 -- start start 2024-09-15T22:09:15.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d904e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d740052e0 0x7f8d8813ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:15.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d904e4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d88143a70 0x7f8d88143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:15.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d904e4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d88137650 0x7f8d88137ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d904e4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8814af40 con 0x7f8d740052e0 2024-09-15T22:09:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d904e4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8d880b4da0 con 0x7f8d88137650 2024-09-15T22:09:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d904e4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8d8814b0c0 con 0x7f8d88143a70 2024-09-15T22:09:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d8e280640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d740052e0 0x7f8d8813ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d8e280640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d740052e0 0x7f8d8813ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43076/0 (socket says 172.21.15.78:43076) 2024-09-15T22:09:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d8e280640 1 -- 172.21.15.78:0/3459980162 learned_addr learned my addr 172.21.15.78:0/3459980162 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d8ea81640 1 --2- 172.21.15.78:0/3459980162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d88137650 0x7f8d88137ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d8da7f640 1 --2- 172.21.15.78:0/3459980162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d88143a70 0x7f8d88143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d8e280640 1 -- 172.21.15.78:0/3459980162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d88143a70 msgr2=0x7f8d88143ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d8e280640 1 --2- 172.21.15.78:0/3459980162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d88143a70 0x7f8d88143ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d8e280640 1 -- 172.21.15.78:0/3459980162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d88137650 msgr2=0x7f8d88137ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d8e280640 1 --2- 172.21.15.78:0/3459980162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d88137650 0x7f8d88137ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d8e280640 1 -- 172.21.15.78:0/3459980162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8813d6e0 con 0x7f8d740052e0 2024-09-15T22:09:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d8da7f640 1 --2- 172.21.15.78:0/3459980162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d88143a70 0x7f8d88143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.517+0000 7f8d8e280640 1 --2- 172.21.15.78:0/3459980162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d740052e0 0x7f8d8813ce10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8d840118e0 tx=0x7f8d84011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.518+0000 7f8d7effd640 1 -- 172.21.15.78:0/3459980162 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8400faf0 con 0x7f8d740052e0 2024-09-15T22:09:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.518+0000 7f8d7effd640 1 -- 172.21.15.78:0/3459980162 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d8400fc90 con 0x7f8d740052e0 2024-09-15T22:09:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.518+0000 7f8d904e4640 1 -- 172.21.15.78:0/3459980162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d881d3740 con 0x7f8d740052e0 2024-09-15T22:09:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.518+0000 7f8d7effd640 1 -- 172.21.15.78:0/3459980162 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d84014440 con 0x7f8d740052e0 2024-09-15T22:09:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.518+0000 7f8d904e4640 1 -- 172.21.15.78:0/3459980162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d88143470 con 0x7f8d740052e0 2024-09-15T22:09:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.518+0000 7f8d904e4640 1 -- 172.21.15.78:0/3459980162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d880b58e0 con 0x7f8d740052e0 2024-09-15T22:09:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.519+0000 7f8d7effd640 1 -- 172.21.15.78:0/3459980162 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8d84012040 con 0x7f8d740052e0 2024-09-15T22:09:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.519+0000 7f8d7effd640 1 --2- 172.21.15.78:0/3459980162 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8d6c06c2b0 0x7f8d6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.520+0000 7f8d8da7f640 1 --2- 172.21.15.78:0/3459980162 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8d6c06c2b0 0x7f8d6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:15.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.520+0000 7f8d7effd640 1 -- 172.21.15.78:0/3459980162 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f8d8408b850 con 0x7f8d740052e0 2024-09-15T22:09:15.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.520+0000 7f8d8da7f640 1 --2- 172.21.15.78:0/3459980162 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8d6c06c2b0 0x7f8d6c06e770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8d78001eb0 tx=0x7f8d78009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:15.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.524+0000 7f8d7effd640 1 -- 172.21.15.78:0/3459980162 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d84019030 con 0x7f8d740052e0 2024-09-15T22:09:15.610 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:09:15.612 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:09:15.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:15.692+0000 7f8d904e4640 1 -- 172.21.15.78:0/3459980162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f8d88145370 con 0x7f8d740052e0 2024-09-15T22:09:16.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.386+0000 7f8d7effd640 1 -- 172.21.15.78:0/3459980162 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f8d8405a230 con 0x7f8d740052e0 2024-09-15T22:09:16.388 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2024-09-15T22:09:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.388+0000 7f8d904e4640 1 -- 172.21.15.78:0/3459980162 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8d6c06c2b0 msgr2=0x7f8d6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.388+0000 7f8d904e4640 1 --2- 172.21.15.78:0/3459980162 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8d6c06c2b0 0x7f8d6c06e770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8d78001eb0 tx=0x7f8d78009040 comp rx=0 tx=0).stop 2024-09-15T22:09:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.388+0000 7f8d904e4640 1 -- 172.21.15.78:0/3459980162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d740052e0 msgr2=0x7f8d8813ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.388+0000 7f8d904e4640 1 --2- 172.21.15.78:0/3459980162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d740052e0 0x7f8d8813ce10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8d840118e0 tx=0x7f8d84011da0 comp rx=0 tx=0).stop 2024-09-15T22:09:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.388+0000 7f8d904e4640 1 -- 172.21.15.78:0/3459980162 shutdown_connections 2024-09-15T22:09:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.388+0000 7f8d904e4640 1 --2- 172.21.15.78:0/3459980162 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8d6c06c2b0 0x7f8d6c06e770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.388+0000 7f8d904e4640 1 --2- 172.21.15.78:0/3459980162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d88137650 0x7f8d88137ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.388+0000 7f8d904e4640 1 --2- 172.21.15.78:0/3459980162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d88143a70 0x7f8d88143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.388+0000 7f8d904e4640 1 --2- 172.21.15.78:0/3459980162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d740052e0 0x7f8d8813ce10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.388+0000 7f8d904e4640 1 -- 172.21.15.78:0/3459980162 >> 172.21.15.78:0/3459980162 conn(0x7f8d880bd600 msgr2=0x7f8d88149490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.388+0000 7f8d904e4640 1 -- 172.21.15.78:0/3459980162 shutdown_connections 2024-09-15T22:09:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.389+0000 7f8d904e4640 1 -- 172.21.15.78:0/3459980162 wait complete. 2024-09-15T22:09:16.411 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:09:16.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.512+0000 7f0439fbd640 1 Processor -- start 2024-09-15T22:09:16.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.512+0000 7f0439fbd640 1 -- start start 2024-09-15T22:09:16.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.513+0000 7f0439fbd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0434151380 0x7f0434153770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:16.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.513+0000 7f0439fbd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04340b7a00 con 0x7f0434141870 2024-09-15T22:09:16.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.513+0000 7f0439fbd640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f043414b180 con 0x7f04340b58e0 2024-09-15T22:09:16.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.513+0000 7f0439fbd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f04340b5cc0 con 0x7f0434151380 2024-09-15T22:09:16.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.513+0000 7f0433fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0434151380 0x7f0434153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:16.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.513+0000 7f0432ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0434141870 0x7f0434141d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43928/0 (socket says 172.21.15.78:43928) 2024-09-15T22:09:16.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.513+0000 7f0432ffd640 1 -- 172.21.15.78:0/3335741301 learned_addr learned my addr 172.21.15.78:0/3335741301 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:16.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.514+0000 7f0433fff640 1 -- 172.21.15.78:0/3335741301 >> v1:172.21.15.175:6789/0 conn(0x7f04340b58e0 legacy=0x7f043414b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:16.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.514+0000 7f0433fff640 1 -- 172.21.15.78:0/3335741301 >> v1:172.21.15.78:6789/0 conn(0x7f0434141870 legacy=0x7f0434141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:16.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.514+0000 7f04327fc640 1 -- 172.21.15.78:0/3335741301 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2815882994 0 0) 0x7f04340b7a00 con 0x7f0434141870 2024-09-15T22:09:16.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.514+0000 7f0433fff640 1 -- 172.21.15.78:0/3335741301 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04340b6c40 con 0x7f0434151380 2024-09-15T22:09:16.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.514+0000 7f0433fff640 1 --2- 172.21.15.78:0/3335741301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434151380 0x7f0434153770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f042c009d90 tx=0x7f042c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd8453981f0ce5c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:16.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.514+0000 7f04327fc640 1 -- 172.21.15.78:0/3335741301 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c007740 con 0x7f0434151380 2024-09-15T22:09:16.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.514+0000 7f04327fc640 1 -- 172.21.15.78:0/3335741301 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042c0078e0 con 0x7f0434151380 2024-09-15T22:09:16.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.514+0000 7f04327fc640 1 -- 172.21.15.78:0/3335741301 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c007cb0 con 0x7f0434151380 2024-09-15T22:09:16.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.515+0000 7f0439fbd640 1 -- 172.21.15.78:0/3335741301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434151380 msgr2=0x7f0434153770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:16.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.515+0000 7f0439fbd640 1 --2- 172.21.15.78:0/3335741301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434151380 0x7f0434153770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f042c009d90 tx=0x7f042c02a660 comp rx=0 tx=0).stop 2024-09-15T22:09:16.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.515+0000 7f0439fbd640 1 -- 172.21.15.78:0/3335741301 shutdown_connections 2024-09-15T22:09:16.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.515+0000 7f0439fbd640 1 --2- 172.21.15.78:0/3335741301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434151380 0x7f0434153770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:16.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.515+0000 7f0439fbd640 1 -- 172.21.15.78:0/3335741301 >> 172.21.15.78:0/3335741301 conn(0x7f0434074ba0 msgr2=0x7f0434074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:16.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.515+0000 7f0439fbd640 1 -- 172.21.15.78:0/3335741301 shutdown_connections 2024-09-15T22:09:16.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.515+0000 7f0439fbd640 1 -- 172.21.15.78:0/3335741301 wait complete. 2024-09-15T22:09:16.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.516+0000 7f0439fbd640 1 Processor -- start 2024-09-15T22:09:16.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.516+0000 7f0439fbd640 1 -- start start 2024-09-15T22:09:16.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0439fbd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04340b58e0 0x7f0434144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:16.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0439fbd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0434141870 0x7f04341e0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:16.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0439fbd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434151380 0x7f0434137550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:16.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0439fbd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f04340b73b0 con 0x7f0434151380 2024-09-15T22:09:16.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0439fbd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04340b7720 con 0x7f0434141870 2024-09-15T22:09:16.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0439fbd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f043414bd70 con 0x7f04340b58e0 2024-09-15T22:09:16.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0433fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434151380 0x7f0434137550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:16.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0433fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434151380 0x7f0434137550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43096/0 (socket says 172.21.15.78:43096) 2024-09-15T22:09:16.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0433fff640 1 -- 172.21.15.78:0/2126381764 learned_addr learned my addr 172.21.15.78:0/2126381764 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:16.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0432ffd640 1 --2- 172.21.15.78:0/2126381764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0434141870 0x7f04341e0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:16.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f04337fe640 1 --2- 172.21.15.78:0/2126381764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04340b58e0 0x7f0434144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:16.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0433fff640 1 -- 172.21.15.78:0/2126381764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04340b58e0 msgr2=0x7f0434144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:16.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0433fff640 1 --2- 172.21.15.78:0/2126381764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04340b58e0 0x7f0434144770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:16.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0433fff640 1 -- 172.21.15.78:0/2126381764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0434141870 msgr2=0x7f04341e0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:16.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0433fff640 1 --2- 172.21.15.78:0/2126381764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0434141870 0x7f04341e0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0433fff640 1 -- 172.21.15.78:0/2126381764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043414d190 con 0x7f0434151380 2024-09-15T22:09:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f04337fe640 1 --2- 172.21.15.78:0/2126381764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04340b58e0 0x7f0434144770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f0433fff640 1 --2- 172.21.15.78:0/2126381764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434151380 0x7f0434137550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f042c009d90 tx=0x7f042c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.517+0000 7f041bfff640 1 -- 172.21.15.78:0/2126381764 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c03f070 con 0x7f0434151380 2024-09-15T22:09:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.518+0000 7f041bfff640 1 -- 172.21.15.78:0/2126381764 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042c031c90 con 0x7f0434151380 2024-09-15T22:09:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.518+0000 7f0439fbd640 1 -- 172.21.15.78:0/2126381764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f043414d470 con 0x7f0434151380 2024-09-15T22:09:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.518+0000 7f041bfff640 1 -- 172.21.15.78:0/2126381764 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c043630 con 0x7f0434151380 2024-09-15T22:09:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.518+0000 7f0439fbd640 1 -- 172.21.15.78:0/2126381764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f043413a380 con 0x7f0434151380 2024-09-15T22:09:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.518+0000 7f0439fbd640 1 -- 172.21.15.78:0/2126381764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04340b4a00 con 0x7f0434151380 2024-09-15T22:09:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.519+0000 7f041bfff640 1 -- 172.21.15.78:0/2126381764 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f042c03b410 con 0x7f0434151380 2024-09-15T22:09:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.519+0000 7f041bfff640 1 --2- 172.21.15.78:0/2126381764 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f042006c2b0 0x7f042006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.519+0000 7f041bfff640 1 -- 172.21.15.78:0/2126381764 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f042c0ac840 con 0x7f0434151380 2024-09-15T22:09:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.519+0000 7f04337fe640 1 --2- 172.21.15.78:0/2126381764 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f042006c2b0 0x7f042006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:16.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.520+0000 7f04337fe640 1 --2- 172.21.15.78:0/2126381764 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f042006c2b0 0x7f042006e770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f043413a9c0 tx=0x7f0424009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:16.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.524+0000 7f041bfff640 1 -- 172.21.15.78:0/2126381764 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f042c07b160 con 0x7f0434151380 2024-09-15T22:09:16.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:16.725+0000 7f0439fbd640 1 -- 172.21.15.78:0/2126381764 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f04340b5240 con 0x7f0434151380 2024-09-15T22:09:17.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.387+0000 7f041bfff640 1 -- 172.21.15.78:0/2126381764 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f042c07aa60 con 0x7f0434151380 2024-09-15T22:09:17.389 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 2 and data pool 3 2024-09-15T22:09:17.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.391+0000 7f0439fbd640 1 -- 172.21.15.78:0/2126381764 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f042006c2b0 msgr2=0x7f042006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:17.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.391+0000 7f0439fbd640 1 --2- 172.21.15.78:0/2126381764 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f042006c2b0 0x7f042006e770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f043413a9c0 tx=0x7f0424009040 comp rx=0 tx=0).stop 2024-09-15T22:09:17.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.391+0000 7f0439fbd640 1 -- 172.21.15.78:0/2126381764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434151380 msgr2=0x7f0434137550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:17.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.391+0000 7f0439fbd640 1 --2- 172.21.15.78:0/2126381764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434151380 0x7f0434137550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f042c009d90 tx=0x7f042c004a40 comp rx=0 tx=0).stop 2024-09-15T22:09:17.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.392+0000 7f0439fbd640 1 -- 172.21.15.78:0/2126381764 shutdown_connections 2024-09-15T22:09:17.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.392+0000 7f0439fbd640 1 --2- 172.21.15.78:0/2126381764 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f042006c2b0 0x7f042006e770 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:17.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.392+0000 7f0439fbd640 1 --2- 172.21.15.78:0/2126381764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0434151380 0x7f0434137550 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:17.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.392+0000 7f0439fbd640 1 --2- 172.21.15.78:0/2126381764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0434141870 0x7f04341e0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:17.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.392+0000 7f0439fbd640 1 --2- 172.21.15.78:0/2126381764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04340b58e0 0x7f0434144770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:17.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.392+0000 7f0439fbd640 1 -- 172.21.15.78:0/2126381764 >> 172.21.15.78:0/2126381764 conn(0x7f0434074ba0 msgr2=0x7f04340b7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:17.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.396+0000 7f0439fbd640 1 -- 172.21.15.78:0/2126381764 shutdown_connections 2024-09-15T22:09:17.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.397+0000 7f0439fbd640 1 -- 172.21.15.78:0/2126381764 wait complete. 2024-09-15T22:09:17.422 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-15T22:09:17.422 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-15T22:09:17.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.523+0000 7fefedd8d640 1 Processor -- start 2024-09-15T22:09:17.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.523+0000 7fefedd8d640 1 -- start start 2024-09-15T22:09:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.524+0000 7fefedd8d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefe80b6810 0x7fefe80b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.524+0000 7fefedd8d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fefe806e6e0 0x7fefe814b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.524+0000 7fefedd8d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fefe806eb00 0x7fefe814bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.524+0000 7fefedd8d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fefe814b330 con 0x7fefe806eb00 2024-09-15T22:09:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.524+0000 7fefedd8d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fefe806efd0 con 0x7fefe806e6e0 2024-09-15T22:09:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.524+0000 7fefedd8d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fefe806f2b0 con 0x7fefe80b6810 2024-09-15T22:09:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.524+0000 7fefe7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fefe806eb00 0x7fefe814bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.524+0000 7fefe7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fefe806eb00 0x7fefe814bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43110/0 (socket says 172.21.15.78:43110) 2024-09-15T22:09:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.524+0000 7fefe7fff640 1 -- 172.21.15.78:0/4023590869 learned_addr learned my addr 172.21.15.78:0/4023590869 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.524+0000 7fefe7fff640 1 -- 172.21.15.78:0/4023590869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefe80b6810 msgr2=0x7fefe80b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.524+0000 7fefe7fff640 1 --2- 172.21.15.78:0/4023590869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefe80b6810 0x7fefe80b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.524+0000 7fefe6ffd640 1 --2- 172.21.15.78:0/4023590869 >> v2:172.21.15.175:3300/0 conn(0x7fefe806e6e0 0x7fefe814b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.524+0000 7fefe7fff640 1 -- 172.21.15.78:0/4023590869 >> v2:172.21.15.175:3300/0 conn(0x7fefe806e6e0 msgr2=0x7fefe814b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.524+0000 7fefe7fff640 1 --2- 172.21.15.78:0/4023590869 >> v2:172.21.15.175:3300/0 conn(0x7fefe806e6e0 0x7fefe814b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.524+0000 7fefe7fff640 1 -- 172.21.15.78:0/4023590869 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe806d230 con 0x7fefe806eb00 2024-09-15T22:09:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.525+0000 7fefe7fff640 1 --2- 172.21.15.78:0/4023590869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefe806eb00 0x7fefe814bd00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fefe809e0b0 tx=0x7fefe002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f215be191a996ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.525+0000 7fefe67fc640 1 -- 172.21.15.78:0/4023590869 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0036070 con 0x7fefe806eb00 2024-09-15T22:09:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.525+0000 7fefe67fc640 1 -- 172.21.15.78:0/4023590869 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe0031600 con 0x7fefe806eb00 2024-09-15T22:09:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.525+0000 7fefe67fc640 1 -- 172.21.15.78:0/4023590869 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe00319d0 con 0x7fefe806eb00 2024-09-15T22:09:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.525+0000 7fefedd8d640 1 -- 172.21.15.78:0/4023590869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefe806eb00 msgr2=0x7fefe814bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.525+0000 7fefedd8d640 1 --2- 172.21.15.78:0/4023590869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefe806eb00 0x7fefe814bd00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fefe809e0b0 tx=0x7fefe002a6a0 comp rx=0 tx=0).stop 2024-09-15T22:09:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.525+0000 7fefedd8d640 1 -- 172.21.15.78:0/4023590869 shutdown_connections 2024-09-15T22:09:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.525+0000 7fefedd8d640 1 --2- 172.21.15.78:0/4023590869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefe806eb00 0x7fefe814bd00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.525+0000 7fefedd8d640 1 --2- 172.21.15.78:0/4023590869 >> v2:172.21.15.175:3300/0 conn(0x7fefe806e6e0 0x7fefe814b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.525+0000 7fefedd8d640 1 --2- 172.21.15.78:0/4023590869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefe80b6810 0x7fefe80b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.525+0000 7fefedd8d640 1 -- 172.21.15.78:0/4023590869 >> 172.21.15.78:0/4023590869 conn(0x7fefe809d310 msgr2=0x7fefe809d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.525+0000 7fefedd8d640 1 -- 172.21.15.78:0/4023590869 shutdown_connections 2024-09-15T22:09:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.525+0000 7fefedd8d640 1 -- 172.21.15.78:0/4023590869 wait complete. 2024-09-15T22:09:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.526+0000 7fefedd8d640 1 Processor -- start 2024-09-15T22:09:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.527+0000 7fefedd8d640 1 -- start start 2024-09-15T22:09:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.527+0000 7fefedd8d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefe806e6e0 0x7fefe81dd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.527+0000 7fefedd8d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefe806eb00 0x7fefe80b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.527+0000 7fefedd8d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefe80b6810 0x7fefe80a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.527+0000 7fefedd8d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fefe806d990 con 0x7fefe80b6810 2024-09-15T22:09:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.527+0000 7fefedd8d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fefe806d810 con 0x7fefe806eb00 2024-09-15T22:09:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.527+0000 7fefedd8d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fefe806db10 con 0x7fefe806e6e0 2024-09-15T22:09:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.527+0000 7fefe7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefe80b6810 0x7fefe80a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.527+0000 7fefe7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefe80b6810 0x7fefe80a0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43112/0 (socket says 172.21.15.78:43112) 2024-09-15T22:09:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.527+0000 7fefe7fff640 1 -- 172.21.15.78:0/1899395320 learned_addr learned my addr 172.21.15.78:0/1899395320 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.527+0000 7fefe77fe640 1 --2- 172.21.15.78:0/1899395320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefe806e6e0 0x7fefe81dd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.527+0000 7fefe6ffd640 1 --2- 172.21.15.78:0/1899395320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefe806eb00 0x7fefe80b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.528+0000 7fefe7fff640 1 -- 172.21.15.78:0/1899395320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefe806e6e0 msgr2=0x7fefe81dd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.528+0000 7fefe7fff640 1 --2- 172.21.15.78:0/1899395320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefe806e6e0 0x7fefe81dd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.528+0000 7fefe7fff640 1 -- 172.21.15.78:0/1899395320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefe806eb00 msgr2=0x7fefe80b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.528+0000 7fefe7fff640 1 --2- 172.21.15.78:0/1899395320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefe806eb00 0x7fefe80b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.528+0000 7fefe7fff640 1 -- 172.21.15.78:0/1899395320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe80b2350 con 0x7fefe80b6810 2024-09-15T22:09:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.528+0000 7fefe7fff640 1 --2- 172.21.15.78:0/1899395320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefe80b6810 0x7fefe80a0f70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fefe0034040 tx=0x7fefe0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.528+0000 7fefcffff640 1 -- 172.21.15.78:0/1899395320 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0036050 con 0x7fefe80b6810 2024-09-15T22:09:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.528+0000 7fefcffff640 1 -- 172.21.15.78:0/1899395320 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe0042070 con 0x7fefe80b6810 2024-09-15T22:09:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.528+0000 7fefcffff640 1 -- 172.21.15.78:0/1899395320 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0009510 con 0x7fefe80b6810 2024-09-15T22:09:17.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.528+0000 7fefedd8d640 1 -- 172.21.15.78:0/1899395320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe80b08c0 con 0x7fefe80b6810 2024-09-15T22:09:17.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.528+0000 7fefedd8d640 1 -- 172.21.15.78:0/1899395320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe80a17b0 con 0x7fefe80b6810 2024-09-15T22:09:17.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.529+0000 7fefedd8d640 1 -- 172.21.15.78:0/1899395320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe80b6bf0 con 0x7fefe80b6810 2024-09-15T22:09:17.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.529+0000 7fefcffff640 1 -- 172.21.15.78:0/1899395320 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fefe0007bd0 con 0x7fefe80b6810 2024-09-15T22:09:17.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.530+0000 7fefcffff640 1 --2- 172.21.15.78:0/1899395320 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fefd406c2b0 0x7fefd406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:17.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.530+0000 7fefe77fe640 1 --2- 172.21.15.78:0/1899395320 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fefd406c2b0 0x7fefd406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:17.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.530+0000 7fefcffff640 1 -- 172.21.15.78:0/1899395320 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fefe00ac380 con 0x7fefe80b6810 2024-09-15T22:09:17.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.530+0000 7fefe77fe640 1 --2- 172.21.15.78:0/1899395320 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fefd406c2b0 0x7fefd406e770 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009890 tx=0x7fefd8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:17.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.534+0000 7fefcffff640 1 -- 172.21.15.78:0/1899395320 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fefe80b2350 con 0x7fefe80b6810 2024-09-15T22:09:17.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:17.709+0000 7fefedd8d640 1 -- 172.21.15.78:0/1899395320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fefe809d9d0 con 0x7fefe80b6810 2024-09-15T22:09:18.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.389+0000 7fefcffff640 1 -- 172.21.15.78:0/1899395320 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7fefe007a4a0 con 0x7fefe80b6810 2024-09-15T22:09:18.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.391+0000 7fefedd8d640 1 -- 172.21.15.78:0/1899395320 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fefd406c2b0 msgr2=0x7fefd406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:18.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.391+0000 7fefedd8d640 1 --2- 172.21.15.78:0/1899395320 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fefd406c2b0 0x7fefd406e770 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009890 tx=0x7fefd8008040 comp rx=0 tx=0).stop 2024-09-15T22:09:18.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.391+0000 7fefedd8d640 1 -- 172.21.15.78:0/1899395320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefe80b6810 msgr2=0x7fefe80a0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:18.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.391+0000 7fefedd8d640 1 --2- 172.21.15.78:0/1899395320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefe80b6810 0x7fefe80a0f70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fefe0034040 tx=0x7fefe0004a40 comp rx=0 tx=0).stop 2024-09-15T22:09:18.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.392+0000 7fefedd8d640 1 -- 172.21.15.78:0/1899395320 shutdown_connections 2024-09-15T22:09:18.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.392+0000 7fefedd8d640 1 --2- 172.21.15.78:0/1899395320 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fefd406c2b0 0x7fefd406e770 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:18.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.392+0000 7fefedd8d640 1 --2- 172.21.15.78:0/1899395320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefe80b6810 0x7fefe80a0f70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:18.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.392+0000 7fefedd8d640 1 --2- 172.21.15.78:0/1899395320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefe806eb00 0x7fefe80b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:18.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.392+0000 7fefedd8d640 1 --2- 172.21.15.78:0/1899395320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefe806e6e0 0x7fefe81dd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:18.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.392+0000 7fefedd8d640 1 -- 172.21.15.78:0/1899395320 >> 172.21.15.78:0/1899395320 conn(0x7fefe809d310 msgr2=0x7fefe8149700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:18.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.392+0000 7fefedd8d640 1 -- 172.21.15.78:0/1899395320 shutdown_connections 2024-09-15T22:09:18.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.392+0000 7fefedd8d640 1 -- 172.21.15.78:0/1899395320 wait complete. 2024-09-15T22:09:18.407 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:09:18.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.516+0000 7f4270186640 1 Processor -- start 2024-09-15T22:09:18.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.516+0000 7f4270186640 1 -- start start 2024-09-15T22:09:18.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.517+0000 7f4270186640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42680ba270 0x7f42680b97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:18.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.517+0000 7f4270186640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4268141ba0 0x7f42680b8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:18.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.517+0000 7f4270186640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4268142050 con 0x7f4268141760 2024-09-15T22:09:18.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.517+0000 7f4270186640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f42680b5f30 con 0x7f4268141ba0 2024-09-15T22:09:18.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.517+0000 7f4270186640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f42680ba650 con 0x7f42680ba270 2024-09-15T22:09:18.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.517+0000 7f426e723640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4268141ba0 0x7f42680b8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:18.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.517+0000 7f426e723640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4268141ba0 0x7f42680b8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43124/0 (socket says 172.21.15.78:43124) 2024-09-15T22:09:18.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.517+0000 7f426e723640 1 -- 172.21.15.78:0/571492957 learned_addr learned my addr 172.21.15.78:0/571492957 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:18.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.517+0000 7f426df22640 1 --2- 172.21.15.78:0/571492957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42680ba270 0x7f42680b97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:18.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.518+0000 7f426e723640 1 -- 172.21.15.78:0/571492957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42680ba270 msgr2=0x7f42680b97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:18.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.518+0000 7f426e723640 1 --2- 172.21.15.78:0/571492957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42680ba270 0x7f42680b97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:18.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.518+0000 7f426e723640 1 -- 172.21.15.78:0/571492957 >> v1:172.21.15.175:6789/0 conn(0x7f4268141760 legacy=0x7f42680b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:18.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.518+0000 7f426e723640 1 -- 172.21.15.78:0/571492957 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42680b51b0 con 0x7f4268141ba0 2024-09-15T22:09:18.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.518+0000 7f426df22640 1 --2- 172.21.15.78:0/571492957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42680ba270 0x7f42680b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:18.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.518+0000 7f426e723640 1 --2- 172.21.15.78:0/571492957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4268141ba0 0x7f42680b8680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4260009e50 tx=0x7f426002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf96dec035af02f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:18.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.518+0000 7f426cf20640 1 -- 172.21.15.78:0/571492957 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4260036070 con 0x7f4268141ba0 2024-09-15T22:09:18.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.518+0000 7f426cf20640 1 -- 172.21.15.78:0/571492957 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4260031600 con 0x7f4268141ba0 2024-09-15T22:09:18.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.518+0000 7f426cf20640 1 -- 172.21.15.78:0/571492957 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42600319d0 con 0x7f4268141ba0 2024-09-15T22:09:18.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.519+0000 7f4270186640 1 -- 172.21.15.78:0/571492957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4268141ba0 msgr2=0x7f42680b8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:18.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.519+0000 7f4270186640 1 --2- 172.21.15.78:0/571492957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4268141ba0 0x7f42680b8680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4260009e50 tx=0x7f426002a680 comp rx=0 tx=0).stop 2024-09-15T22:09:18.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.519+0000 7f4270186640 1 -- 172.21.15.78:0/571492957 shutdown_connections 2024-09-15T22:09:18.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.519+0000 7f4270186640 1 --2- 172.21.15.78:0/571492957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4268141ba0 0x7f42680b8680 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:18.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.519+0000 7f4270186640 1 --2- 172.21.15.78:0/571492957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42680ba270 0x7f42680b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:18.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.519+0000 7f4270186640 1 -- 172.21.15.78:0/571492957 >> 172.21.15.78:0/571492957 conn(0x7f4268074ba0 msgr2=0x7f4268074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:18.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.519+0000 7f4270186640 1 -- 172.21.15.78:0/571492957 shutdown_connections 2024-09-15T22:09:18.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.519+0000 7f4270186640 1 -- 172.21.15.78:0/571492957 wait complete. 2024-09-15T22:09:18.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.520+0000 7f4270186640 1 Processor -- start 2024-09-15T22:09:18.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.520+0000 7f4270186640 1 -- start start 2024-09-15T22:09:18.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f4270186640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42680ba270 0x7f426813ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:18.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f4270186640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4268141760 0x7f42681dd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:18.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f4270186640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4268141ba0 0x7f42681ddd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:18.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f4270186640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42680b5bc0 con 0x7f4268141760 2024-09-15T22:09:18.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f4270186640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f42680b58e0 con 0x7f42680ba270 2024-09-15T22:09:18.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f4270186640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f42680b9d20 con 0x7f4268141ba0 2024-09-15T22:09:18.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f426d721640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4268141760 0x7f42681dd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:18.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f426df22640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42680ba270 0x7f426813ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:18.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f426d721640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4268141760 0x7f42681dd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43130/0 (socket says 172.21.15.78:43130) 2024-09-15T22:09:18.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f426df22640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42680ba270 0x7f426813ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.78:56600/0 (socket says 172.21.15.78:56600) 2024-09-15T22:09:18.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f426d721640 1 -- 172.21.15.78:0/703736331 learned_addr learned my addr 172.21.15.78:0/703736331 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f426e723640 1 --2- 172.21.15.78:0/703736331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4268141ba0 0x7f42681ddd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f426d721640 1 -- 172.21.15.78:0/703736331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4268141ba0 msgr2=0x7f42681ddd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f426d721640 1 --2- 172.21.15.78:0/703736331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4268141ba0 0x7f42681ddd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f426d721640 1 -- 172.21.15.78:0/703736331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42680ba270 msgr2=0x7f426813ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f426d721640 1 --2- 172.21.15.78:0/703736331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42680ba270 0x7f426813ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f426d721640 1 -- 172.21.15.78:0/703736331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426813a6f0 con 0x7f4268141760 2024-09-15T22:09:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f426d721640 1 --2- 172.21.15.78:0/703736331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4268141760 0x7f42681dd7d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f425800c440 tx=0x7f425800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f425e7fc640 1 -- 172.21.15.78:0/703736331 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42580052d0 con 0x7f4268141760 2024-09-15T22:09:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f425e7fc640 1 -- 172.21.15.78:0/703736331 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4258005470 con 0x7f4268141760 2024-09-15T22:09:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f4270186640 1 -- 172.21.15.78:0/703736331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42680be000 con 0x7f4268141760 2024-09-15T22:09:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.521+0000 7f425e7fc640 1 -- 172.21.15.78:0/703736331 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258007260 con 0x7f4268141760 2024-09-15T22:09:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.522+0000 7f4270186640 1 -- 172.21.15.78:0/703736331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f426813a410 con 0x7f4268141760 2024-09-15T22:09:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.523+0000 7f4270186640 1 -- 172.21.15.78:0/703736331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42680b7950 con 0x7f4268141760 2024-09-15T22:09:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.523+0000 7f425e7fc640 1 -- 172.21.15.78:0/703736331 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f42580074c0 con 0x7f4268141760 2024-09-15T22:09:18.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.523+0000 7f425e7fc640 1 --2- 172.21.15.78:0/703736331 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f424c06c2b0 0x7f424c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:18.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.524+0000 7f425e7fc640 1 -- 172.21.15.78:0/703736331 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f425808a8b0 con 0x7f4268141760 2024-09-15T22:09:18.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.524+0000 7f426df22640 1 --2- 172.21.15.78:0/703736331 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f424c06c2b0 0x7f424c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:18.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.524+0000 7f426df22640 1 --2- 172.21.15.78:0/703736331 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f424c06c2b0 0x7f424c06e770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f426813b4f0 tx=0x7f4264008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:18.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.528+0000 7f425e7fc640 1 -- 172.21.15.78:0/703736331 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4258058930 con 0x7f4268141760 2024-09-15T22:09:18.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:18.694+0000 7f4270186640 1 -- 172.21.15.78:0/703736331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f42680bce90 con 0x7f4268141760 2024-09-15T22:09:20.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.423+0000 7f425e7fc640 1 -- 172.21.15.78:0/703736331 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f425805cc30 con 0x7f4268141760 2024-09-15T22:09:20.425 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data_ec' created 2024-09-15T22:09:20.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.426+0000 7f4270186640 1 -- 172.21.15.78:0/703736331 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f424c06c2b0 msgr2=0x7f424c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:20.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.426+0000 7f4270186640 1 --2- 172.21.15.78:0/703736331 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f424c06c2b0 0x7f424c06e770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f426813b4f0 tx=0x7f4264008040 comp rx=0 tx=0).stop 2024-09-15T22:09:20.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.426+0000 7f4270186640 1 -- 172.21.15.78:0/703736331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4268141760 msgr2=0x7f42681dd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:20.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.426+0000 7f4270186640 1 --2- 172.21.15.78:0/703736331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4268141760 0x7f42681dd7d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f425800c440 tx=0x7f425800c900 comp rx=0 tx=0).stop 2024-09-15T22:09:20.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.426+0000 7f4270186640 1 -- 172.21.15.78:0/703736331 shutdown_connections 2024-09-15T22:09:20.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.426+0000 7f4270186640 1 --2- 172.21.15.78:0/703736331 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f424c06c2b0 0x7f424c06e770 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:20.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.426+0000 7f4270186640 1 --2- 172.21.15.78:0/703736331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4268141ba0 0x7f42681ddd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:20.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.426+0000 7f4270186640 1 --2- 172.21.15.78:0/703736331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4268141760 0x7f42681dd7d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:20.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.426+0000 7f4270186640 1 --2- 172.21.15.78:0/703736331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42680ba270 0x7f426813ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:20.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.426+0000 7f4270186640 1 -- 172.21.15.78:0/703736331 >> 172.21.15.78:0/703736331 conn(0x7f4268074ba0 msgr2=0x7f4268143ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:20.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.426+0000 7f4270186640 1 -- 172.21.15.78:0/703736331 shutdown_connections 2024-09-15T22:09:20.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.426+0000 7f4270186640 1 -- 172.21.15.78:0/703736331 wait complete. 2024-09-15T22:09:20.448 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-15T22:09:20.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.552+0000 7f335d67b640 1 Processor -- start 2024-09-15T22:09:20.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.552+0000 7f335d67b640 1 -- start start 2024-09-15T22:09:20.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f335d67b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f33580be0e0 0x7f335809c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:20.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f335d67b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33580be4c0 con 0x7f3358144cb0 2024-09-15T22:09:20.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f335d67b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f335806d1d0 con 0x7f335806cb00 2024-09-15T22:09:20.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f335d67b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f33580bbd10 con 0x7f33580be0e0 2024-09-15T22:09:20.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f33577fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3358144cb0 0x7f3358145120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38384/0 (socket says 172.21.15.78:38384) 2024-09-15T22:09:20.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f33577fe640 1 -- 172.21.15.78:0/3915563723 learned_addr learned my addr 172.21.15.78:0/3915563723 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:20.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f33567fc640 1 -- 172.21.15.78:0/3915563723 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4035382241 0 0) 0x7f33580be4c0 con 0x7f3358144cb0 2024-09-15T22:09:20.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f33567fc640 1 -- 172.21.15.78:0/3915563723 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3344003520 con 0x7f3358144cb0 2024-09-15T22:09:20.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f3356ffd640 1 --2- 172.21.15.78:0/3915563723 >> v2:172.21.15.175:3300/0 conn(0x7f33580be0e0 0x7f335809c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:20.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f33567fc640 1 -- 172.21.15.78:0/3915563723 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2787356268 0 0) 0x7f3344003520 con 0x7f3358144cb0 2024-09-15T22:09:20.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f33567fc640 1 -- 172.21.15.78:0/3915563723 >> v2:172.21.15.175:3300/0 conn(0x7f33580be0e0 msgr2=0x7f335809c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:20.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f33567fc640 1 --2- 172.21.15.78:0/3915563723 >> v2:172.21.15.175:3300/0 conn(0x7f33580be0e0 0x7f335809c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:20.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f33567fc640 1 -- 172.21.15.78:0/3915563723 >> v1:172.21.15.175:6789/0 conn(0x7f335806cb00 legacy=0x7f3358147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:20.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f33567fc640 1 -- 172.21.15.78:0/3915563723 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335806d4b0 con 0x7f3358144cb0 2024-09-15T22:09:20.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f33567fc640 1 -- 172.21.15.78:0/3915563723 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3961011974 0 0) 0x7f33500019f0 con 0x7f3358144cb0 2024-09-15T22:09:20.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.553+0000 7f33567fc640 1 -- 172.21.15.78:0/3915563723 >> v1:172.21.15.78:6789/0 conn(0x7f3358144cb0 legacy=0x7f3358145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:20.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.554+0000 7f33567fc640 1 --2- 172.21.15.78:0/3915563723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33440039b0 0x7f3344003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:20.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.554+0000 7f33567fc640 1 --2- 172.21.15.78:0/3915563723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3344004800 0x7f3344004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:20.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.554+0000 7f33567fc640 1 --2- 172.21.15.78:0/3915563723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33440052e0 0x7f334400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:20.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.554+0000 7f33567fc640 1 -- 172.21.15.78:0/3915563723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f33580bbd10 con 0x7f3344004800 2024-09-15T22:09:20.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.554+0000 7f33567fc640 1 -- 172.21.15.78:0/3915563723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f334400c1b0 con 0x7f33440039b0 2024-09-15T22:09:20.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.554+0000 7f33567fc640 1 -- 172.21.15.78:0/3915563723 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f334400c3b0 con 0x7f33440052e0 2024-09-15T22:09:20.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.554+0000 7f334e7fc640 1 --2- 172.21.15.78:0/3915563723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3344004800 0x7f3344004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:20.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.554+0000 7f3356ffd640 1 --2- 172.21.15.78:0/3915563723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33440039b0 0x7f3344003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:20.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.554+0000 7f33577fe640 1 --2- 172.21.15.78:0/3915563723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33440052e0 0x7f334400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:20.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.554+0000 7f334e7fc640 1 -- 172.21.15.78:0/3915563723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33440052e0 msgr2=0x7f334400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:20.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.554+0000 7f334e7fc640 1 --2- 172.21.15.78:0/3915563723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33440052e0 0x7f334400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:20.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.554+0000 7f334e7fc640 1 -- 172.21.15.78:0/3915563723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33440039b0 msgr2=0x7f3344003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:20.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.554+0000 7f334e7fc640 1 --2- 172.21.15.78:0/3915563723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33440039b0 0x7f3344003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:20.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.554+0000 7f334e7fc640 1 -- 172.21.15.78:0/3915563723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3344003520 con 0x7f3344004800 2024-09-15T22:09:20.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.554+0000 7f33577fe640 1 -- 172.21.15.78:0/3915563723 reap_dead start 2024-09-15T22:09:20.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.555+0000 7f334e7fc640 1 --2- 172.21.15.78:0/3915563723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3344004800 0x7f3344004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f335806cf70 tx=0x7f3344005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5521bc7ee29b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:20.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.555+0000 7f33567fc640 1 -- 172.21.15.78:0/3915563723 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3340001370 con 0x7f3344004800 2024-09-15T22:09:20.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.555+0000 7f33567fc640 1 -- 172.21.15.78:0/3915563723 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33400052d0 con 0x7f3344004800 2024-09-15T22:09:20.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.555+0000 7f33567fc640 1 -- 172.21.15.78:0/3915563723 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334002ab50 con 0x7f3344004800 2024-09-15T22:09:20.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.555+0000 7f335d67b640 1 -- 172.21.15.78:0/3915563723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3344004800 msgr2=0x7f3344004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:20.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.555+0000 7f335d67b640 1 --2- 172.21.15.78:0/3915563723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3344004800 0x7f3344004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f335806cf70 tx=0x7f3344005830 comp rx=0 tx=0).stop 2024-09-15T22:09:20.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.555+0000 7f335d67b640 1 -- 172.21.15.78:0/3915563723 shutdown_connections 2024-09-15T22:09:20.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.555+0000 7f335d67b640 1 --2- 172.21.15.78:0/3915563723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3344004800 0x7f3344004c80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:20.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.555+0000 7f335d67b640 1 -- 172.21.15.78:0/3915563723 >> 172.21.15.78:0/3915563723 conn(0x7f33580751d0 msgr2=0x7f33580bd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:20.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.555+0000 7f335d67b640 1 -- 172.21.15.78:0/3915563723 shutdown_connections 2024-09-15T22:09:20.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.555+0000 7f335d67b640 1 -- 172.21.15.78:0/3915563723 wait complete. 2024-09-15T22:09:20.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.556+0000 7f335d67b640 1 Processor -- start 2024-09-15T22:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.557+0000 7f335d67b640 1 -- start start 2024-09-15T22:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.557+0000 7f335d67b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3344004800 0x7f33580b7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.557+0000 7f335d67b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33580b9920 0x7f33580b8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.557+0000 7f335d67b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33580b8b60 0x7f3358140f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.557+0000 7f335d67b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f335806db00 con 0x7f33580b8b60 2024-09-15T22:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.557+0000 7f335d67b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f335806c670 con 0x7f3344004800 2024-09-15T22:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.557+0000 7f335d67b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f335809c680 con 0x7f33580b9920 2024-09-15T22:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.557+0000 7f33577fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33580b8b60 0x7f3358140f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.557+0000 7f33577fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33580b8b60 0x7f3358140f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50936/0 (socket says 172.21.15.78:50936) 2024-09-15T22:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.557+0000 7f33577fe640 1 -- 172.21.15.78:0/340416972 learned_addr learned my addr 172.21.15.78:0/340416972 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.557+0000 7f3356ffd640 1 --2- 172.21.15.78:0/340416972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3344004800 0x7f33580b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.557+0000 7f334e7fc640 1 --2- 172.21.15.78:0/340416972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33580b9920 0x7f33580b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.558+0000 7f33577fe640 1 -- 172.21.15.78:0/340416972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33580b9920 msgr2=0x7f33580b8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.558+0000 7f33577fe640 1 --2- 172.21.15.78:0/340416972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33580b9920 0x7f33580b8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.558+0000 7f33577fe640 1 -- 172.21.15.78:0/340416972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3344004800 msgr2=0x7f33580b7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.558+0000 7f33577fe640 1 --2- 172.21.15.78:0/340416972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3344004800 0x7f33580b7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.558+0000 7f33577fe640 1 -- 172.21.15.78:0/340416972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33580b8fe0 con 0x7f33580b8b60 2024-09-15T22:09:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.558+0000 7f33577fe640 1 --2- 172.21.15.78:0/340416972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33580b8b60 0x7f3358140f90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3350000f80 tx=0x7f3350007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.558+0000 7f334ffff640 1 -- 172.21.15.78:0/340416972 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335000ab20 con 0x7f33580b8b60 2024-09-15T22:09:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.558+0000 7f334ffff640 1 -- 172.21.15.78:0/340416972 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3350019070 con 0x7f33580b8b60 2024-09-15T22:09:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.558+0000 7f334ffff640 1 -- 172.21.15.78:0/340416972 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33500133f0 con 0x7f33580b8b60 2024-09-15T22:09:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.558+0000 7f335d67b640 1 -- 172.21.15.78:0/340416972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33580b8050 con 0x7f33580b8b60 2024-09-15T22:09:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.558+0000 7f335d67b640 1 -- 172.21.15.78:0/340416972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33580baab0 con 0x7f33580b8b60 2024-09-15T22:09:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.559+0000 7f335d67b640 1 -- 172.21.15.78:0/340416972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33580b8410 con 0x7f33580b8b60 2024-09-15T22:09:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.559+0000 7f334ffff640 1 -- 172.21.15.78:0/340416972 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3350013590 con 0x7f33580b8b60 2024-09-15T22:09:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.560+0000 7f334ffff640 1 --2- 172.21.15.78:0/340416972 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f333806c2b0 0x7f333806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.560+0000 7f3356ffd640 1 --2- 172.21.15.78:0/340416972 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f333806c2b0 0x7f333806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.560+0000 7f334ffff640 1 -- 172.21.15.78:0/340416972 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f335008ba90 con 0x7f33580b8b60 2024-09-15T22:09:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.560+0000 7f3356ffd640 1 --2- 172.21.15.78:0/340416972 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f333806c2b0 0x7f333806e770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3348006fd0 tx=0x7f3348008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.565+0000 7f334ffff640 1 -- 172.21.15.78:0/340416972 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f33580b8fe0 con 0x7f33580b8b60 2024-09-15T22:09:20.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:20.730+0000 7f335d67b640 1 -- 172.21.15.78:0/340416972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f3358147c40 con 0x7f33580b8b60 2024-09-15T22:09:21.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.427+0000 7f334ffff640 1 -- 172.21.15.78:0/340416972 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f3350059920 con 0x7f33580b8b60 2024-09-15T22:09:21.429 INFO:teuthology.orchestra.run.smithi078.stderr:set pool 4 allow_ec_overwrites to true 2024-09-15T22:09:21.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.431+0000 7f335d67b640 1 -- 172.21.15.78:0/340416972 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f333806c2b0 msgr2=0x7f333806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:21.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.431+0000 7f335d67b640 1 --2- 172.21.15.78:0/340416972 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f333806c2b0 0x7f333806e770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3348006fd0 tx=0x7f3348008040 comp rx=0 tx=0).stop 2024-09-15T22:09:21.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.431+0000 7f335d67b640 1 -- 172.21.15.78:0/340416972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33580b8b60 msgr2=0x7f3358140f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:21.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.431+0000 7f335d67b640 1 --2- 172.21.15.78:0/340416972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33580b8b60 0x7f3358140f90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3350000f80 tx=0x7f3350007b20 comp rx=0 tx=0).stop 2024-09-15T22:09:21.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.431+0000 7f335d67b640 1 -- 172.21.15.78:0/340416972 shutdown_connections 2024-09-15T22:09:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.431+0000 7f335d67b640 1 --2- 172.21.15.78:0/340416972 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f333806c2b0 0x7f333806e770 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.431+0000 7f335d67b640 1 --2- 172.21.15.78:0/340416972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33580b8b60 0x7f3358140f90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.431+0000 7f335d67b640 1 --2- 172.21.15.78:0/340416972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33580b9920 0x7f33580b8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.431+0000 7f335d67b640 1 --2- 172.21.15.78:0/340416972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3344004800 0x7f33580b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.431+0000 7f335d67b640 1 -- 172.21.15.78:0/340416972 >> 172.21.15.78:0/340416972 conn(0x7f33580751d0 msgr2=0x7f33580b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.431+0000 7f335d67b640 1 -- 172.21.15.78:0/340416972 shutdown_connections 2024-09-15T22:09:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.431+0000 7f335d67b640 1 -- 172.21.15.78:0/340416972 wait complete. 2024-09-15T22:09:21.463 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-15T22:09:21.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.565+0000 7f323d647640 1 Processor -- start 2024-09-15T22:09:21.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.565+0000 7f323d647640 1 -- start start 2024-09-15T22:09:21.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.566+0000 7f323d647640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f323806d1e0 0x7f3238073130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:21.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.566+0000 7f323d647640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32380722e0 con 0x7f323814b540 2024-09-15T22:09:21.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.566+0000 7f323d647640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f323806cc40 con 0x7f3238072d50 2024-09-15T22:09:21.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.566+0000 7f323d647640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f3238073890 con 0x7f323806d1e0 2024-09-15T22:09:21.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.566+0000 7f32367fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f323806d1e0 0x7f3238073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:21.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.566+0000 7f32367fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f323806d1e0 0x7f3238073130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50952/0 (socket says 172.21.15.78:50952) 2024-09-15T22:09:21.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.566+0000 7f32367fc640 1 -- 172.21.15.78:0/3691247121 learned_addr learned my addr 172.21.15.78:0/3691247121 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:21.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.566+0000 7f32377fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f323814b540 0x7f323814b990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38392/0 (socket says 172.21.15.78:38392) 2024-09-15T22:09:21.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.566+0000 7f32367fc640 1 -- 172.21.15.78:0/3691247121 >> v1:172.21.15.175:6789/0 conn(0x7f3238072d50 legacy=0x7f3238073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:21.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.566+0000 7f32367fc640 1 -- 172.21.15.78:0/3691247121 >> v1:172.21.15.78:6789/0 conn(0x7f323814b540 legacy=0x7f323814b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:21.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.566+0000 7f3235ffb640 1 -- 172.21.15.78:0/3691247121 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2693171900 0 0) 0x7f32380722e0 con 0x7f323814b540 2024-09-15T22:09:21.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.566+0000 7f32367fc640 1 -- 172.21.15.78:0/3691247121 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32380b74c0 con 0x7f323806d1e0 2024-09-15T22:09:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.567+0000 7f32367fc640 1 --2- 172.21.15.78:0/3691247121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f323806d1e0 0x7f3238073130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3238073a10 tx=0x7f322c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca7a1258fec6ca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.567+0000 7f3235ffb640 1 -- 172.21.15.78:0/3691247121 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c037070 con 0x7f323806d1e0 2024-09-15T22:09:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.567+0000 7f3235ffb640 1 -- 172.21.15.78:0/3691247121 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f322c032440 con 0x7f323806d1e0 2024-09-15T22:09:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.567+0000 7f3235ffb640 1 -- 172.21.15.78:0/3691247121 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c032810 con 0x7f323806d1e0 2024-09-15T22:09:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.568+0000 7f323d647640 1 -- 172.21.15.78:0/3691247121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f323806d1e0 msgr2=0x7f3238073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.568+0000 7f323d647640 1 --2- 172.21.15.78:0/3691247121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f323806d1e0 0x7f3238073130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3238073a10 tx=0x7f322c02a1c0 comp rx=0 tx=0).stop 2024-09-15T22:09:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.568+0000 7f323d647640 1 -- 172.21.15.78:0/3691247121 shutdown_connections 2024-09-15T22:09:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.568+0000 7f323d647640 1 --2- 172.21.15.78:0/3691247121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f323806d1e0 0x7f3238073130 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.568+0000 7f323d647640 1 -- 172.21.15.78:0/3691247121 >> 172.21.15.78:0/3691247121 conn(0x7f32380bb390 msgr2=0x7f32380bb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.568+0000 7f323d647640 1 -- 172.21.15.78:0/3691247121 shutdown_connections 2024-09-15T22:09:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.568+0000 7f323d647640 1 -- 172.21.15.78:0/3691247121 wait complete. 2024-09-15T22:09:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.569+0000 7f323d647640 1 Processor -- start 2024-09-15T22:09:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.569+0000 7f323d647640 1 -- start start 2024-09-15T22:09:21.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f323d647640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f323806d1e0 0x7f32380aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f323d647640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3238072d50 0x7f32381e1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f323d647640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f323814b540 0x7f32380b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f323d647640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32380b7260 con 0x7f323806d1e0 2024-09-15T22:09:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f323d647640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f32380725c0 con 0x7f3238072d50 2024-09-15T22:09:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f323d647640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3238153450 con 0x7f323814b540 2024-09-15T22:09:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f3236ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f323806d1e0 0x7f32380aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f3236ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f323806d1e0 0x7f32380aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50968/0 (socket says 172.21.15.78:50968) 2024-09-15T22:09:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f3236ffd640 1 -- 172.21.15.78:0/1783729918 learned_addr learned my addr 172.21.15.78:0/1783729918 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f3236ffd640 1 -- 172.21.15.78:0/1783729918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f323814b540 msgr2=0x7f32380b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f3236ffd640 1 --2- 172.21.15.78:0/1783729918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f323814b540 0x7f32380b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f3236ffd640 1 -- 172.21.15.78:0/1783729918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3238072d50 msgr2=0x7f32381e1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f3236ffd640 1 --2- 172.21.15.78:0/1783729918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3238072d50 0x7f32381e1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f3236ffd640 1 -- 172.21.15.78:0/1783729918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32380b14d0 con 0x7f323806d1e0 2024-09-15T22:09:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f3236ffd640 1 --2- 172.21.15.78:0/1783729918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f323806d1e0 0x7f32380aee10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f322800c870 tx=0x7f322800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:21.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f321f7fe640 1 -- 172.21.15.78:0/1783729918 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3228003b70 con 0x7f323806d1e0 2024-09-15T22:09:21.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f321f7fe640 1 -- 172.21.15.78:0/1783729918 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3228003d30 con 0x7f323806d1e0 2024-09-15T22:09:21.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f323d647640 1 -- 172.21.15.78:0/1783729918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32381e0930 con 0x7f323806d1e0 2024-09-15T22:09:21.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f321f7fe640 1 -- 172.21.15.78:0/1783729918 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322800aa90 con 0x7f323806d1e0 2024-09-15T22:09:21.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.570+0000 7f323d647640 1 -- 172.21.15.78:0/1783729918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32381452b0 con 0x7f323806d1e0 2024-09-15T22:09:21.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.571+0000 7f323d647640 1 -- 172.21.15.78:0/1783729918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32380b1860 con 0x7f323806d1e0 2024-09-15T22:09:21.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.572+0000 7f321f7fe640 1 -- 172.21.15.78:0/1783729918 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f322800ac30 con 0x7f323806d1e0 2024-09-15T22:09:21.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.572+0000 7f321f7fe640 1 --2- 172.21.15.78:0/1783729918 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f322406c2e0 0x7f322406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:21.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.572+0000 7f321f7fe640 1 -- 172.21.15.78:0/1783729918 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f322808b620 con 0x7f323806d1e0 2024-09-15T22:09:21.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.572+0000 7f32367fc640 1 --2- 172.21.15.78:0/1783729918 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f322406c2e0 0x7f322406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:21.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.573+0000 7f32367fc640 1 --2- 172.21.15.78:0/1783729918 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f322406c2e0 0x7f322406e7a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f322c034000 tx=0x7f322c02c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:21.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.577+0000 7f321f7fe640 1 -- 172.21.15.78:0/1783729918 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32380b1860 con 0x7f323806d1e0 2024-09-15T22:09:21.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:21.779+0000 7f323d647640 1 -- 172.21.15.78:0/1783729918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f3238073130 con 0x7f323806d1e0 2024-09-15T22:09:22.379 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-09-15T22:09:22.377+0000 7fc7d1ee1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:09:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.433+0000 7f321f7fe640 1 -- 172.21.15.78:0/1783729918 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f32380b14d0 con 0x7f323806d1e0 2024-09-15T22:09:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:added data pool 4 to fsmap 2024-09-15T22:09:22.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.436+0000 7f323d647640 1 -- 172.21.15.78:0/1783729918 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f322406c2e0 msgr2=0x7f322406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:22.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.436+0000 7f323d647640 1 --2- 172.21.15.78:0/1783729918 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f322406c2e0 0x7f322406e7a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f322c034000 tx=0x7f322c02c000 comp rx=0 tx=0).stop 2024-09-15T22:09:22.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.436+0000 7f323d647640 1 -- 172.21.15.78:0/1783729918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f323806d1e0 msgr2=0x7f32380aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:22.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.436+0000 7f323d647640 1 --2- 172.21.15.78:0/1783729918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f323806d1e0 0x7f32380aee10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f322800c870 tx=0x7f322800cd30 comp rx=0 tx=0).stop 2024-09-15T22:09:22.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.436+0000 7f323d647640 1 -- 172.21.15.78:0/1783729918 shutdown_connections 2024-09-15T22:09:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.436+0000 7f323d647640 1 --2- 172.21.15.78:0/1783729918 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f322406c2e0 0x7f322406e7a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.436+0000 7f323d647640 1 --2- 172.21.15.78:0/1783729918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f323814b540 0x7f32380b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.436+0000 7f323d647640 1 --2- 172.21.15.78:0/1783729918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3238072d50 0x7f32381e1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.436+0000 7f323d647640 1 --2- 172.21.15.78:0/1783729918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f323806d1e0 0x7f32380aee10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.436+0000 7f323d647640 1 -- 172.21.15.78:0/1783729918 >> 172.21.15.78:0/1783729918 conn(0x7f32380bb390 msgr2=0x7f32380b9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.436+0000 7f323d647640 1 -- 172.21.15.78:0/1783729918 shutdown_connections 2024-09-15T22:09:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.436+0000 7f323d647640 1 -- 172.21.15.78:0/1783729918 wait complete. 2024-09-15T22:09:22.450 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:09:22.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.547+0000 7fe1ebee4640 1 Processor -- start 2024-09-15T22:09:22.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.547+0000 7fe1ebee4640 1 -- start start 2024-09-15T22:09:22.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.548+0000 7fe1ebee4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe1e40753b0 0x7fe1e409ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:22.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.548+0000 7fe1ebee4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e4149980 con 0x7fe1e40b4d40 2024-09-15T22:09:22.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.548+0000 7fe1ebee4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e4149c60 con 0x7fe1e409fbe0 2024-09-15T22:09:22.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.548+0000 7fe1ebee4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fe1e40b60f0 con 0x7fe1e40753b0 2024-09-15T22:09:22.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.548+0000 7fe1e947f640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe1e40b4d40 0x7fe1e4074ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38396/0 (socket says 172.21.15.78:38396) 2024-09-15T22:09:22.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.548+0000 7fe1e947f640 1 -- 172.21.15.78:0/987623838 learned_addr learned my addr 172.21.15.78:0/987623838 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:22.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.548+0000 7fe1ea481640 1 --2- 172.21.15.78:0/987623838 >> v2:172.21.15.78:3300/0 conn(0x7fe1e40753b0 0x7fe1e409ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:22.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.548+0000 7fe1e8c7e640 1 -- 172.21.15.78:0/987623838 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2618790792 0 0) 0x7fe1e4149980 con 0x7fe1e40b4d40 2024-09-15T22:09:22.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.548+0000 7fe1e8c7e640 1 -- 172.21.15.78:0/987623838 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1d0003520 con 0x7fe1e40b4d40 2024-09-15T22:09:22.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.548+0000 7fe1ea481640 1 -- 172.21.15.78:0/987623838 >> v1:172.21.15.175:6789/0 conn(0x7fe1e409fbe0 legacy=0x7fe1e4148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:22.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.548+0000 7fe1ea481640 1 -- 172.21.15.78:0/987623838 >> v1:172.21.15.78:6789/0 conn(0x7fe1e40b4d40 legacy=0x7fe1e4074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:22.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.548+0000 7fe1ea481640 1 -- 172.21.15.78:0/987623838 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e4149690 con 0x7fe1e40753b0 2024-09-15T22:09:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.549+0000 7fe1ea481640 1 --2- 172.21.15.78:0/987623838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e40753b0 0x7fe1e409ffc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009d90 tx=0x7fe1dc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f4912abefec5db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.549+0000 7fe1e8c7e640 1 -- 172.21.15.78:0/987623838 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc007740 con 0x7fe1e40753b0 2024-09-15T22:09:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.549+0000 7fe1e8c7e640 1 -- 172.21.15.78:0/987623838 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1dc0078e0 con 0x7fe1e40753b0 2024-09-15T22:09:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.549+0000 7fe1e8c7e640 1 -- 172.21.15.78:0/987623838 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc007cb0 con 0x7fe1e40753b0 2024-09-15T22:09:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.550+0000 7fe1ebee4640 1 -- 172.21.15.78:0/987623838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e40753b0 msgr2=0x7fe1e409ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.550+0000 7fe1ebee4640 1 --2- 172.21.15.78:0/987623838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e40753b0 0x7fe1e409ffc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009d90 tx=0x7fe1dc02a660 comp rx=0 tx=0).stop 2024-09-15T22:09:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.550+0000 7fe1ebee4640 1 -- 172.21.15.78:0/987623838 shutdown_connections 2024-09-15T22:09:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.550+0000 7fe1ebee4640 1 --2- 172.21.15.78:0/987623838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e40753b0 0x7fe1e409ffc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.550+0000 7fe1ebee4640 1 -- 172.21.15.78:0/987623838 >> 172.21.15.78:0/987623838 conn(0x7fe1e409c0f0 msgr2=0x7fe1e409c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.550+0000 7fe1ebee4640 1 -- 172.21.15.78:0/987623838 shutdown_connections 2024-09-15T22:09:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.550+0000 7fe1ebee4640 1 -- 172.21.15.78:0/987623838 wait complete. 2024-09-15T22:09:22.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.551+0000 7fe1ebee4640 1 Processor -- start 2024-09-15T22:09:22.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.551+0000 7fe1ebee4640 1 -- start start 2024-09-15T22:09:22.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.551+0000 7fe1ebee4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1e40753b0 0x7fe1e4142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:22.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.551+0000 7fe1ebee4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1e409fbe0 0x7fe1e4145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:22.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.551+0000 7fe1ebee4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e40b4d40 0x7fe1e4145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:22.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.551+0000 7fe1ebee4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e4151650 con 0x7fe1e40b4d40 2024-09-15T22:09:22.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.551+0000 7fe1ebee4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e41514d0 con 0x7fe1e40753b0 2024-09-15T22:09:22.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.551+0000 7fe1ebee4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e41517d0 con 0x7fe1e409fbe0 2024-09-15T22:09:22.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1ea481640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e40b4d40 0x7fe1e4145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:22.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1ea481640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e40b4d40 0x7fe1e4145890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50988/0 (socket says 172.21.15.78:50988) 2024-09-15T22:09:22.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1ea481640 1 -- 172.21.15.78:0/3668179697 learned_addr learned my addr 172.21.15.78:0/3668179697 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:22.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1e9c80640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1e40753b0 0x7fe1e4142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:22.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1ea481640 1 -- 172.21.15.78:0/3668179697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1e409fbe0 msgr2=0x7fe1e4145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:22.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1e947f640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1e409fbe0 0x7fe1e4145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:22.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1ea481640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1e409fbe0 0x7fe1e4145350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1ea481640 1 -- 172.21.15.78:0/3668179697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1e40753b0 msgr2=0x7fe1e4142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1ea481640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1e40753b0 0x7fe1e4142be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1ea481640 1 -- 172.21.15.78:0/3668179697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e41432c0 con 0x7fe1e40b4d40 2024-09-15T22:09:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1e9c80640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1e40753b0 0x7fe1e4142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1e947f640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1e409fbe0 0x7fe1e4145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1ea481640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e40b4d40 0x7fe1e4145890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc02ac50 tx=0x7fe1dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1da7fc640 1 -- 172.21.15.78:0/3668179697 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc040070 con 0x7fe1e40b4d40 2024-09-15T22:09:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1da7fc640 1 -- 172.21.15.78:0/3668179697 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1dc031bc0 con 0x7fe1e40b4d40 2024-09-15T22:09:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1da7fc640 1 -- 172.21.15.78:0/3668179697 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc009450 con 0x7fe1e40b4d40 2024-09-15T22:09:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1ebee4640 1 -- 172.21.15.78:0/3668179697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e4142310 con 0x7fe1e40b4d40 2024-09-15T22:09:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.552+0000 7fe1ebee4640 1 -- 172.21.15.78:0/3668179697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e4146310 con 0x7fe1e40b4d40 2024-09-15T22:09:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.553+0000 7fe1ebee4640 1 -- 172.21.15.78:0/3668179697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e409ffc0 con 0x7fe1e40b4d40 2024-09-15T22:09:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.554+0000 7fe1da7fc640 1 -- 172.21.15.78:0/3668179697 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe1dc039040 con 0x7fe1e40b4d40 2024-09-15T22:09:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.554+0000 7fe1da7fc640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe1c806c2b0 0x7fe1c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.554+0000 7fe1e9c80640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe1c806c2b0 0x7fe1c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.554+0000 7fe1da7fc640 1 -- 172.21.15.78:0/3668179697 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe1dc0acf40 con 0x7fe1e40b4d40 2024-09-15T22:09:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.554+0000 7fe1e9c80640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe1c806c2b0 0x7fe1c806e770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0007fd0 tx=0x7fe1e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:22.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.558+0000 7fe1da7fc640 1 -- 172.21.15.78:0/3668179697 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1e41432c0 con 0x7fe1e40b4d40 2024-09-15T22:09:22.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.756+0000 7fe1ebee4640 1 -- 172.21.15.78:0/3668179697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1e40b5e10 con 0x7fe1e40b4d40 2024-09-15T22:09:22.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.757+0000 7fe1da7fc640 1 -- 172.21.15.78:0/3668179697 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3574 (secure 0 0 0) 0x7fe1dc03ae60 con 0x7fe1e40b4d40 2024-09-15T22:09:22.759 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:22.759 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":7,"btime":"2024-09-15T22:09:22:429192+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1036052633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1036052633},{"type":"v1","addr":"172.21.15.78:6835","nonce":1036052633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:09:16.727586+0000","modified":"2024-09-15T22:09:21.780719+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6833/4038139714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":4038139714},{"type":"v1","addr":"172.21.15.175:6833","nonce":4038139714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-09-15T22:09:22.760 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 7 2024-09-15T22:09:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.758+0000 7fe1ebee4640 1 -- 172.21.15.78:0/3668179697 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe1c806c2b0 msgr2=0x7fe1c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.758+0000 7fe1ebee4640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe1c806c2b0 0x7fe1c806e770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0007fd0 tx=0x7fe1e0009040 comp rx=0 tx=0).stop 2024-09-15T22:09:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.758+0000 7fe1ebee4640 1 -- 172.21.15.78:0/3668179697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e40b4d40 msgr2=0x7fe1e4145890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.758+0000 7fe1ebee4640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e40b4d40 0x7fe1e4145890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc02ac50 tx=0x7fe1dc004a40 comp rx=0 tx=0).stop 2024-09-15T22:09:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.758+0000 7fe1ebee4640 1 -- 172.21.15.78:0/3668179697 shutdown_connections 2024-09-15T22:09:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.758+0000 7fe1ebee4640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe1c806c2b0 0x7fe1c806e770 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.758+0000 7fe1ebee4640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1e40b4d40 0x7fe1e4145890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.758+0000 7fe1ebee4640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1e409fbe0 0x7fe1e4145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.758+0000 7fe1ebee4640 1 --2- 172.21.15.78:0/3668179697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1e40753b0 0x7fe1e4142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.758+0000 7fe1ebee4640 1 -- 172.21.15.78:0/3668179697 >> 172.21.15.78:0/3668179697 conn(0x7fe1e409c0f0 msgr2=0x7fe1e406d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.759+0000 7fe1ebee4640 1 -- 172.21.15.78:0/3668179697 shutdown_connections 2024-09-15T22:09:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.759+0000 7fe1ebee4640 1 -- 172.21.15.78:0/3668179697 wait complete. 2024-09-15T22:09:22.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:09:22.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.868+0000 7efc399b7640 1 Processor -- start 2024-09-15T22:09:22.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.869+0000 7efc399b7640 1 -- start start 2024-09-15T22:09:22.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.869+0000 7efc399b7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efc340b7370 0x7efc3406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:22.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.869+0000 7efc399b7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efc3414bca0 0x7efc340b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:22.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.869+0000 7efc399b7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc3406ea30 con 0x7efc341481f0 2024-09-15T22:09:22.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.869+0000 7efc399b7640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7efc340b6900 con 0x7efc3414bca0 2024-09-15T22:09:22.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.869+0000 7efc399b7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7efc3414b1c0 con 0x7efc340b7370 2024-09-15T22:09:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.869+0000 7efc327fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efc3414bca0 0x7efc340b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.869+0000 7efc327fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efc3414bca0 0x7efc340b7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51000/0 (socket says 172.21.15.78:51000) 2024-09-15T22:09:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.869+0000 7efc327fc640 1 -- 172.21.15.78:0/3045436177 learned_addr learned my addr 172.21.15.78:0/3045436177 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.869+0000 7efc32ffd640 1 --2- 172.21.15.78:0/3045436177 >> v2:172.21.15.175:3300/0 conn(0x7efc340b7370 0x7efc3406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.870+0000 7efc327fc640 1 -- 172.21.15.78:0/3045436177 >> v2:172.21.15.175:3300/0 conn(0x7efc340b7370 msgr2=0x7efc3406e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.870+0000 7efc327fc640 1 --2- 172.21.15.78:0/3045436177 >> v2:172.21.15.175:3300/0 conn(0x7efc340b7370 0x7efc3406e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.870+0000 7efc327fc640 1 -- 172.21.15.78:0/3045436177 >> v1:172.21.15.175:6789/0 conn(0x7efc341481f0 legacy=0x7efc340ba1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.870+0000 7efc327fc640 1 -- 172.21.15.78:0/3045436177 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3414b4a0 con 0x7efc3414bca0 2024-09-15T22:09:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.870+0000 7efc327fc640 1 --2- 172.21.15.78:0/3045436177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc3414bca0 0x7efc340b7750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc34070fe0 tx=0x7efc1c02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6c9c410b5c35a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.870+0000 7efc31ffb640 1 -- 172.21.15.78:0/3045436177 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1c037070 con 0x7efc3414bca0 2024-09-15T22:09:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.870+0000 7efc31ffb640 1 -- 172.21.15.78:0/3045436177 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc1c032440 con 0x7efc3414bca0 2024-09-15T22:09:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.870+0000 7efc31ffb640 1 -- 172.21.15.78:0/3045436177 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1c032810 con 0x7efc3414bca0 2024-09-15T22:09:22.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.871+0000 7efc399b7640 1 -- 172.21.15.78:0/3045436177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc3414bca0 msgr2=0x7efc340b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:22.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.871+0000 7efc399b7640 1 --2- 172.21.15.78:0/3045436177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc3414bca0 0x7efc340b7750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc34070fe0 tx=0x7efc1c02a150 comp rx=0 tx=0).stop 2024-09-15T22:09:22.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.871+0000 7efc399b7640 1 -- 172.21.15.78:0/3045436177 shutdown_connections 2024-09-15T22:09:22.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.871+0000 7efc399b7640 1 --2- 172.21.15.78:0/3045436177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc3414bca0 0x7efc340b7750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.871+0000 7efc399b7640 1 --2- 172.21.15.78:0/3045436177 >> v2:172.21.15.175:3300/0 conn(0x7efc340b7370 0x7efc3406e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.871+0000 7efc399b7640 1 -- 172.21.15.78:0/3045436177 >> 172.21.15.78:0/3045436177 conn(0x7efc3409d200 msgr2=0x7efc3409d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.871+0000 7efc399b7640 1 -- 172.21.15.78:0/3045436177 shutdown_connections 2024-09-15T22:09:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.871+0000 7efc399b7640 1 -- 172.21.15.78:0/3045436177 wait complete. 2024-09-15T22:09:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.872+0000 7efc399b7640 1 Processor -- start 2024-09-15T22:09:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.872+0000 7efc399b7640 1 -- start start 2024-09-15T22:09:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc399b7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc340b7370 0x7efc3409c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc399b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc341481f0 0x7efc341d23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc399b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc3414bca0 0x7efc341452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc399b7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efc340b6420 con 0x7efc340b7370 2024-09-15T22:09:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc399b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efc340b7c90 con 0x7efc341481f0 2024-09-15T22:09:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc399b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efc340b65a0 con 0x7efc3414bca0 2024-09-15T22:09:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc32ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc340b7370 0x7efc3409c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:22.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc32ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc340b7370 0x7efc3409c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51006/0 (socket says 172.21.15.78:51006) 2024-09-15T22:09:22.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc32ffd640 1 -- 172.21.15.78:0/3033139003 learned_addr learned my addr 172.21.15.78:0/3033139003 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:22.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc327fc640 1 --2- 172.21.15.78:0/3033139003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc341481f0 0x7efc341d23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:22.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc32ffd640 1 -- 172.21.15.78:0/3033139003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc3414bca0 msgr2=0x7efc341452c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:09:22.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc32ffd640 1 --2- 172.21.15.78:0/3033139003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc3414bca0 0x7efc341452c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc32ffd640 1 -- 172.21.15.78:0/3033139003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc341481f0 msgr2=0x7efc341d23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:22.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc32ffd640 1 --2- 172.21.15.78:0/3033139003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc341481f0 0x7efc341d23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:22.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc32ffd640 1 -- 172.21.15.78:0/3033139003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3414ac50 con 0x7efc340b7370 2024-09-15T22:09:22.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc327fc640 1 --2- 172.21.15.78:0/3033139003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc341481f0 0x7efc341d23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:22.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc32ffd640 1 --2- 172.21.15.78:0/3033139003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc340b7370 0x7efc3409c840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc2400e9b0 tx=0x7efc2400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:22.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc2bfff640 1 -- 172.21.15.78:0/3033139003 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc24017070 con 0x7efc340b7370 2024-09-15T22:09:22.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc2bfff640 1 -- 172.21.15.78:0/3033139003 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2400c9a0 con 0x7efc340b7370 2024-09-15T22:09:22.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc399b7640 1 -- 172.21.15.78:0/3033139003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc341d1ec0 con 0x7efc340b7370 2024-09-15T22:09:22.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.873+0000 7efc2bfff640 1 -- 172.21.15.78:0/3033139003 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2400cd90 con 0x7efc340b7370 2024-09-15T22:09:22.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.874+0000 7efc399b7640 1 -- 172.21.15.78:0/3033139003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc34149f60 con 0x7efc340b7370 2024-09-15T22:09:22.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.875+0000 7efc399b7640 1 -- 172.21.15.78:0/3033139003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc3406e4f0 con 0x7efc340b7370 2024-09-15T22:09:22.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.875+0000 7efc2bfff640 1 -- 172.21.15.78:0/3033139003 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efc2401a070 con 0x7efc340b7370 2024-09-15T22:09:22.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.875+0000 7efc2bfff640 1 --2- 172.21.15.78:0/3033139003 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7efc1406c2b0 0x7efc1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:22.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.876+0000 7efc327fc640 1 --2- 172.21.15.78:0/3033139003 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7efc1406c2b0 0x7efc1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:22.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.876+0000 7efc2bfff640 1 -- 172.21.15.78:0/3033139003 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efc2408bae0 con 0x7efc340b7370 2024-09-15T22:09:22.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.876+0000 7efc327fc640 1 --2- 172.21.15.78:0/3033139003 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7efc1406c2b0 0x7efc1406e770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efc1c034000 tx=0x7efc1c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:22.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:22.880+0000 7efc2bfff640 1 -- 172.21.15.78:0/3033139003 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc24059fa0 con 0x7efc340b7370 2024-09-15T22:09:23.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.044+0000 7efc399b7640 1 -- 172.21.15.78:0/3033139003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc34069170 con 0x7efc340b7370 2024-09-15T22:09:23.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.045+0000 7efc2bfff640 1 -- 172.21.15.78:0/3033139003 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7efc240598a0 con 0x7efc340b7370 2024-09-15T22:09:23.048 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:23.048 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"34e44e87-1d1a-416f-b208-c16e07980ff5","created":"2024-09-15T22:08:53.842443+0000","modified":"2024-09-15T22:09:21.780555+0000","last_up_change":"2024-09-15T22:09:04.830042+0000","last_in_change":"2024-09-15T22:08:55.864039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:05.999373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:14.532061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:15.710676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:09:19.437681+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"71eb9af6-bf66-4450-a5d1-d4a81f71f95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6817","nonce":3548923409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6819","nonce":3548923409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6823","nonce":3548923409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6821","nonce":3548923409}]},"public_addr":"172.21.15.78:6817/3548923409","cluster_addr":"172.21.15.78:6819/3548923409","heartbeat_back_addr":"172.21.15.78:6823/3548923409","heartbeat_front_addr":"172.21.15.78:6821/3548923409","state":["exists","up"]},{"osd":1,"uuid":"f0070f6d-7998-4ad3-b597-e5777e61d503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6809","nonce":1233827941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6811","nonce":1233827941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6815","nonce":1233827941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6813","nonce":1233827941}]},"public_addr":"172.21.15.78:6809/1233827941","cluster_addr":"172.21.15.78:6811/1233827941","heartbeat_back_addr":"172.21.15.78:6815/1233827941","heartbeat_front_addr":"172.21.15.78:6813/1233827941","state":["exists","up"]},{"osd":2,"uuid":"6d9c91c7-2c8a-48f9-9bef-67ea7320980e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6825","nonce":636523247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6827","nonce":636523247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6831","nonce":636523247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6829","nonce":636523247}]},"public_addr":"172.21.15.78:6825/636523247","cluster_addr":"172.21.15.78:6827/636523247","heartbeat_back_addr":"172.21.15.78:6831/636523247","heartbeat_front_addr":"172.21.15.78:6829/636523247","state":["exists","up"]},{"osd":3,"uuid":"943e38fb-b450-48c0-8f01-d381b0b8e313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6801","nonce":1841812488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6803","nonce":1841812488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6807","nonce":1841812488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6805","nonce":1841812488}]},"public_addr":"172.21.15.78:6801/1841812488","cluster_addr":"172.21.15.78:6803/1841812488","heartbeat_back_addr":"172.21.15.78:6807/1841812488","heartbeat_front_addr":"172.21.15.78:6805/1841812488","state":["exists","up"]},{"osd":4,"uuid":"259f50f8-3223-450d-8cd1-d0d333c278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6817","nonce":1803357070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6819","nonce":1803357070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6823","nonce":1803357070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6821","nonce":1803357070}]},"public_addr":"172.21.15.175:6817/1803357070","cluster_addr":"172.21.15.175:6819/1803357070","heartbeat_back_addr":"172.21.15.175:6823/1803357070","heartbeat_front_addr":"172.21.15.175:6821/1803357070","state":["exists","up"]},{"osd":5,"uuid":"d70426cd-a39b-4a20-8c7b-bedc8352e303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6825","nonce":2221415707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6827","nonce":2221415707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6831","nonce":2221415707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6829","nonce":2221415707}]},"public_addr":"172.21.15.175:6825/2221415707","cluster_addr":"172.21.15.175:6827/2221415707","heartbeat_back_addr":"172.21.15.175:6831/2221415707","heartbeat_front_addr":"172.21.15.175:6829/2221415707","state":["exists","up"]},{"osd":6,"uuid":"95b9ed3a-cbfc-45a5-8967-88db9da099ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6801","nonce":1974018373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6803","nonce":1974018373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6807","nonce":1974018373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6805","nonce":1974018373}]},"public_addr":"172.21.15.175:6801/1974018373","cluster_addr":"172.21.15.175:6803/1974018373","heartbeat_back_addr":"172.21.15.175:6807/1974018373","heartbeat_front_addr":"172.21.15.175:6805/1974018373","state":["exists","up"]},{"osd":7,"uuid":"5fc56286-91e9-4a13-b161-ad7d30fc0119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6809","nonce":2386415083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6811","nonce":2386415083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6815","nonce":2386415083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6813","nonce":2386415083}]},"public_addr":"172.21.15.175:6809/2386415083","cluster_addr":"172.21.15.175:6811/2386415083","heartbeat_back_addr":"172.21.15.175:6815/2386415083","heartbeat_front_addr":"172.21.15.175:6813/2386415083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.191845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.871482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.594323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.463568+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.398880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.490112+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.119097+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.677350+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:09:23.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.047+0000 7efc399b7640 1 -- 172.21.15.78:0/3033139003 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7efc1406c2b0 msgr2=0x7efc1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.047+0000 7efc399b7640 1 --2- 172.21.15.78:0/3033139003 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7efc1406c2b0 0x7efc1406e770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efc1c034000 tx=0x7efc1c02e000 comp rx=0 tx=0).stop 2024-09-15T22:09:23.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.047+0000 7efc399b7640 1 -- 172.21.15.78:0/3033139003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc340b7370 msgr2=0x7efc3409c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.047+0000 7efc399b7640 1 --2- 172.21.15.78:0/3033139003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc340b7370 0x7efc3409c840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc2400e9b0 tx=0x7efc2400ee70 comp rx=0 tx=0).stop 2024-09-15T22:09:23.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.047+0000 7efc399b7640 1 -- 172.21.15.78:0/3033139003 shutdown_connections 2024-09-15T22:09:23.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.047+0000 7efc399b7640 1 --2- 172.21.15.78:0/3033139003 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7efc1406c2b0 0x7efc1406e770 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.047+0000 7efc399b7640 1 --2- 172.21.15.78:0/3033139003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc3414bca0 0x7efc341452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.047+0000 7efc399b7640 1 --2- 172.21.15.78:0/3033139003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc341481f0 0x7efc341d23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.047+0000 7efc399b7640 1 --2- 172.21.15.78:0/3033139003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc340b7370 0x7efc3409c840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.047+0000 7efc399b7640 1 -- 172.21.15.78:0/3033139003 >> 172.21.15.78:0/3033139003 conn(0x7efc3409d200 msgr2=0x7efc340731c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:23.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.048+0000 7efc399b7640 1 -- 172.21.15.78:0/3033139003 shutdown_connections 2024-09-15T22:09:23.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.048+0000 7efc399b7640 1 -- 172.21.15.78:0/3033139003 wait complete. 2024-09-15T22:09:23.060 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:09:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.156+0000 7fbf57903640 1 Processor -- start 2024-09-15T22:09:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.156+0000 7fbf57903640 1 -- start start 2024-09-15T22:09:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.157+0000 7fbf57903640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf500ba270 0x7fbf500b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.157+0000 7fbf57903640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbf501417f0 0x7fbf50141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.157+0000 7fbf57903640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf500b6c90 con 0x7fbf500b7f70 2024-09-15T22:09:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.157+0000 7fbf57903640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbf500b6f00 con 0x7fbf501417f0 2024-09-15T22:09:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.157+0000 7fbf57903640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbf500b7a80 con 0x7fbf500ba270 2024-09-15T22:09:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.157+0000 7fbf55ea0640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbf500b7f70 0x7fbf500b8420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38406/0 (socket says 172.21.15.78:38406) 2024-09-15T22:09:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.157+0000 7fbf55ea0640 1 -- 172.21.15.78:0/108307564 learned_addr learned my addr 172.21.15.78:0/108307564 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.157+0000 7fbf47fff640 1 -- 172.21.15.78:0/108307564 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975304712 0 0) 0x7fbf500b6c90 con 0x7fbf500b7f70 2024-09-15T22:09:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.157+0000 7fbf47fff640 1 -- 172.21.15.78:0/108307564 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf3c003520 con 0x7fbf500b7f70 2024-09-15T22:09:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf47fff640 1 -- 172.21.15.78:0/108307564 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 924090161 0 0) 0x7fbf3c003520 con 0x7fbf500b7f70 2024-09-15T22:09:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf54e9e640 1 --2- 172.21.15.78:0/108307564 >> v2:172.21.15.175:3300/0 conn(0x7fbf501417f0 0x7fbf50141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf47fff640 1 -- 172.21.15.78:0/108307564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf500ba270 msgr2=0x7fbf500b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf47fff640 1 --2- 172.21.15.78:0/108307564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf500ba270 0x7fbf500b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf47fff640 1 -- 172.21.15.78:0/108307564 >> v2:172.21.15.175:3300/0 conn(0x7fbf501417f0 msgr2=0x7fbf50141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf47fff640 1 --2- 172.21.15.78:0/108307564 >> v2:172.21.15.175:3300/0 conn(0x7fbf501417f0 0x7fbf50141c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf47fff640 1 -- 172.21.15.78:0/108307564 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf500ba650 con 0x7fbf500b7f70 2024-09-15T22:09:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf47fff640 1 -- 172.21.15.78:0/108307564 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3961011974 0 0) 0x7fbf480019f0 con 0x7fbf500b7f70 2024-09-15T22:09:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf47fff640 1 -- 172.21.15.78:0/108307564 >> v1:172.21.15.78:6789/0 conn(0x7fbf500b7f70 legacy=0x7fbf500b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf47fff640 1 --2- 172.21.15.78:0/108307564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf3c0039b0 0x7fbf3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf47fff640 1 --2- 172.21.15.78:0/108307564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf500ba270 0x7fbf3c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf47fff640 1 --2- 172.21.15.78:0/108307564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf3c004e60 0x7fbf3c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf47fff640 1 -- 172.21.15.78:0/108307564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbf500b6f00 con 0x7fbf3c004e60 2024-09-15T22:09:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf47fff640 1 -- 172.21.15.78:0/108307564 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbf500b7a80 con 0x7fbf3c0039b0 2024-09-15T22:09:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf47fff640 1 -- 172.21.15.78:0/108307564 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbf3c005670 con 0x7fbf500ba270 2024-09-15T22:09:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf55ea0640 1 --2- 172.21.15.78:0/108307564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf3c004e60 0x7fbf3c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf54e9e640 1 --2- 172.21.15.78:0/108307564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf500ba270 0x7fbf3c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf5569f640 1 --2- 172.21.15.78:0/108307564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf3c0039b0 0x7fbf3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf55ea0640 1 -- 172.21.15.78:0/108307564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf500ba270 msgr2=0x7fbf3c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf55ea0640 1 --2- 172.21.15.78:0/108307564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf500ba270 0x7fbf3c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf55ea0640 1 -- 172.21.15.78:0/108307564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf3c0039b0 msgr2=0x7fbf3c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf55ea0640 1 --2- 172.21.15.78:0/108307564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf3c0039b0 0x7fbf3c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.158+0000 7fbf55ea0640 1 -- 172.21.15.78:0/108307564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3c003520 con 0x7fbf3c004e60 2024-09-15T22:09:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.159+0000 7fbf55ea0640 1 --2- 172.21.15.78:0/108307564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf3c004e60 0x7fbf3c00b9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbf480013d0 tx=0x7fbf3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11e4a10b2aba3bb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.159+0000 7fbf47fff640 1 -- 172.21.15.78:0/108307564 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800a4e0 con 0x7fbf3c004e60 2024-09-15T22:09:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.159+0000 7fbf47fff640 1 -- 172.21.15.78:0/108307564 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf4802f070 con 0x7fbf3c004e60 2024-09-15T22:09:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.159+0000 7fbf47fff640 1 -- 172.21.15.78:0/108307564 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4802bce0 con 0x7fbf3c004e60 2024-09-15T22:09:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.159+0000 7fbf57903640 1 -- 172.21.15.78:0/108307564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf3c004e60 msgr2=0x7fbf3c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.159+0000 7fbf57903640 1 --2- 172.21.15.78:0/108307564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf3c004e60 0x7fbf3c00b9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbf480013d0 tx=0x7fbf3c005830 comp rx=0 tx=0).stop 2024-09-15T22:09:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.159+0000 7fbf55ea0640 1 -- 172.21.15.78:0/108307564 reap_dead start 2024-09-15T22:09:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.159+0000 7fbf57903640 1 -- 172.21.15.78:0/108307564 shutdown_connections 2024-09-15T22:09:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.159+0000 7fbf57903640 1 -- 172.21.15.78:0/108307564 >> 172.21.15.78:0/108307564 conn(0x7fbf50074ba0 msgr2=0x7fbf50074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.159+0000 7fbf57903640 1 -- 172.21.15.78:0/108307564 shutdown_connections 2024-09-15T22:09:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.159+0000 7fbf57903640 1 -- 172.21.15.78:0/108307564 wait complete. 2024-09-15T22:09:23.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.160+0000 7fbf57903640 1 Processor -- start 2024-09-15T22:09:23.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.160+0000 7fbf57903640 1 -- start start 2024-09-15T22:09:23.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf57903640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf3c004e60 0x7fbf500bbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf57903640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf500bc550 0x7fbf501e0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf57903640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf5013e2e0 0x7fbf5013e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf57903640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbf500b77a0 con 0x7fbf500bc550 2024-09-15T22:09:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf57903640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbf500b74c0 con 0x7fbf5013e2e0 2024-09-15T22:09:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf57903640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbf500b4a70 con 0x7fbf3c004e60 2024-09-15T22:09:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf54e9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf500bc550 0x7fbf501e0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf54e9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf500bc550 0x7fbf501e0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51038/0 (socket says 172.21.15.78:51038) 2024-09-15T22:09:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf54e9e640 1 -- 172.21.15.78:0/555655487 learned_addr learned my addr 172.21.15.78:0/555655487 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf55ea0640 1 --2- 172.21.15.78:0/555655487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf5013e2e0 0x7fbf5013e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf5569f640 1 --2- 172.21.15.78:0/555655487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf3c004e60 0x7fbf500bbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf54e9e640 1 -- 172.21.15.78:0/555655487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf3c004e60 msgr2=0x7fbf500bbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf54e9e640 1 --2- 172.21.15.78:0/555655487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf3c004e60 0x7fbf500bbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf54e9e640 1 -- 172.21.15.78:0/555655487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf5013e2e0 msgr2=0x7fbf5013e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf54e9e640 1 --2- 172.21.15.78:0/555655487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf5013e2e0 0x7fbf5013e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf54e9e640 1 -- 172.21.15.78:0/555655487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf500bc130 con 0x7fbf500bc550 2024-09-15T22:09:23.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf5569f640 1 --2- 172.21.15.78:0/555655487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf3c004e60 0x7fbf500bbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:23.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.161+0000 7fbf54e9e640 1 --2- 172.21.15.78:0/555655487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf500bc550 0x7fbf501e0f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000f870 tx=0x7fbf4000fd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:23.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.162+0000 7fbf45ffb640 1 -- 172.21.15.78:0/555655487 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000dbb0 con 0x7fbf500bc550 2024-09-15T22:09:23.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.162+0000 7fbf45ffb640 1 -- 172.21.15.78:0/555655487 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf4000dd50 con 0x7fbf500bc550 2024-09-15T22:09:23.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.162+0000 7fbf57903640 1 -- 172.21.15.78:0/555655487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf50148670 con 0x7fbf500bc550 2024-09-15T22:09:23.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.162+0000 7fbf45ffb640 1 -- 172.21.15.78:0/555655487 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf40013680 con 0x7fbf500bc550 2024-09-15T22:09:23.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.162+0000 7fbf57903640 1 -- 172.21.15.78:0/555655487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf500bd860 con 0x7fbf500bc550 2024-09-15T22:09:23.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.163+0000 7fbf57903640 1 -- 172.21.15.78:0/555655487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf500b5ce0 con 0x7fbf500bc550 2024-09-15T22:09:23.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.163+0000 7fbf45ffb640 1 -- 172.21.15.78:0/555655487 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbf40013820 con 0x7fbf500bc550 2024-09-15T22:09:23.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.164+0000 7fbf45ffb640 1 --2- 172.21.15.78:0/555655487 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbf3406c2e0 0x7fbf3406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.164+0000 7fbf45ffb640 1 -- 172.21.15.78:0/555655487 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbf4008c0c0 con 0x7fbf500bc550 2024-09-15T22:09:23.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.164+0000 7fbf5569f640 1 --2- 172.21.15.78:0/555655487 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbf3406c2e0 0x7fbf3406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.164+0000 7fbf5569f640 1 --2- 172.21.15.78:0/555655487 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbf3406c2e0 0x7fbf3406e7a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c004700 tx=0x7fbf4c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:23.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.168+0000 7fbf45ffb640 1 -- 172.21.15.78:0/555655487 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf40017030 con 0x7fbf500bc550 2024-09-15T22:09:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.335+0000 7fbf57903640 1 -- 172.21.15.78:0/555655487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf500b8e10 con 0x7fbf500bc550 2024-09-15T22:09:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.336+0000 7fbf45ffb640 1 -- 172.21.15.78:0/555655487 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7fbf4005a4f0 con 0x7fbf500bc550 2024-09-15T22:09:23.338 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:23.339 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"34e44e87-1d1a-416f-b208-c16e07980ff5","created":"2024-09-15T22:08:53.842443+0000","modified":"2024-09-15T22:09:21.780555+0000","last_up_change":"2024-09-15T22:09:04.830042+0000","last_in_change":"2024-09-15T22:08:55.864039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:05.999373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:14.532061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:15.710676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:09:19.437681+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"71eb9af6-bf66-4450-a5d1-d4a81f71f95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6817","nonce":3548923409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6819","nonce":3548923409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6823","nonce":3548923409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6821","nonce":3548923409}]},"public_addr":"172.21.15.78:6817/3548923409","cluster_addr":"172.21.15.78:6819/3548923409","heartbeat_back_addr":"172.21.15.78:6823/3548923409","heartbeat_front_addr":"172.21.15.78:6821/3548923409","state":["exists","up"]},{"osd":1,"uuid":"f0070f6d-7998-4ad3-b597-e5777e61d503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6809","nonce":1233827941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6811","nonce":1233827941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6815","nonce":1233827941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6813","nonce":1233827941}]},"public_addr":"172.21.15.78:6809/1233827941","cluster_addr":"172.21.15.78:6811/1233827941","heartbeat_back_addr":"172.21.15.78:6815/1233827941","heartbeat_front_addr":"172.21.15.78:6813/1233827941","state":["exists","up"]},{"osd":2,"uuid":"6d9c91c7-2c8a-48f9-9bef-67ea7320980e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6825","nonce":636523247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6827","nonce":636523247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6831","nonce":636523247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6829","nonce":636523247}]},"public_addr":"172.21.15.78:6825/636523247","cluster_addr":"172.21.15.78:6827/636523247","heartbeat_back_addr":"172.21.15.78:6831/636523247","heartbeat_front_addr":"172.21.15.78:6829/636523247","state":["exists","up"]},{"osd":3,"uuid":"943e38fb-b450-48c0-8f01-d381b0b8e313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6801","nonce":1841812488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6803","nonce":1841812488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6807","nonce":1841812488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6805","nonce":1841812488}]},"public_addr":"172.21.15.78:6801/1841812488","cluster_addr":"172.21.15.78:6803/1841812488","heartbeat_back_addr":"172.21.15.78:6807/1841812488","heartbeat_front_addr":"172.21.15.78:6805/1841812488","state":["exists","up"]},{"osd":4,"uuid":"259f50f8-3223-450d-8cd1-d0d333c278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6817","nonce":1803357070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6819","nonce":1803357070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6823","nonce":1803357070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6821","nonce":1803357070}]},"public_addr":"172.21.15.175:6817/1803357070","cluster_addr":"172.21.15.175:6819/1803357070","heartbeat_back_addr":"172.21.15.175:6823/1803357070","heartbeat_front_addr":"172.21.15.175:6821/1803357070","state":["exists","up"]},{"osd":5,"uuid":"d70426cd-a39b-4a20-8c7b-bedc8352e303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6825","nonce":2221415707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6827","nonce":2221415707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6831","nonce":2221415707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6829","nonce":2221415707}]},"public_addr":"172.21.15.175:6825/2221415707","cluster_addr":"172.21.15.175:6827/2221415707","heartbeat_back_addr":"172.21.15.175:6831/2221415707","heartbeat_front_addr":"172.21.15.175:6829/2221415707","state":["exists","up"]},{"osd":6,"uuid":"95b9ed3a-cbfc-45a5-8967-88db9da099ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6801","nonce":1974018373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6803","nonce":1974018373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6807","nonce":1974018373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6805","nonce":1974018373}]},"public_addr":"172.21.15.175:6801/1974018373","cluster_addr":"172.21.15.175:6803/1974018373","heartbeat_back_addr":"172.21.15.175:6807/1974018373","heartbeat_front_addr":"172.21.15.175:6805/1974018373","state":["exists","up"]},{"osd":7,"uuid":"5fc56286-91e9-4a13-b161-ad7d30fc0119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6809","nonce":2386415083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6811","nonce":2386415083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6815","nonce":2386415083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6813","nonce":2386415083}]},"public_addr":"172.21.15.175:6809/2386415083","cluster_addr":"172.21.15.175:6811/2386415083","heartbeat_back_addr":"172.21.15.175:6815/2386415083","heartbeat_front_addr":"172.21.15.175:6813/2386415083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.191845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.871482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.594323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.463568+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.398880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.490112+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.119097+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.677350+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:09:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.338+0000 7fbf57903640 1 -- 172.21.15.78:0/555655487 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbf3406c2e0 msgr2=0x7fbf3406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.338+0000 7fbf57903640 1 --2- 172.21.15.78:0/555655487 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbf3406c2e0 0x7fbf3406e7a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c004700 tx=0x7fbf4c008040 comp rx=0 tx=0).stop 2024-09-15T22:09:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.338+0000 7fbf57903640 1 -- 172.21.15.78:0/555655487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf500bc550 msgr2=0x7fbf501e0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.338+0000 7fbf57903640 1 --2- 172.21.15.78:0/555655487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf500bc550 0x7fbf501e0f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000f870 tx=0x7fbf4000fd30 comp rx=0 tx=0).stop 2024-09-15T22:09:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.339+0000 7fbf57903640 1 -- 172.21.15.78:0/555655487 shutdown_connections 2024-09-15T22:09:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.339+0000 7fbf57903640 1 --2- 172.21.15.78:0/555655487 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbf3406c2e0 0x7fbf3406e7a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.339+0000 7fbf57903640 1 --2- 172.21.15.78:0/555655487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf5013e2e0 0x7fbf5013e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.339+0000 7fbf57903640 1 --2- 172.21.15.78:0/555655487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf500bc550 0x7fbf501e0f30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.339+0000 7fbf57903640 1 --2- 172.21.15.78:0/555655487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf3c004e60 0x7fbf500bbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.339+0000 7fbf57903640 1 -- 172.21.15.78:0/555655487 >> 172.21.15.78:0/555655487 conn(0x7fbf50074ba0 msgr2=0x7fbf50074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:23.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.339+0000 7fbf57903640 1 -- 172.21.15.78:0/555655487 shutdown_connections 2024-09-15T22:09:23.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.339+0000 7fbf57903640 1 -- 172.21.15.78:0/555655487 wait complete. 2024-09-15T22:09:23.368 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:09:23.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.464+0000 7f7069fc6640 1 Processor -- start 2024-09-15T22:09:23.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.464+0000 7f7069fc6640 1 -- start start 2024-09-15T22:09:23.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.465+0000 7f7069fc6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f706414bb40 0x7f7064147a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.465+0000 7f7069fc6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70641417e0 0x7f7064141c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.465+0000 7f7069fc6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7064075900 con 0x7f7064075520 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.465+0000 7f7069fc6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f7064147f90 con 0x7f706414bb40 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.465+0000 7f7069fc6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f706414b6b0 con 0x7f70641417e0 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.465+0000 7f7062ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f706414bb40 0x7f7064147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.465+0000 7f7062ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f706414bb40 0x7f7064147a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51054/0 (socket says 172.21.15.78:51054) 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.465+0000 7f7062ffd640 1 -- 172.21.15.78:0/3909533664 learned_addr learned my addr 172.21.15.78:0/3909533664 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.465+0000 7f7063fff640 1 --2- 172.21.15.78:0/3909533664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70641417e0 0x7f7064141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.465+0000 7f7062ffd640 1 -- 172.21.15.78:0/3909533664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70641417e0 msgr2=0x7f7064141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.465+0000 7f7062ffd640 1 --2- 172.21.15.78:0/3909533664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70641417e0 0x7f7064141c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.465+0000 7f7062ffd640 1 -- 172.21.15.78:0/3909533664 >> v1:172.21.15.175:6789/0 conn(0x7f7064075520 legacy=0x7f706409cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.465+0000 7f7062ffd640 1 -- 172.21.15.78:0/3909533664 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706406dc00 con 0x7f706414bb40 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.466+0000 7f7062ffd640 1 --2- 172.21.15.78:0/3909533664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f706414bb40 0x7f7064147a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7058009870 tx=0x7f705802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24aa86095be20282 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.466+0000 7f70627fc640 1 -- 172.21.15.78:0/3909533664 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7058037070 con 0x7f706414bb40 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.466+0000 7f70627fc640 1 -- 172.21.15.78:0/3909533664 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7058032440 con 0x7f706414bb40 2024-09-15T22:09:23.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.466+0000 7f70627fc640 1 -- 172.21.15.78:0/3909533664 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7058032810 con 0x7f706414bb40 2024-09-15T22:09:23.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.467+0000 7f7069fc6640 1 -- 172.21.15.78:0/3909533664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f706414bb40 msgr2=0x7f7064147a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.467+0000 7f7069fc6640 1 --2- 172.21.15.78:0/3909533664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f706414bb40 0x7f7064147a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7058009870 tx=0x7f705802a1c0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.467+0000 7f7069fc6640 1 -- 172.21.15.78:0/3909533664 shutdown_connections 2024-09-15T22:09:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.467+0000 7f7069fc6640 1 --2- 172.21.15.78:0/3909533664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70641417e0 0x7f7064141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.467+0000 7f7069fc6640 1 --2- 172.21.15.78:0/3909533664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f706414bb40 0x7f7064147a50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.467+0000 7f7069fc6640 1 -- 172.21.15.78:0/3909533664 >> 172.21.15.78:0/3909533664 conn(0x7f70640bdcb0 msgr2=0x7f7064074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.467+0000 7f7069fc6640 1 -- 172.21.15.78:0/3909533664 shutdown_connections 2024-09-15T22:09:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.467+0000 7f7069fc6640 1 -- 172.21.15.78:0/3909533664 wait complete. 2024-09-15T22:09:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.468+0000 7f7069fc6640 1 Processor -- start 2024-09-15T22:09:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.468+0000 7f7069fc6640 1 -- start start 2024-09-15T22:09:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7069fc6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7064075520 0x7f706414a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7069fc6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70641417e0 0x7f7064144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7069fc6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7064140760 0x7f7064140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7069fc6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7064142190 con 0x7f70641417e0 2024-09-15T22:09:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7069fc6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f706414b340 con 0x7f7064140760 2024-09-15T22:09:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7069fc6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f70640a2a60 con 0x7f7064075520 2024-09-15T22:09:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7062ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70641417e0 0x7f7064144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7062ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70641417e0 0x7f7064144a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51056/0 (socket says 172.21.15.78:51056) 2024-09-15T22:09:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7062ffd640 1 -- 172.21.15.78:0/1566296461 learned_addr learned my addr 172.21.15.78:0/1566296461 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7063fff640 1 --2- 172.21.15.78:0/1566296461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7064140760 0x7f7064140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f70637fe640 1 --2- 172.21.15.78:0/1566296461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7064075520 0x7f706414a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7062ffd640 1 -- 172.21.15.78:0/1566296461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7064075520 msgr2=0x7f706414a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7062ffd640 1 --2- 172.21.15.78:0/1566296461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7064075520 0x7f706414a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7062ffd640 1 -- 172.21.15.78:0/1566296461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7064140760 msgr2=0x7f7064140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7062ffd640 1 --2- 172.21.15.78:0/1566296461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7064140760 0x7f7064140bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7062ffd640 1 -- 172.21.15.78:0/1566296461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7064142910 con 0x7f70641417e0 2024-09-15T22:09:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7062ffd640 1 --2- 172.21.15.78:0/1566296461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70641417e0 0x7f7064144a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f70580090b0 tx=0x7f70580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f704bfff640 1 -- 172.21.15.78:0/1566296461 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7058041070 con 0x7f70641417e0 2024-09-15T22:09:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f704bfff640 1 -- 172.21.15.78:0/1566296461 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7058004220 con 0x7f70641417e0 2024-09-15T22:09:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7069fc6640 1 -- 172.21.15.78:0/1566296461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7064143ab0 con 0x7f70641417e0 2024-09-15T22:09:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f704bfff640 1 -- 172.21.15.78:0/1566296461 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7058037040 con 0x7f70641417e0 2024-09-15T22:09:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.469+0000 7f7069fc6640 1 -- 172.21.15.78:0/1566296461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7064144220 con 0x7f70641417e0 2024-09-15T22:09:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.470+0000 7f7069fc6640 1 -- 172.21.15.78:0/1566296461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7064147a50 con 0x7f70641417e0 2024-09-15T22:09:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.471+0000 7f704bfff640 1 -- 172.21.15.78:0/1566296461 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f705802ad10 con 0x7f70641417e0 2024-09-15T22:09:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.471+0000 7f704bfff640 1 --2- 172.21.15.78:0/1566296461 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f705006c2b0 0x7f705006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.471+0000 7f704bfff640 1 -- 172.21.15.78:0/1566296461 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f70580ab920 con 0x7f70641417e0 2024-09-15T22:09:23.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.471+0000 7f70637fe640 1 --2- 172.21.15.78:0/1566296461 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f705006c2b0 0x7f705006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.472+0000 7f70637fe640 1 --2- 172.21.15.78:0/1566296461 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f705006c2b0 0x7f705006e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7054001780 tx=0x7f7054009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:23.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.475+0000 7f704bfff640 1 -- 172.21.15.78:0/1566296461 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7064142910 con 0x7f70641417e0 2024-09-15T22:09:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.677+0000 7f7069fc6640 1 -- 172.21.15.78:0/1566296461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7064142c40 con 0x7f70641417e0 2024-09-15T22:09:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.678+0000 7f704bfff640 1 -- 172.21.15.78:0/1566296461 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3574 (secure 0 0 0) 0x7f7058079790 con 0x7f70641417e0 2024-09-15T22:09:23.680 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:23.680 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":7,"btime":"2024-09-15T22:09:22:429192+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1036052633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1036052633},{"type":"v1","addr":"172.21.15.78:6835","nonce":1036052633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:09:16.727586+0000","modified":"2024-09-15T22:09:21.780719+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6833/4038139714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":4038139714},{"type":"v1","addr":"172.21.15.175:6833","nonce":4038139714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-09-15T22:09:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 7 2024-09-15T22:09:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.680+0000 7f7069fc6640 1 -- 172.21.15.78:0/1566296461 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f705006c2b0 msgr2=0x7f705006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.680+0000 7f7069fc6640 1 --2- 172.21.15.78:0/1566296461 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f705006c2b0 0x7f705006e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7054001780 tx=0x7f7054009040 comp rx=0 tx=0).stop 2024-09-15T22:09:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.680+0000 7f7069fc6640 1 -- 172.21.15.78:0/1566296461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70641417e0 msgr2=0x7f7064144a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.680+0000 7f7069fc6640 1 --2- 172.21.15.78:0/1566296461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70641417e0 0x7f7064144a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f70580090b0 tx=0x7f70580046c0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.680+0000 7f7069fc6640 1 -- 172.21.15.78:0/1566296461 shutdown_connections 2024-09-15T22:09:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.680+0000 7f7069fc6640 1 --2- 172.21.15.78:0/1566296461 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f705006c2b0 0x7f705006e770 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.680+0000 7f7069fc6640 1 --2- 172.21.15.78:0/1566296461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7064140760 0x7f7064140bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.680+0000 7f7069fc6640 1 --2- 172.21.15.78:0/1566296461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70641417e0 0x7f7064144a90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.680+0000 7f7069fc6640 1 --2- 172.21.15.78:0/1566296461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7064075520 0x7f706414a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.680+0000 7f7069fc6640 1 -- 172.21.15.78:0/1566296461 >> 172.21.15.78:0/1566296461 conn(0x7f70640bdcb0 msgr2=0x7f7064145b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.680+0000 7f7069fc6640 1 -- 172.21.15.78:0/1566296461 shutdown_connections 2024-09-15T22:09:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.680+0000 7f7069fc6640 1 -- 172.21.15.78:0/1566296461 wait complete. 2024-09-15T22:09:23.693 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:09:23.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.789+0000 7fc5ca73b640 1 Processor -- start 2024-09-15T22:09:23.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.789+0000 7fc5ca73b640 1 -- start start 2024-09-15T22:09:23.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.790+0000 7fc5ca73b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc5c40baf20 0x7fc5c40ba080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.790+0000 7fc5ca73b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5c40b7620 0x7fc5c4150110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.790+0000 7fc5ca73b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c40b9a40 con 0x7fc5c4149720 2024-09-15T22:09:23.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.790+0000 7fc5ca73b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fc5c40b9d20 con 0x7fc5c40b7620 2024-09-15T22:09:23.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.790+0000 7fc5ca73b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc5c4148d80 con 0x7fc5c40baf20 2024-09-15T22:09:23.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.790+0000 7fc5c8cd8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5c40b7620 0x7fc5c4150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.790+0000 7fc5c8cd8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5c40b7620 0x7fc5c4150110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51064/0 (socket says 172.21.15.78:51064) 2024-09-15T22:09:23.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.790+0000 7fc5c8cd8640 1 -- 172.21.15.78:0/152092827 learned_addr learned my addr 172.21.15.78:0/152092827 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:23.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.790+0000 7fc5c8cd8640 1 -- 172.21.15.78:0/152092827 >> v2:172.21.15.175:3300/0 conn(0x7fc5c40baf20 msgr2=0x7fc5c40ba080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:23.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.790+0000 7fc5c37fe640 1 --2- 172.21.15.78:0/152092827 >> v2:172.21.15.175:3300/0 conn(0x7fc5c40baf20 0x7fc5c40ba080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.790+0000 7fc5c8cd8640 1 --2- 172.21.15.78:0/152092827 >> v2:172.21.15.175:3300/0 conn(0x7fc5c40baf20 0x7fc5c40ba080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.790+0000 7fc5c8cd8640 1 -- 172.21.15.78:0/152092827 >> v1:172.21.15.175:6789/0 conn(0x7fc5c4149720 legacy=0x7fc5c40b9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:23.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.790+0000 7fc5c8cd8640 1 -- 172.21.15.78:0/152092827 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c40b7070 con 0x7fc5c40b7620 2024-09-15T22:09:23.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.791+0000 7fc5c8cd8640 1 --2- 172.21.15.78:0/152092827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c40b7620 0x7fc5c4150110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40b6830 tx=0x7fc5bc02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4772dc1071e034 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:23.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.791+0000 7fc5c2ffd640 1 -- 172.21.15.78:0/152092827 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc036070 con 0x7fc5c40b7620 2024-09-15T22:09:23.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.791+0000 7fc5c2ffd640 1 -- 172.21.15.78:0/152092827 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5bc031600 con 0x7fc5c40b7620 2024-09-15T22:09:23.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.791+0000 7fc5c2ffd640 1 -- 172.21.15.78:0/152092827 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0319d0 con 0x7fc5c40b7620 2024-09-15T22:09:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.791+0000 7fc5ca73b640 1 -- 172.21.15.78:0/152092827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c40b7620 msgr2=0x7fc5c4150110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.791+0000 7fc5ca73b640 1 --2- 172.21.15.78:0/152092827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c40b7620 0x7fc5c4150110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40b6830 tx=0x7fc5bc02a5d0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.791+0000 7fc5ca73b640 1 -- 172.21.15.78:0/152092827 shutdown_connections 2024-09-15T22:09:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.791+0000 7fc5ca73b640 1 --2- 172.21.15.78:0/152092827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c40b7620 0x7fc5c4150110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.791+0000 7fc5ca73b640 1 --2- 172.21.15.78:0/152092827 >> v2:172.21.15.175:3300/0 conn(0x7fc5c40baf20 0x7fc5c40ba080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.791+0000 7fc5ca73b640 1 -- 172.21.15.78:0/152092827 >> 172.21.15.78:0/152092827 conn(0x7fc5c409d200 msgr2=0x7fc5c409d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.791+0000 7fc5ca73b640 1 -- 172.21.15.78:0/152092827 shutdown_connections 2024-09-15T22:09:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.791+0000 7fc5ca73b640 1 -- 172.21.15.78:0/152092827 wait complete. 2024-09-15T22:09:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.792+0000 7fc5ca73b640 1 Processor -- start 2024-09-15T22:09:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.793+0000 7fc5ca73b640 1 -- start start 2024-09-15T22:09:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.793+0000 7fc5ca73b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c40b7620 0x7fc5c41d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.793+0000 7fc5ca73b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c40baf20 0x7fc5c4140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.793+0000 7fc5ca73b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c4149720 0x7fc5c4140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.793+0000 7fc5ca73b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c4149c80 con 0x7fc5c40baf20 2024-09-15T22:09:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.793+0000 7fc5ca73b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c4149b00 con 0x7fc5c40b7620 2024-09-15T22:09:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.793+0000 7fc5ca73b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c40b7a70 con 0x7fc5c4149720 2024-09-15T22:09:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.793+0000 7fc5c37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c40baf20 0x7fc5c4140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.793+0000 7fc5c37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c40baf20 0x7fc5c4140960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51072/0 (socket says 172.21.15.78:51072) 2024-09-15T22:09:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.793+0000 7fc5c37fe640 1 -- 172.21.15.78:0/1559114491 learned_addr learned my addr 172.21.15.78:0/1559114491 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.793+0000 7fc5c3fff640 1 --2- 172.21.15.78:0/1559114491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c40b7620 0x7fc5c41d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.793+0000 7fc5c8cd8640 1 --2- 172.21.15.78:0/1559114491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c4149720 0x7fc5c4140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.794+0000 7fc5c37fe640 1 -- 172.21.15.78:0/1559114491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c4149720 msgr2=0x7fc5c4140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.794+0000 7fc5c37fe640 1 --2- 172.21.15.78:0/1559114491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c4149720 0x7fc5c4140ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.794+0000 7fc5c37fe640 1 -- 172.21.15.78:0/1559114491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c40b7620 msgr2=0x7fc5c41d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.794+0000 7fc5c37fe640 1 --2- 172.21.15.78:0/1559114491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c40b7620 0x7fc5c41d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.794+0000 7fc5c37fe640 1 -- 172.21.15.78:0/1559114491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c4142460 con 0x7fc5c40baf20 2024-09-15T22:09:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.794+0000 7fc5c37fe640 1 --2- 172.21.15.78:0/1559114491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c40baf20 0x7fc5c4140960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800c7f0 tx=0x7fc5b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.794+0000 7fc5c0ff9640 1 -- 172.21.15.78:0/1559114491 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8015070 con 0x7fc5c40baf20 2024-09-15T22:09:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.794+0000 7fc5c0ff9640 1 -- 172.21.15.78:0/1559114491 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b8004220 con 0x7fc5c40baf20 2024-09-15T22:09:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.794+0000 7fc5ca73b640 1 -- 172.21.15.78:0/1559114491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c4143210 con 0x7fc5c40baf20 2024-09-15T22:09:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.794+0000 7fc5c0ff9640 1 -- 172.21.15.78:0/1559114491 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8007620 con 0x7fc5c40baf20 2024-09-15T22:09:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.794+0000 7fc5ca73b640 1 -- 172.21.15.78:0/1559114491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c41d0ab0 con 0x7fc5c40baf20 2024-09-15T22:09:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.795+0000 7fc5ca73b640 1 -- 172.21.15.78:0/1559114491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c4140270 con 0x7fc5c40baf20 2024-09-15T22:09:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.796+0000 7fc5c0ff9640 1 -- 172.21.15.78:0/1559114491 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc5b80079d0 con 0x7fc5c40baf20 2024-09-15T22:09:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.796+0000 7fc5c0ff9640 1 --2- 172.21.15.78:0/1559114491 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc5b006c2e0 0x7fc5b006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.796+0000 7fc5c0ff9640 1 -- 172.21.15.78:0/1559114491 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc5b808b7e0 con 0x7fc5c40baf20 2024-09-15T22:09:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.796+0000 7fc5c3fff640 1 --2- 172.21.15.78:0/1559114491 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc5b006c2e0 0x7fc5b006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.796+0000 7fc5c3fff640 1 --2- 172.21.15.78:0/1559114491 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc5b006c2e0 0x7fc5b006e7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4004f60 tx=0x7fc5b4007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:23.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.800+0000 7fc5c0ff9640 1 -- 172.21.15.78:0/1559114491 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc5b8059530 con 0x7fc5c40baf20 2024-09-15T22:09:23.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.968+0000 7fc5ca73b640 1 -- 172.21.15.78:0/1559114491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5c40ba080 con 0x7fc5c40baf20 2024-09-15T22:09:23.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.969+0000 7fc5c0ff9640 1 -- 172.21.15.78:0/1559114491 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7fc5b805d830 con 0x7fc5c40baf20 2024-09-15T22:09:23.971 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:23.971 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"34e44e87-1d1a-416f-b208-c16e07980ff5","created":"2024-09-15T22:08:53.842443+0000","modified":"2024-09-15T22:09:21.780555+0000","last_up_change":"2024-09-15T22:09:04.830042+0000","last_in_change":"2024-09-15T22:08:55.864039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:05.999373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:14.532061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:15.710676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:09:19.437681+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"71eb9af6-bf66-4450-a5d1-d4a81f71f95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6817","nonce":3548923409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6819","nonce":3548923409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6823","nonce":3548923409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6821","nonce":3548923409}]},"public_addr":"172.21.15.78:6817/3548923409","cluster_addr":"172.21.15.78:6819/3548923409","heartbeat_back_addr":"172.21.15.78:6823/3548923409","heartbeat_front_addr":"172.21.15.78:6821/3548923409","state":["exists","up"]},{"osd":1,"uuid":"f0070f6d-7998-4ad3-b597-e5777e61d503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6809","nonce":1233827941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6811","nonce":1233827941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6815","nonce":1233827941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6813","nonce":1233827941}]},"public_addr":"172.21.15.78:6809/1233827941","cluster_addr":"172.21.15.78:6811/1233827941","heartbeat_back_addr":"172.21.15.78:6815/1233827941","heartbeat_front_addr":"172.21.15.78:6813/1233827941","state":["exists","up"]},{"osd":2,"uuid":"6d9c91c7-2c8a-48f9-9bef-67ea7320980e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6825","nonce":636523247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6827","nonce":636523247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6831","nonce":636523247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6829","nonce":636523247}]},"public_addr":"172.21.15.78:6825/636523247","cluster_addr":"172.21.15.78:6827/636523247","heartbeat_back_addr":"172.21.15.78:6831/636523247","heartbeat_front_addr":"172.21.15.78:6829/636523247","state":["exists","up"]},{"osd":3,"uuid":"943e38fb-b450-48c0-8f01-d381b0b8e313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6801","nonce":1841812488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6803","nonce":1841812488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6807","nonce":1841812488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6805","nonce":1841812488}]},"public_addr":"172.21.15.78:6801/1841812488","cluster_addr":"172.21.15.78:6803/1841812488","heartbeat_back_addr":"172.21.15.78:6807/1841812488","heartbeat_front_addr":"172.21.15.78:6805/1841812488","state":["exists","up"]},{"osd":4,"uuid":"259f50f8-3223-450d-8cd1-d0d333c278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6817","nonce":1803357070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6819","nonce":1803357070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6823","nonce":1803357070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6821","nonce":1803357070}]},"public_addr":"172.21.15.175:6817/1803357070","cluster_addr":"172.21.15.175:6819/1803357070","heartbeat_back_addr":"172.21.15.175:6823/1803357070","heartbeat_front_addr":"172.21.15.175:6821/1803357070","state":["exists","up"]},{"osd":5,"uuid":"d70426cd-a39b-4a20-8c7b-bedc8352e303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6825","nonce":2221415707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6827","nonce":2221415707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6831","nonce":2221415707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6829","nonce":2221415707}]},"public_addr":"172.21.15.175:6825/2221415707","cluster_addr":"172.21.15.175:6827/2221415707","heartbeat_back_addr":"172.21.15.175:6831/2221415707","heartbeat_front_addr":"172.21.15.175:6829/2221415707","state":["exists","up"]},{"osd":6,"uuid":"95b9ed3a-cbfc-45a5-8967-88db9da099ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6801","nonce":1974018373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6803","nonce":1974018373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6807","nonce":1974018373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6805","nonce":1974018373}]},"public_addr":"172.21.15.175:6801/1974018373","cluster_addr":"172.21.15.175:6803/1974018373","heartbeat_back_addr":"172.21.15.175:6807/1974018373","heartbeat_front_addr":"172.21.15.175:6805/1974018373","state":["exists","up"]},{"osd":7,"uuid":"5fc56286-91e9-4a13-b161-ad7d30fc0119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6809","nonce":2386415083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6811","nonce":2386415083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6815","nonce":2386415083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6813","nonce":2386415083}]},"public_addr":"172.21.15.175:6809/2386415083","cluster_addr":"172.21.15.175:6811/2386415083","heartbeat_back_addr":"172.21.15.175:6815/2386415083","heartbeat_front_addr":"172.21.15.175:6813/2386415083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.191845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.871482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.594323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.463568+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.398880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.490112+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.119097+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.677350+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:09:23.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.971+0000 7fc5ca73b640 1 -- 172.21.15.78:0/1559114491 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc5b006c2e0 msgr2=0x7fc5b006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.971+0000 7fc5ca73b640 1 --2- 172.21.15.78:0/1559114491 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc5b006c2e0 0x7fc5b006e7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4004f60 tx=0x7fc5b4007e30 comp rx=0 tx=0).stop 2024-09-15T22:09:23.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.971+0000 7fc5ca73b640 1 -- 172.21.15.78:0/1559114491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c40baf20 msgr2=0x7fc5c4140960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.971+0000 7fc5ca73b640 1 --2- 172.21.15.78:0/1559114491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c40baf20 0x7fc5c4140960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800c7f0 tx=0x7fc5b800ccb0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.971+0000 7fc5ca73b640 1 -- 172.21.15.78:0/1559114491 shutdown_connections 2024-09-15T22:09:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.971+0000 7fc5ca73b640 1 --2- 172.21.15.78:0/1559114491 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc5b006c2e0 0x7fc5b006e7a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.971+0000 7fc5ca73b640 1 --2- 172.21.15.78:0/1559114491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c4149720 0x7fc5c4140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.971+0000 7fc5ca73b640 1 --2- 172.21.15.78:0/1559114491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5c40baf20 0x7fc5c4140960 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.971+0000 7fc5ca73b640 1 --2- 172.21.15.78:0/1559114491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c40b7620 0x7fc5c41d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.971+0000 7fc5ca73b640 1 -- 172.21.15.78:0/1559114491 >> 172.21.15.78:0/1559114491 conn(0x7fc5c409d200 msgr2=0x7fc5c40721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.971+0000 7fc5ca73b640 1 -- 172.21.15.78:0/1559114491 shutdown_connections 2024-09-15T22:09:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:23.971+0000 7fc5ca73b640 1 -- 172.21.15.78:0/1559114491 wait complete. 2024-09-15T22:09:24.186 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:09:16.727586+0000', 'modified': '2024-09-15T22:09:21.780719+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6833/4038139714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 4038139714}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 4038139714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4267, 'qdb_cluster': [4267]} 2024-09-15T22:09:24.186 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:09:24.187 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-15T22:09:24.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.285+0000 7fadea19f640 1 Processor -- start 2024-09-15T22:09:24.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.285+0000 7fadea19f640 1 -- start start 2024-09-15T22:09:24.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.285+0000 7fadea19f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade40ba270 0x7fade40b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.285+0000 7fadea19f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fade4141c30 0x7fade40b8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.285+0000 7fadea19f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade40b6c90 con 0x7fade41417f0 2024-09-15T22:09:24.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.285+0000 7fadea19f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fade41420e0 con 0x7fade4141c30 2024-09-15T22:09:24.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.285+0000 7fadea19f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fade40b6f00 con 0x7fade40ba270 2024-09-15T22:09:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.286+0000 7fade3fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fade4141c30 0x7fade40b8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.286+0000 7fade37fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade40ba270 0x7fade40b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.286+0000 7fade3fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fade4141c30 0x7fade40b8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.78:46956/0 (socket says 172.21.15.78:46956) 2024-09-15T22:09:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.286+0000 7fade3fff640 1 -- 172.21.15.78:0/381638153 learned_addr learned my addr 172.21.15.78:0/381638153 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.286+0000 7faddbfff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fade41417f0 0x7fade40b7f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.78:36022/0 (socket says 172.21.15.78:36022) 2024-09-15T22:09:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.286+0000 7fade3fff640 1 -- 172.21.15.78:0/381638153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade40ba270 msgr2=0x7fade40b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.286+0000 7fade3fff640 1 --2- 172.21.15.78:0/381638153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade40ba270 0x7fade40b97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.286+0000 7fade3fff640 1 -- 172.21.15.78:0/381638153 >> v1:172.21.15.175:6789/0 conn(0x7fade41417f0 legacy=0x7fade40b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.286+0000 7fade3fff640 1 -- 172.21.15.78:0/381638153 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade40b7a80 con 0x7fade4141c30 2024-09-15T22:09:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.286+0000 7fade37fe640 1 --2- 172.21.15.78:0/381638153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade40ba270 0x7fade40b97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:09:24.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.287+0000 7fade3fff640 1 --2- 172.21.15.78:0/381638153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade4141c30 0x7fade40b8680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faddc009e50 tx=0x7faddc02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47e6df59ed08ee5e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:24.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.287+0000 7fade2ffd640 1 -- 172.21.15.78:0/381638153 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc036070 con 0x7fade4141c30 2024-09-15T22:09:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.287+0000 7fade2ffd640 1 -- 172.21.15.78:0/381638153 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faddc031600 con 0x7fade4141c30 2024-09-15T22:09:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.287+0000 7fade2ffd640 1 -- 172.21.15.78:0/381638153 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc0319d0 con 0x7fade4141c30 2024-09-15T22:09:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.287+0000 7fadea19f640 1 -- 172.21.15.78:0/381638153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade4141c30 msgr2=0x7fade40b8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.287+0000 7fadea19f640 1 --2- 172.21.15.78:0/381638153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade4141c30 0x7fade40b8680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faddc009e50 tx=0x7faddc02a5f0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.287+0000 7fadea19f640 1 -- 172.21.15.78:0/381638153 shutdown_connections 2024-09-15T22:09:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.287+0000 7fadea19f640 1 --2- 172.21.15.78:0/381638153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade4141c30 0x7fade40b8680 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.287+0000 7fadea19f640 1 --2- 172.21.15.78:0/381638153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade40ba270 0x7fade40b97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.287+0000 7fadea19f640 1 -- 172.21.15.78:0/381638153 >> 172.21.15.78:0/381638153 conn(0x7fade4074ba0 msgr2=0x7fade4074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.288+0000 7fadea19f640 1 -- 172.21.15.78:0/381638153 shutdown_connections 2024-09-15T22:09:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.288+0000 7fadea19f640 1 -- 172.21.15.78:0/381638153 wait complete. 2024-09-15T22:09:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.288+0000 7fadea19f640 1 Processor -- start 2024-09-15T22:09:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.289+0000 7fadea19f640 1 -- start start 2024-09-15T22:09:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.289+0000 7fadea19f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade40ba270 0x7fade41d33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.289+0000 7fadea19f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fade41417f0 0x7fade4140670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.289+0000 7fadea19f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade4141c30 0x7fade41e08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.289+0000 7fadea19f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fade40b74c0 con 0x7fade41417f0 2024-09-15T22:09:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.289+0000 7fadea19f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fade40b5190 con 0x7fade40ba270 2024-09-15T22:09:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.289+0000 7fadea19f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fade40b77a0 con 0x7fade4141c30 2024-09-15T22:09:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.289+0000 7faddbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fade41417f0 0x7fade4140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.289+0000 7faddbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fade41417f0 0x7fade4140670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51078/0 (socket says 172.21.15.78:51078) 2024-09-15T22:09:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.289+0000 7faddbfff640 1 -- 172.21.15.78:0/484048300 learned_addr learned my addr 172.21.15.78:0/484048300 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.289+0000 7fade37fe640 1 --2- 172.21.15.78:0/484048300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade40ba270 0x7fade41d33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.289+0000 7fade3fff640 1 --2- 172.21.15.78:0/484048300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade4141c30 0x7fade41e08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.290+0000 7faddbfff640 1 -- 172.21.15.78:0/484048300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade4141c30 msgr2=0x7fade41e08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.290+0000 7faddbfff640 1 --2- 172.21.15.78:0/484048300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade4141c30 0x7fade41e08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.290+0000 7faddbfff640 1 -- 172.21.15.78:0/484048300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade40ba270 msgr2=0x7fade41d33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.290+0000 7faddbfff640 1 --2- 172.21.15.78:0/484048300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade40ba270 0x7fade41d33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.290+0000 7faddbfff640 1 -- 172.21.15.78:0/484048300 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade4147590 con 0x7fade41417f0 2024-09-15T22:09:24.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.290+0000 7faddbfff640 1 --2- 172.21.15.78:0/484048300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fade41417f0 0x7fade4140670 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00c440 tx=0x7fadcc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:24.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.290+0000 7fade0ff9640 1 -- 172.21.15.78:0/484048300 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc0074e0 con 0x7fade41417f0 2024-09-15T22:09:24.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.290+0000 7fade0ff9640 1 -- 172.21.15.78:0/484048300 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadcc007680 con 0x7fade41417f0 2024-09-15T22:09:24.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.290+0000 7fadea19f640 1 -- 172.21.15.78:0/484048300 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade4147870 con 0x7fade41417f0 2024-09-15T22:09:24.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.290+0000 7fade0ff9640 1 -- 172.21.15.78:0/484048300 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc004a20 con 0x7fade41417f0 2024-09-15T22:09:24.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.290+0000 7fadea19f640 1 -- 172.21.15.78:0/484048300 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade4140150 con 0x7fade41417f0 2024-09-15T22:09:24.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.292+0000 7fade0ff9640 1 -- 172.21.15.78:0/484048300 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fadcc01a020 con 0x7fade41417f0 2024-09-15T22:09:24.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.292+0000 7fade0ff9640 1 --2- 172.21.15.78:0/484048300 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fadc406c2b0 0x7fadc406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.292+0000 7fade0ff9640 1 -- 172.21.15.78:0/484048300 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fadcc08ad90 con 0x7fade41417f0 2024-09-15T22:09:24.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.292+0000 7fade37fe640 1 --2- 172.21.15.78:0/484048300 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fadc406c2b0 0x7fadc406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.293+0000 7fade37fe640 1 --2- 172.21.15.78:0/484048300 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fadc406c2b0 0x7fadc406e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fade41d1b20 tx=0x7fadd4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:24.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.293+0000 7faded01a740 1 Processor -- start 2024-09-15T22:09:24.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.293+0000 7faded01a740 1 -- start start 2024-09-15T22:09:24.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.293+0000 7faded01a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a60596aa0 0x560a605c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.293+0000 7faded01a740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605c8e10 0x560a605d28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.293+0000 7faded01a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605d2e00 0x560a605d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.293+0000 7faded01a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560a604fe520 con 0x560a60596aa0 2024-09-15T22:09:24.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.293+0000 7faded01a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560a604a63e0 con 0x560a605d2e00 2024-09-15T22:09:24.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.293+0000 7faded01a740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x560a604fa4e0 con 0x560a605c8e10 2024-09-15T22:09:24.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.294+0000 7fade37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a60596aa0 0x560a605c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.294+0000 7fade37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a60596aa0 0x560a605c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51090/0 (socket says 172.21.15.78:51090) 2024-09-15T22:09:24.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.294+0000 7fade37fe640 1 -- 172.21.15.78:0/2479892914 learned_addr learned my addr 172.21.15.78:0/2479892914 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:24.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.294+0000 7fade3fff640 1 --2- 172.21.15.78:0/2479892914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605d2e00 0x560a605d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.294+0000 7faddbfff640 1 --2- 172.21.15.78:0/2479892914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605c8e10 0x560a605d28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.294+0000 7fade37fe640 1 -- 172.21.15.78:0/2479892914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605c8e10 msgr2=0x560a605d28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:24.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.294+0000 7fade37fe640 1 --2- 172.21.15.78:0/2479892914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605c8e10 0x560a605d28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.294+0000 7fade37fe640 1 -- 172.21.15.78:0/2479892914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605d2e00 msgr2=0x560a605d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:24.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.294+0000 7fade37fe640 1 --2- 172.21.15.78:0/2479892914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605d2e00 0x560a605d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.294+0000 7fade37fe640 1 -- 172.21.15.78:0/2479892914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a604c12f0 con 0x560a60596aa0 2024-09-15T22:09:24.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.294+0000 7fade3fff640 1 --2- 172.21.15.78:0/2479892914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605d2e00 0x560a605d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:24.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.294+0000 7fade37fe640 1 --2- 172.21.15.78:0/2479892914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a60596aa0 0x560a605c88d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fadd4011e80 tx=0x7fadd4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3286ad1a05830ea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:24.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.294+0000 7fadd97fa640 1 -- 172.21.15.78:0/2479892914 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4014c90 con 0x560a60596aa0 2024-09-15T22:09:24.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.294+0000 7fadd97fa640 1 -- 172.21.15.78:0/2479892914 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd401b070 con 0x560a60596aa0 2024-09-15T22:09:24.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.294+0000 7fadd97fa640 1 -- 172.21.15.78:0/2479892914 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4004230 con 0x560a60596aa0 2024-09-15T22:09:24.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.295+0000 7faded01a740 1 -- 172.21.15.78:0/2479892914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a60596aa0 msgr2=0x560a605c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.295+0000 7faded01a740 1 --2- 172.21.15.78:0/2479892914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a60596aa0 0x560a605c88d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fadd4011e80 tx=0x7fadd4014000 comp rx=0 tx=0).stop 2024-09-15T22:09:24.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.295+0000 7faded01a740 1 -- 172.21.15.78:0/2479892914 shutdown_connections 2024-09-15T22:09:24.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.295+0000 7faded01a740 1 --2- 172.21.15.78:0/2479892914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605d2e00 0x560a605d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.295+0000 7faded01a740 1 --2- 172.21.15.78:0/2479892914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605c8e10 0x560a605d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.295+0000 7faded01a740 1 --2- 172.21.15.78:0/2479892914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a60596aa0 0x560a605c88d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.295+0000 7faded01a740 1 -- 172.21.15.78:0/2479892914 >> 172.21.15.78:0/2479892914 conn(0x560a605987b0 msgr2=0x560a6059af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.295+0000 7faded01a740 1 -- 172.21.15.78:0/2479892914 shutdown_connections 2024-09-15T22:09:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.295+0000 7faded01a740 1 -- 172.21.15.78:0/2479892914 wait complete. 2024-09-15T22:09:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.295+0000 7faded01a740 1 -- start start 2024-09-15T22:09:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7faded01a740 1 Processor -- start 2024-09-15T22:09:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7faded01a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605c8e10 0x560a605c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7faded01a740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605d2e00 0x560a605d2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7faded01a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605b1de0 0x560a605b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7faded01a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560a605c8440 con 0x560a605c8e10 2024-09-15T22:09:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7faded01a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560a60487450 con 0x560a605b1de0 2024-09-15T22:09:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7faded01a740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x560a6059b610 con 0x560a605d2e00 2024-09-15T22:09:24.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7faded01a740 10 client.0 _ll_register_callbacks cb 0x560a60210ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:09:24.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7fade37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605c8e10 0x560a605c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7fade37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605c8e10 0x560a605c5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51100/0 (socket says 172.21.15.78:51100) 2024-09-15T22:09:24.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7fade37fe640 1 -- 172.21.15.78:0/2630422578 learned_addr learned my addr 172.21.15.78:0/2630422578 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:24.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7faddbfff640 1 --2- 172.21.15.78:0/2630422578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605d2e00 0x560a605d2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7fade3fff640 1 --2- 172.21.15.78:0/2630422578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605b1de0 0x560a605b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7fade37fe640 1 -- 172.21.15.78:0/2630422578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605d2e00 msgr2=0x560a605d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:24.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7fade37fe640 1 --2- 172.21.15.78:0/2630422578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605d2e00 0x560a605d2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7fade37fe640 1 -- 172.21.15.78:0/2630422578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605b1de0 msgr2=0x560a605b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:24.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7fade37fe640 1 --2- 172.21.15.78:0/2630422578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605b1de0 0x560a605b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.296+0000 7fade37fe640 1 -- 172.21.15.78:0/2630422578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a602112d0 con 0x560a605c8e10 2024-09-15T22:09:24.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7faddbfff640 1 --2- 172.21.15.78:0/2630422578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605d2e00 0x560a605d2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7fade37fe640 1 --2- 172.21.15.78:0/2630422578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605c8e10 0x560a605c5a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fadd4004260 tx=0x7fadd4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409c497f26ca8495 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7fadc27fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-15T22:09:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7fadc27fc640 1 -- 172.21.15.78:0/2630422578 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4037060 con 0x560a605c8e10 2024-09-15T22:09:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7fadc27fc640 1 -- 172.21.15.78:0/2630422578 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fadd4003610 con 0x560a605c8e10 2024-09-15T22:09:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7faded01a740 1 -- 172.21.15.78:0/2630422578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadd401b070 con 0x560a605c8e10 2024-09-15T22:09:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7fadc27fc640 1 -- 172.21.15.78:0/2630422578 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fadd4005990 con 0x560a605c8e10 2024-09-15T22:09:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7faded01a740 10 client.4392 fetch_fsmap learned FSMap version 7 2024-09-15T22:09:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7faded01a740 1 -- 172.21.15.78:0/2630422578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x560a602db6b0 con 0x560a605c8e10 2024-09-15T22:09:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7fadc27fc640 1 -- 172.21.15.78:0/2630422578 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd401b070 con 0x560a605c8e10 2024-09-15T22:09:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7fadc27fc640 1 -- 172.21.15.78:0/2630422578 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 7) ==== 2300+0+0 (secure 0 0 0) 0x7fadd4020070 con 0x560a605c8e10 2024-09-15T22:09:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7faded01a740 10 client.4392 fetch_fsmap finished waiting for FSMap version 7 2024-09-15T22:09:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7faded01a740 10 client.4392 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:09:24.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7faded01a740 20 client.4392 populate_metadata read hostname 'smithi078' 2024-09-15T22:09:24.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7faded01a740 1 --2- 172.21.15.78:0/2630422578 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x560a605dd510 0x560a605dd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7faded01a740 4 client.4392 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:09:24.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7faded01a740 1 -- 172.21.15.78:0/2630422578 --> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a6050bc50 con 0x560a605dd510 2024-09-15T22:09:24.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.297+0000 7faddbfff640 1 --2- 172.21.15.78:0/2630422578 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x560a605dd510 0x560a605dd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.298+0000 7fadc27fc640 10 client.4392 ms_handle_connect on v2:172.21.15.175:6832/4038139714 2024-09-15T22:09:24.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.298+0000 7faddbfff640 1 --2- 172.21.15.78:0/2630422578 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x560a605dd510 0x560a605dd8f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0d7d6c2714d12d8 server_cookie=d54edc420384dc5e in_seq=0 out_seq=0 2024-09-15T22:09:24.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.299+0000 7fadc27fc640 1 -- 172.21.15.78:0/2630422578 <== mds.0 v2:172.21.15.175:6832/4038139714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a6050bc50 con 0x560a605dd510 2024-09-15T22:09:24.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.299+0000 7fadc27fc640 10 client.4392 handle_command_reply: tid=0 2024-09-15T22:09:24.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.299+0000 7faded01a740 1 client.4392 shutdown 2024-09-15T22:09:24.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.299+0000 7faded01a740 1 -- 172.21.15.78:0/2630422578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605c8e10 msgr2=0x560a605c5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.299+0000 7faded01a740 1 --2- 172.21.15.78:0/2630422578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605c8e10 0x560a605c5a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fadd4004260 tx=0x7fadd4004730 comp rx=0 tx=0).stop 2024-09-15T22:09:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.299+0000 7faded01a740 1 -- 172.21.15.78:0/2630422578 shutdown_connections 2024-09-15T22:09:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.299+0000 7faded01a740 1 --2- 172.21.15.78:0/2630422578 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x560a605dd510 0x560a605dd8f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.299+0000 7faded01a740 1 --2- 172.21.15.78:0/2630422578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605b1de0 0x560a605b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.299+0000 7faded01a740 1 --2- 172.21.15.78:0/2630422578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605d2e00 0x560a605d2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.299+0000 7fadc27fc640 0 client.4392 ms_handle_reset on v2:172.21.15.175:6832/4038139714 2024-09-15T22:09:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.299+0000 7faded01a740 1 --2- 172.21.15.78:0/2630422578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605c8e10 0x560a605c5a00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.299+0000 7faded01a740 1 -- 172.21.15.78:0/2630422578 >> 172.21.15.78:0/2630422578 conn(0x560a60596aa0 msgr2=0x560a6059bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.299+0000 7faded01a740 1 -- 172.21.15.78:0/2630422578 shutdown_connections 2024-09-15T22:09:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.299+0000 7faded01a740 1 -- 172.21.15.78:0/2630422578 wait complete. 2024-09-15T22:09:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.299+0000 7faded01a740 20 client.4392 trim_cache size 0 max 16384 2024-09-15T22:09:24.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.317+0000 7faded01a740 1 Processor -- start 2024-09-15T22:09:24.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.317+0000 7faded01a740 1 -- start start 2024-09-15T22:09:24.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.317+0000 7faded01a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605b1de0 0x560a605c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.317+0000 7faded01a740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605c8e10 0x560a605d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.317+0000 7faded01a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605d2e00 0x560a605d11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.317+0000 7faded01a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fade41eb510 con 0x560a605b1de0 2024-09-15T22:09:24.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.317+0000 7faded01a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fade41ea6a0 con 0x560a605d2e00 2024-09-15T22:09:24.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.317+0000 7faded01a740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x560a605cfb70 con 0x560a605c8e10 2024-09-15T22:09:24.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.317+0000 7fade37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605b1de0 0x560a605c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.318+0000 7fade37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605b1de0 0x560a605c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51116/0 (socket says 172.21.15.78:51116) 2024-09-15T22:09:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.318+0000 7fade37fe640 1 -- 172.21.15.78:0/5855545 learned_addr learned my addr 172.21.15.78:0/5855545 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.318+0000 7fade37fe640 1 -- 172.21.15.78:0/5855545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605c8e10 msgr2=0x560a605d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.318+0000 7fade37fe640 1 --2- 172.21.15.78:0/5855545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605c8e10 0x560a605d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.318+0000 7fade37fe640 1 -- 172.21.15.78:0/5855545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605d2e00 msgr2=0x560a605d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.318+0000 7fade37fe640 1 --2- 172.21.15.78:0/5855545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605d2e00 0x560a605d11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.318+0000 7fade37fe640 1 -- 172.21.15.78:0/5855545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a60597cb0 con 0x560a605b1de0 2024-09-15T22:09:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.318+0000 7fade37fe640 1 --2- 172.21.15.78:0/5855545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605b1de0 0x560a605c83b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fadd4014810 tx=0x7fadd402b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33dcec9d8af1b686 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.318+0000 7fadd8ff9640 1 -- 172.21.15.78:0/5855545 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4011ac0 con 0x560a605b1de0 2024-09-15T22:09:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.318+0000 7fadd8ff9640 1 -- 172.21.15.78:0/5855545 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd4038260 con 0x560a605b1de0 2024-09-15T22:09:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.318+0000 7fadd8ff9640 1 -- 172.21.15.78:0/5855545 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4038610 con 0x560a605b1de0 2024-09-15T22:09:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.318+0000 7faded01a740 1 -- 172.21.15.78:0/5855545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605b1de0 msgr2=0x560a605c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.319+0000 7faded01a740 1 --2- 172.21.15.78:0/5855545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605b1de0 0x560a605c83b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fadd4014810 tx=0x7fadd402b050 comp rx=0 tx=0).stop 2024-09-15T22:09:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.319+0000 7faded01a740 1 -- 172.21.15.78:0/5855545 shutdown_connections 2024-09-15T22:09:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.319+0000 7faded01a740 1 --2- 172.21.15.78:0/5855545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605d2e00 0x560a605d11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.319+0000 7faded01a740 1 --2- 172.21.15.78:0/5855545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605c8e10 0x560a605d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.319+0000 7faded01a740 1 --2- 172.21.15.78:0/5855545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605b1de0 0x560a605c83b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.319+0000 7faded01a740 1 -- 172.21.15.78:0/5855545 >> 172.21.15.78:0/5855545 conn(0x560a60596aa0 msgr2=0x560a605c3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.319+0000 7faded01a740 1 -- 172.21.15.78:0/5855545 shutdown_connections 2024-09-15T22:09:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.319+0000 7faded01a740 1 -- 172.21.15.78:0/5855545 wait complete. 2024-09-15T22:09:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.319+0000 7faded01a740 1 -- start start 2024-09-15T22:09:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.319+0000 7faded01a740 1 Processor -- start 2024-09-15T22:09:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faded01a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605b1de0 0x560a605b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faded01a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605c8e10 0x560a605da560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faded01a740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605d2e00 0x560a6059aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faded01a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560a605cef70 con 0x560a605c8e10 2024-09-15T22:09:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faded01a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560a605c60c0 con 0x560a605b1de0 2024-09-15T22:09:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faded01a740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x560a605d9f10 con 0x560a605d2e00 2024-09-15T22:09:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faded01a740 10 client.0 _ll_register_callbacks cb 0x7fadd4011d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:09:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faddbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605c8e10 0x560a605da560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faddbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605c8e10 0x560a605da560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51118/0 (socket says 172.21.15.78:51118) 2024-09-15T22:09:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faddbfff640 1 -- 172.21.15.78:0/2551910455 learned_addr learned my addr 172.21.15.78:0/2551910455 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faddbfff640 1 -- 172.21.15.78:0/2551910455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605d2e00 msgr2=0x560a6059aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7fade37fe640 1 --2- 172.21.15.78:0/2551910455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605b1de0 0x560a605b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faddbfff640 1 --2- 172.21.15.78:0/2551910455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605d2e00 0x560a6059aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faddbfff640 1 -- 172.21.15.78:0/2551910455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605b1de0 msgr2=0x560a605b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faddbfff640 1 --2- 172.21.15.78:0/2551910455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605b1de0 0x560a605b2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faddbfff640 1 -- 172.21.15.78:0/2551910455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a6059afd0 con 0x560a605c8e10 2024-09-15T22:09:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faddbfff640 1 --2- 172.21.15.78:0/2551910455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605c8e10 0x560a605da560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fadcc055060 tx=0x7fadcc061800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16df044abbac46b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7fadc27fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-15T22:09:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7fadc27fc640 1 -- 172.21.15.78:0/2551910455 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc086070 con 0x560a605c8e10 2024-09-15T22:09:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7fadc27fc640 1 -- 172.21.15.78:0/2551910455 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fadcc059060 con 0x560a605c8e10 2024-09-15T22:09:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7faded01a740 1 -- 172.21.15.78:0/2551910455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadd4038260 con 0x560a605c8e10 2024-09-15T22:09:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.320+0000 7fadc27fc640 1 -- 172.21.15.78:0/2551910455 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fadcc0612a0 con 0x560a605c8e10 2024-09-15T22:09:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7faded01a740 10 client.4398 fetch_fsmap learned FSMap version 7 2024-09-15T22:09:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7faded01a740 1 -- 172.21.15.78:0/2551910455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x560a6059b1e0 con 0x560a605c8e10 2024-09-15T22:09:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7fadc27fc640 1 -- 172.21.15.78:0/2551910455 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd4038260 con 0x560a605c8e10 2024-09-15T22:09:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7fadc27fc640 1 -- 172.21.15.78:0/2551910455 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 7) ==== 2300+0+0 (secure 0 0 0) 0x7fadcc004bc0 con 0x560a605c8e10 2024-09-15T22:09:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7faded01a740 10 client.4398 fetch_fsmap finished waiting for FSMap version 7 2024-09-15T22:09:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7faded01a740 10 client.4398 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:09:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7faded01a740 20 client.4398 populate_metadata read hostname 'smithi078' 2024-09-15T22:09:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7faded01a740 1 --2- 172.21.15.78:0/2551910455 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x560a605ae7b0 0x560a605aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7faded01a740 4 client.4398 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:09:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7faded01a740 1 -- 172.21.15.78:0/2551910455 --> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] -- command(tid 0: {"prefix": "status"}) -- 0x560a60505fa0 con 0x560a605ae7b0 2024-09-15T22:09:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7fade37fe640 1 --2- 172.21.15.78:0/2551910455 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x560a605ae7b0 0x560a605aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7fade37fe640 1 --2- 172.21.15.78:0/2551910455 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x560a605ae7b0 0x560a605aeb90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1bcadafcd6db652 server_cookie=83c6a82bbf7d31c9 in_seq=0 out_seq=0 2024-09-15T22:09:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7fadc27fc640 10 client.4398 ms_handle_connect on v2:172.21.15.175:6832/4038139714 2024-09-15T22:09:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7fadc27fc640 1 -- 172.21.15.78:0/2551910455 <== mds.0 v2:172.21.15.175:6832/4038139714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+317 (crc 0 0 0) 0x560a60505fa0 con 0x560a605ae7b0 2024-09-15T22:09:24.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7fadc27fc640 10 client.4398 handle_command_reply: tid=0 2024-09-15T22:09:24.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.321+0000 7faded01a740 1 client.4398 shutdown 2024-09-15T22:09:24.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7faded01a740 1 -- 172.21.15.78:0/2551910455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605c8e10 msgr2=0x560a605da560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7faded01a740 1 --2- 172.21.15.78:0/2551910455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605c8e10 0x560a605da560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fadcc055060 tx=0x7fadcc061800 comp rx=0 tx=0).stop 2024-09-15T22:09:24.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7faded01a740 1 -- 172.21.15.78:0/2551910455 shutdown_connections 2024-09-15T22:09:24.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7faded01a740 1 --2- 172.21.15.78:0/2551910455 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x560a605ae7b0 0x560a605aeb90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7faded01a740 1 --2- 172.21.15.78:0/2551910455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a605d2e00 0x560a6059aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7faded01a740 1 --2- 172.21.15.78:0/2551910455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a605c8e10 0x560a605da560 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7fadc27fc640 0 client.4398 ms_handle_reset on v2:172.21.15.175:6832/4038139714 2024-09-15T22:09:24.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7faded01a740 1 --2- 172.21.15.78:0/2551910455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a605b1de0 0x560a605b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7faded01a740 1 -- 172.21.15.78:0/2551910455 >> 172.21.15.78:0/2551910455 conn(0x560a60596aa0 msgr2=0x560a605c8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:24.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7faded01a740 1 -- 172.21.15.78:0/2551910455 shutdown_connections 2024-09-15T22:09:24.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7faded01a740 1 -- 172.21.15.78:0/2551910455 wait complete. 2024-09-15T22:09:24.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7faded01a740 20 client.4398 trim_cache size 0 max 16384 2024-09-15T22:09:24.332 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-15T22:09:24.332 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "34e44e87-1d1a-416f-b208-c16e07980ff5", 2024-09-15T22:09:24.332 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-15T22:09:24.332 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4267, 2024-09-15T22:09:24.332 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-15T22:09:24.332 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-15T22:09:24.333 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-15T22:09:24.333 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 6.933296854, 2024-09-15T22:09:24.333 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 7, 2024-09-15T22:09:24.333 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 25, 2024-09-15T22:09:24.333 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 25, 2024-09-15T22:09:24.333 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 12.950267252 2024-09-15T22:09:24.333 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-15T22:09:24.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7fadea19f640 1 -- 172.21.15.78:0/484048300 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fadc406c2b0 msgr2=0x7fadc406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7fadea19f640 1 --2- 172.21.15.78:0/484048300 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fadc406c2b0 0x7fadc406e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fade41d1b20 tx=0x7fadd4009190 comp rx=0 tx=0).stop 2024-09-15T22:09:24.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7fadea19f640 1 -- 172.21.15.78:0/484048300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fade41417f0 msgr2=0x7fade4140670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7fadea19f640 1 --2- 172.21.15.78:0/484048300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fade41417f0 0x7fade4140670 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00c440 tx=0x7fadcc001e70 comp rx=0 tx=0).stop 2024-09-15T22:09:24.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7fadea19f640 1 -- 172.21.15.78:0/484048300 shutdown_connections 2024-09-15T22:09:24.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7fadea19f640 1 --2- 172.21.15.78:0/484048300 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fadc406c2b0 0x7fadc406e770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7fadea19f640 1 --2- 172.21.15.78:0/484048300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade4141c30 0x7fade41e08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7fadea19f640 1 --2- 172.21.15.78:0/484048300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fade41417f0 0x7fade4140670 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7fadea19f640 1 --2- 172.21.15.78:0/484048300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade40ba270 0x7fade41d33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7fadea19f640 1 -- 172.21.15.78:0/484048300 >> 172.21.15.78:0/484048300 conn(0x7fade4074ba0 msgr2=0x7fade4149cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:24.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7fadea19f640 1 -- 172.21.15.78:0/484048300 shutdown_connections 2024-09-15T22:09:24.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.322+0000 7fadea19f640 1 -- 172.21.15.78:0/484048300 wait complete. 2024-09-15T22:09:24.336 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:09:24.336 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:09:24.336 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:09:24.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.434+0000 7fd14e882640 1 Processor -- start 2024-09-15T22:09:24.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.434+0000 7fd14e882640 1 -- start start 2024-09-15T22:09:24.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd14e882640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1481481f0 0x7fd148148620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd14e882640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1480b6900 con 0x7fd14814bca0 2024-09-15T22:09:24.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd14e882640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd14814b1c0 con 0x7fd1480b7370 2024-09-15T22:09:24.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd14e882640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd14814b4a0 con 0x7fd1481481f0 2024-09-15T22:09:24.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd1477fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd14814bca0 0x7fd1480b7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38416/0 (socket says 172.21.15.78:38416) 2024-09-15T22:09:24.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd1477fe640 1 -- 172.21.15.78:0/3237297572 learned_addr learned my addr 172.21.15.78:0/3237297572 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:24.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd14ce1f640 1 --2- 172.21.15.78:0/3237297572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1481481f0 0x7fd148148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd146ffd640 1 -- 172.21.15.78:0/3237297572 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2091123718 0 0) 0x7fd1480b6900 con 0x7fd14814bca0 2024-09-15T22:09:24.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd146ffd640 1 -- 172.21.15.78:0/3237297572 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd130003520 con 0x7fd14814bca0 2024-09-15T22:09:24.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd146ffd640 1 -- 172.21.15.78:0/3237297572 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3354462442 0 0) 0x7fd130003520 con 0x7fd14814bca0 2024-09-15T22:09:24.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd146ffd640 1 -- 172.21.15.78:0/3237297572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1481481f0 msgr2=0x7fd148148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:24.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd146ffd640 1 --2- 172.21.15.78:0/3237297572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1481481f0 0x7fd148148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd146ffd640 1 -- 172.21.15.78:0/3237297572 >> v1:172.21.15.175:6789/0 conn(0x7fd1480b7370 legacy=0x7fd14806e4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:09:24.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd146ffd640 1 -- 172.21.15.78:0/3237297572 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14814b780 con 0x7fd14814bca0 2024-09-15T22:09:24.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd146ffd640 1 -- 172.21.15.78:0/3237297572 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3961011974 0 0) 0x7fd13c001670 con 0x7fd14814bca0 2024-09-15T22:09:24.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.435+0000 7fd14ce1f640 1 --2- 172.21.15.78:0/3237297572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1481481f0 0x7fd148148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:09:24.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.436+0000 7fd146ffd640 1 -- 172.21.15.78:0/3237297572 >> v1:172.21.15.78:6789/0 conn(0x7fd14814bca0 legacy=0x7fd1480b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.436+0000 7fd146ffd640 1 --2- 172.21.15.78:0/3237297572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1300039e0 0x7fd130003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.436+0000 7fd146ffd640 1 --2- 172.21.15.78:0/3237297572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd130004800 0x7fd130004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.436+0000 7fd146ffd640 1 --2- 172.21.15.78:0/3237297572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1481481f0 0x7fd130005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.436+0000 7fd146ffd640 1 -- 172.21.15.78:0/3237297572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd14814b4a0 con 0x7fd130004800 2024-09-15T22:09:24.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.436+0000 7fd146ffd640 1 -- 172.21.15.78:0/3237297572 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd13000bb50 con 0x7fd1300039e0 2024-09-15T22:09:24.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.436+0000 7fd146ffd640 1 -- 172.21.15.78:0/3237297572 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd13000bd20 con 0x7fd1481481f0 2024-09-15T22:09:24.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.436+0000 7fd1477fe640 1 --2- 172.21.15.78:0/3237297572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd130004800 0x7fd130004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.436+0000 7fd14ce1f640 1 --2- 172.21.15.78:0/3237297572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1481481f0 0x7fd130005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.436+0000 7fd1477fe640 1 -- 172.21.15.78:0/3237297572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1481481f0 msgr2=0x7fd130005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:24.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.436+0000 7fd1477fe640 1 --2- 172.21.15.78:0/3237297572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1481481f0 0x7fd130005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.436+0000 7fd1477fe640 1 -- 172.21.15.78:0/3237297572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1300039e0 msgr2=0x7fd130003de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:09:24.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.436+0000 7fd1477fe640 1 --2- 172.21.15.78:0/3237297572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1300039e0 0x7fd130003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.436+0000 7fd1477fe640 1 -- 172.21.15.78:0/3237297572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd130003520 con 0x7fd130004800 2024-09-15T22:09:24.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.437+0000 7fd1477fe640 1 --2- 172.21.15.78:0/3237297572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd130004800 0x7fd130004c80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00c240 tx=0x7fd130005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51729e17b209136f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:24.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.438+0000 7fd146ffd640 1 -- 172.21.15.78:0/3237297572 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c007d30 con 0x7fd130004800 2024-09-15T22:09:24.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.438+0000 7fd146ffd640 1 -- 172.21.15.78:0/3237297572 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd13c005af0 con 0x7fd130004800 2024-09-15T22:09:24.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.438+0000 7fd146ffd640 1 -- 172.21.15.78:0/3237297572 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c007070 con 0x7fd130004800 2024-09-15T22:09:24.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.439+0000 7fd14e882640 1 -- 172.21.15.78:0/3237297572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd130004800 msgr2=0x7fd130004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.439+0000 7fd14e882640 1 --2- 172.21.15.78:0/3237297572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd130004800 0x7fd130004c80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00c240 tx=0x7fd130005830 comp rx=0 tx=0).stop 2024-09-15T22:09:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.439+0000 7fd14ce1f640 1 -- 172.21.15.78:0/3237297572 reap_dead start 2024-09-15T22:09:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.439+0000 7fd14e882640 1 -- 172.21.15.78:0/3237297572 shutdown_connections 2024-09-15T22:09:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.439+0000 7fd14e882640 1 -- 172.21.15.78:0/3237297572 >> 172.21.15.78:0/3237297572 conn(0x7fd14809d200 msgr2=0x7fd14809d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.439+0000 7fd14e882640 1 -- 172.21.15.78:0/3237297572 shutdown_connections 2024-09-15T22:09:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.439+0000 7fd14e882640 1 -- 172.21.15.78:0/3237297572 wait complete. 2024-09-15T22:09:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.440+0000 7fd14e882640 1 Processor -- start 2024-09-15T22:09:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.440+0000 7fd14e882640 1 -- start start 2024-09-15T22:09:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd14e882640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd130004800 0x7fd14809ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd14e882640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd14806bdc0 0x7fd14806c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd14e882640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1481e0850 0x7fd1481e0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd14e882640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd1481487a0 con 0x7fd14806bdc0 2024-09-15T22:09:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd14e882640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd148148620 con 0x7fd130004800 2024-09-15T22:09:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd14e882640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd148148920 con 0x7fd1481e0850 2024-09-15T22:09:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd1477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd14806bdc0 0x7fd14806c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd1477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd14806bdc0 0x7fd14806c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51138/0 (socket says 172.21.15.78:51138) 2024-09-15T22:09:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd1477fe640 1 -- 172.21.15.78:0/1905711790 learned_addr learned my addr 172.21.15.78:0/1905711790 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd147fff640 1 --2- 172.21.15.78:0/1905711790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd130004800 0x7fd14809ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd14ce1f640 1 --2- 172.21.15.78:0/1905711790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1481e0850 0x7fd1481e0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd1477fe640 1 -- 172.21.15.78:0/1905711790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1481e0850 msgr2=0x7fd1481e0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd1477fe640 1 --2- 172.21.15.78:0/1905711790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1481e0850 0x7fd1481e0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd1477fe640 1 -- 172.21.15.78:0/1905711790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd130004800 msgr2=0x7fd14809ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd1477fe640 1 --2- 172.21.15.78:0/1905711790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd130004800 0x7fd14809ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd1477fe640 1 -- 172.21.15.78:0/1905711790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14806c780 con 0x7fd14806bdc0 2024-09-15T22:09:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd14ce1f640 1 --2- 172.21.15.78:0/1905711790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1481e0850 0x7fd1481e0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.441+0000 7fd1477fe640 1 --2- 172.21.15.78:0/1905711790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd14806bdc0 0x7fd14806c240 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd13c02ae20 tx=0x7fd1480ba0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.442+0000 7fd144ff9640 1 -- 172.21.15.78:0/1905711790 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c042020 con 0x7fd14806bdc0 2024-09-15T22:09:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.442+0000 7fd144ff9640 1 -- 172.21.15.78:0/1905711790 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd13c004bf0 con 0x7fd14806bdc0 2024-09-15T22:09:24.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.442+0000 7fd144ff9640 1 -- 172.21.15.78:0/1905711790 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c007d30 con 0x7fd14806bdc0 2024-09-15T22:09:24.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.442+0000 7fd14e882640 1 -- 172.21.15.78:0/1905711790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1481d14b0 con 0x7fd14806bdc0 2024-09-15T22:09:24.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.442+0000 7fd14e882640 1 -- 172.21.15.78:0/1905711790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1480a0630 con 0x7fd14806bdc0 2024-09-15T22:09:24.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.443+0000 7fd14e882640 1 -- 172.21.15.78:0/1905711790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1480a0450 con 0x7fd14806bdc0 2024-09-15T22:09:24.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.443+0000 7fd144ff9640 1 -- 172.21.15.78:0/1905711790 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd13c045020 con 0x7fd14806bdc0 2024-09-15T22:09:24.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.444+0000 7fd144ff9640 1 --2- 172.21.15.78:0/1905711790 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd13406c2e0 0x7fd13406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:24.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.444+0000 7fd144ff9640 1 -- 172.21.15.78:0/1905711790 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd13c0ab8d0 con 0x7fd14806bdc0 2024-09-15T22:09:24.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.444+0000 7fd147fff640 1 --2- 172.21.15.78:0/1905711790 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd13406c2e0 0x7fd13406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:24.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.444+0000 7fd147fff640 1 --2- 172.21.15.78:0/1905711790 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd13406c2e0 0x7fd13406e7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd138006fd0 tx=0x7fd138009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:24.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.448+0000 7fd144ff9640 1 -- 172.21.15.78:0/1905711790 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd1480a0450 con 0x7fd14806bdc0 2024-09-15T22:09:24.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.646+0000 7fd14e882640 1 -- 172.21.15.78:0/1905711790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd14806e4f0 con 0x7fd14806bdc0 2024-09-15T22:09:24.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.647+0000 7fd144ff9640 1 -- 172.21.15.78:0/1905711790 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7fd14806c780 con 0x7fd14806bdc0 2024-09-15T22:09:24.649 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T22:09:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.649+0000 7fd14e882640 1 -- 172.21.15.78:0/1905711790 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd13406c2e0 msgr2=0x7fd13406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.649+0000 7fd14e882640 1 --2- 172.21.15.78:0/1905711790 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd13406c2e0 0x7fd13406e7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd138006fd0 tx=0x7fd138009060 comp rx=0 tx=0).stop 2024-09-15T22:09:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.649+0000 7fd14e882640 1 -- 172.21.15.78:0/1905711790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd14806bdc0 msgr2=0x7fd14806c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.649+0000 7fd14e882640 1 --2- 172.21.15.78:0/1905711790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd14806bdc0 0x7fd14806c240 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd13c02ae20 tx=0x7fd1480ba0b0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.649+0000 7fd14e882640 1 -- 172.21.15.78:0/1905711790 shutdown_connections 2024-09-15T22:09:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.649+0000 7fd14e882640 1 --2- 172.21.15.78:0/1905711790 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd13406c2e0 0x7fd13406e7a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.649+0000 7fd14e882640 1 --2- 172.21.15.78:0/1905711790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1481e0850 0x7fd1481e0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.649+0000 7fd14e882640 1 --2- 172.21.15.78:0/1905711790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd14806bdc0 0x7fd14806c240 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.649+0000 7fd14e882640 1 --2- 172.21.15.78:0/1905711790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd130004800 0x7fd14809ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.649+0000 7fd14e882640 1 -- 172.21.15.78:0/1905711790 >> 172.21.15.78:0/1905711790 conn(0x7fd14809d200 msgr2=0x7fd1480721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:24.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.649+0000 7fd14e882640 1 -- 172.21.15.78:0/1905711790 shutdown_connections 2024-09-15T22:09:24.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24.649+0000 7fd14e882640 1 -- 172.21.15.78:0/1905711790 wait complete. 2024-09-15T22:09:24.661 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:09:24.661 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:09:24.661 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-09-15T22:09:24.661 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-15T22:09:24.662 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:09:24.662 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:09:24.662 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:09:24.662 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:09:24.662 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-15T22:09:24.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:24.662 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-09-15T22:09:24.677 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:09:24.678 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:09:24.678 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:09:24.678 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:09:24.678 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-09-15T22:09:24.678 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:09:24.678 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:09:24.678 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:09:24.678 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-09-15T22:09:24.678 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:09:24.678 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:09:24.678 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-09-15T22:09:24.678 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:09:24.678 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:09:24.678 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:09:24.679 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-09-15T22:09:24.679 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:09:24.679 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42802sec preferred_lft 42802sec 2024-09-15T22:09:24.679 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link noprefixroute 2024-09-15T22:09:24.679 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:09:24.679 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:09:24.679 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:09:24.680 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-15T22:09:24.680 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:09:24.680 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2024-09-15T22:09:24.680 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2024-09-15T22:09:24.680 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:09:24.680 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-15T22:09:24.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:09:24.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:09:24.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:24.874 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:09:24.898 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-09-15T22:09:24.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:24.900 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-09-15T22:09:24.967 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-09-15T22:09:24.968 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:09:24.968 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:09:24.968 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:09:24.968 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:09:24.968 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:09:24.968 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-15T22:09:24.968 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:09:24.969 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:09:24.969 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:09:24.969 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-15T22:09:25.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:09:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:09:25.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:25.288 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-15T22:09:25.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:25.304 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2024-09-15T22:09:25.359 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:09:25.359 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-15T22:09:25.359 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:09:25.360 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-15T22:09:25.360 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-15T22:09:25.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:09:25.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:09:25.480 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-15T22:09:25.481 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:09:25.481 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-15T22:09:25.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-15T22:09:25.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:09:25.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-15T22:09:25.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-15T22:09:25.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-15T22:09:25.481 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-15T22:09:25.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:09:25.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:09:25.623 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:09:25.623 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-15T22:09:25.623 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2024-09-15T22:09:25.623 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:09:25.623 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-15T22:09:25.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:09:25.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:09:25.706 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-15T22:09:25.706 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:09:25.707 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:09:25.721 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-15T22:09:25.721 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:09:25.721 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:09:25.777 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2024-09-15T22:09:25.845 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:09:25.900 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2024-09-15T22:09:25.900 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2024-09-15T22:09:25.900 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2024-09-15T22:09:25.901 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2024-09-15T22:09:25.901 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2024-09-15T22:09:25.901 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2024-09-15T22:09:25.901 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2024-09-15T22:09:25.901 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2024-09-15T22:09:25.901 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2024-09-15T22:09:25.901 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2024-09-15T22:09:25.901 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2024-09-15T22:09:25.901 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/selinux 2024-09-15T22:09:25.901 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:09:25.901 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2024-09-15T22:09:25.901 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2024-09-15T22:09:25.901 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2024-09-15T22:09:25.902 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2024-09-15T22:09:25.902 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2024-09-15T22:09:25.902 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2024-09-15T22:09:25.902 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T22:09:25.902 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T22:09:25.902 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T22:09:25.902 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T22:09:25.902 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2024-09-15T22:09:25.902 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2024-09-15T22:09:25.902 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:09:25.902 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:09:25.902 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:09:25.903 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:09:25.903 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2024-09-15T22:09:25.903 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:09:25.903 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:09:25.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:25.903 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2024-09-15T22:09:25.955 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T22:09:25.955 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-15T22:09:25.998 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2024-09-15T22:09:26.021 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:09:26.079 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2024-09-15T22:09:26.079 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2024-09-15T22:09:26.079 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2024-09-15T22:09:26.079 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2024-09-15T22:09:26.079 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2024-09-15T22:09:26.079 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2024-09-15T22:09:26.079 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2024-09-15T22:09:26.079 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2024-09-15T22:09:26.079 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2024-09-15T22:09:26.080 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2024-09-15T22:09:26.080 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2024-09-15T22:09:26.080 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/selinux 2024-09-15T22:09:26.080 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:09:26.080 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2024-09-15T22:09:26.080 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2024-09-15T22:09:26.080 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2024-09-15T22:09:26.080 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2024-09-15T22:09:26.080 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2024-09-15T22:09:26.080 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2024-09-15T22:09:26.080 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T22:09:26.080 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T22:09:26.080 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T22:09:26.081 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T22:09:26.081 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2024-09-15T22:09:26.081 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2024-09-15T22:09:26.081 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:09:26.081 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:09:26.081 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:09:26.081 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:09:26.081 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2024-09-15T22:09:26.081 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:09:26.081 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:09:26.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:26.082 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2024-09-15T22:09:26.090 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi078.stderr:2024-09-15T22:09:26.088+0000 7f47ff619480 -1 init, newargv = 0x56332309c950 newargc=15 2024-09-15T22:09:26.090 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi078.stderr:ceph-fuse[41301]: starting ceph client 2024-09-15T22:09:26.097 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi078.stderr:ceph-fuse[41301]: starting fuse 2024-09-15T22:09:26.105 INFO:teuthology.orchestra.run.smithi078.stdout:41 2024-09-15T22:09:26.105 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-15T22:09:26.106 DEBUG:teuthology.orchestra.run.smithi078:> sudo stdin-killer -- python3 -c ' 2024-09-15T22:09:26.106 DEBUG:teuthology.orchestra.run.smithi078:> import glob 2024-09-15T22:09:26.106 DEBUG:teuthology.orchestra.run.smithi078:> import re 2024-09-15T22:09:26.106 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-15T22:09:26.106 DEBUG:teuthology.orchestra.run.smithi078:> import subprocess 2024-09-15T22:09:26.106 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-15T22:09:26.106 DEBUG:teuthology.orchestra.run.smithi078:> def _find_admin_socket(client_name): 2024-09-15T22:09:26.106 DEBUG:teuthology.orchestra.run.smithi078:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-15T22:09:26.106 DEBUG:teuthology.orchestra.run.smithi078:> files = glob.glob(asok_path) 2024-09-15T22:09:26.106 DEBUG:teuthology.orchestra.run.smithi078:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-15T22:09:26.106 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-15T22:09:26.106 DEBUG:teuthology.orchestra.run.smithi078:> # Given a non-glob path, it better be there 2024-09-15T22:09:26.106 DEBUG:teuthology.orchestra.run.smithi078:> if "*" not in asok_path: 2024-09-15T22:09:26.107 DEBUG:teuthology.orchestra.run.smithi078:> assert(len(files) == 1) 2024-09-15T22:09:26.107 DEBUG:teuthology.orchestra.run.smithi078:> return files[0] 2024-09-15T22:09:26.107 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-15T22:09:26.107 DEBUG:teuthology.orchestra.run.smithi078:> for f in files: 2024-09-15T22:09:26.107 DEBUG:teuthology.orchestra.run.smithi078:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T22:09:26.107 DEBUG:teuthology.orchestra.run.smithi078:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T22:09:26.107 DEBUG:teuthology.orchestra.run.smithi078:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T22:09:26.107 DEBUG:teuthology.orchestra.run.smithi078:> contents = proc_f.read() 2024-09-15T22:09:26.107 DEBUG:teuthology.orchestra.run.smithi078:> if mountpoint in contents: 2024-09-15T22:09:26.107 DEBUG:teuthology.orchestra.run.smithi078:> return f 2024-09-15T22:09:26.107 DEBUG:teuthology.orchestra.run.smithi078:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T22:09:26.107 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-15T22:09:26.107 DEBUG:teuthology.orchestra.run.smithi078:> print(_find_admin_socket("client.admin")) 2024-09-15T22:09:26.107 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-15T22:09:26.223 INFO:teuthology.orchestra.run.smithi078.stdout:/var/run/ceph/ceph-client.admin.41301.asok 2024-09-15T22:09:26.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:09:26.234 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41301.asok 2024-09-15T22:09:26.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:26.234 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41301.asok status 2024-09-15T22:09:26.370 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-15T22:09:26.370 INFO:teuthology.orchestra.run.smithi078.stdout: "metadata": { 2024-09-15T22:09:26.370 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T22:09:26.370 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:09:26.370 INFO:teuthology.orchestra.run.smithi078.stdout: "entity_id": "admin", 2024-09-15T22:09:26.370 INFO:teuthology.orchestra.run.smithi078.stdout: "hostname": "smithi078", 2024-09-15T22:09:26.370 INFO:teuthology.orchestra.run.smithi078.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-15T22:09:26.370 INFO:teuthology.orchestra.run.smithi078.stdout: "pid": "41301", 2024-09-15T22:09:26.370 INFO:teuthology.orchestra.run.smithi078.stdout: "root": "/" 2024-09-15T22:09:26.370 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-15T22:09:26.370 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_count": 0, 2024-09-15T22:09:26.370 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_pinned_count": 0, 2024-09-15T22:09:26.371 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4410, 2024-09-15T22:09:26.371 INFO:teuthology.orchestra.run.smithi078.stdout: "inst": { 2024-09-15T22:09:26.371 INFO:teuthology.orchestra.run.smithi078.stdout: "name": { 2024-09-15T22:09:26.371 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "client", 2024-09-15T22:09:26.371 INFO:teuthology.orchestra.run.smithi078.stdout: "num": 4410 2024-09-15T22:09:26.371 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-15T22:09:26.371 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2024-09-15T22:09:26.371 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-09-15T22:09:26.371 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:09:26.371 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1645154399 2024-09-15T22:09:26.371 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-15T22:09:26.371 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-15T22:09:26.371 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2024-09-15T22:09:26.371 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-09-15T22:09:26.372 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:09:26.372 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1645154399 2024-09-15T22:09:26.372 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-15T22:09:26.372 INFO:teuthology.orchestra.run.smithi078.stdout: "inst_str": "client.4410 192.168.0.1:0/1645154399", 2024-09-15T22:09:26.372 INFO:teuthology.orchestra.run.smithi078.stdout: "addr_str": "192.168.0.1:0/1645154399", 2024-09-15T22:09:26.372 INFO:teuthology.orchestra.run.smithi078.stdout: "inode_count": 1, 2024-09-15T22:09:26.372 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_epoch": 7, 2024-09-15T22:09:26.372 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch": 25, 2024-09-15T22:09:26.372 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch_barrier": 0, 2024-09-15T22:09:26.372 INFO:teuthology.orchestra.run.smithi078.stdout: "blocklisted": false, 2024-09-15T22:09:26.372 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs" 2024-09-15T22:09:26.372 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-15T22:09:26.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:26.378 DEBUG:teuthology.orchestra.run.smithi078:> stat --file-system '--printf=%T 2024-09-15T22:09:26.378 DEBUG:teuthology.orchestra.run.smithi078:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:09:26.394 INFO:teuthology.orchestra.run.smithi078.stdout:fuseblk 2024-09-15T22:09:26.394 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:09:26.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:26.394 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:09:26.459 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-15T22:09:26.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:09:26.565 INFO:teuthology.orchestra.run.smithi078.stdout:# file: . 2024-09-15T22:09:26.565 INFO:teuthology.orchestra.run.smithi078.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-15T22:09:26.565 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:26.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:09:26.571 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:09:26.571 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:09:26.587 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:09:26.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.723+0000 7fd100e27640 1 Processor -- start 2024-09-15T22:09:26.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.723+0000 7fd100e27640 1 -- start start 2024-09-15T22:09:26.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.724+0000 7fd100e27640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd0fc072d00 0x7fd0fc146350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:26.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.724+0000 7fd100e27640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd0fc0b5340 0x7fd0fc0730e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:26.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.724+0000 7fd100e27640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0fc145870 con 0x7fd0fc13f1a0 2024-09-15T22:09:26.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.724+0000 7fd100e27640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fd0fc145ec0 con 0x7fd0fc0b5340 2024-09-15T22:09:26.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.724+0000 7fd100e27640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd0fc145b50 con 0x7fd0fc072d00 2024-09-15T22:09:26.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.724+0000 7fd0f9d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd0fc0b5340 0x7fd0fc0730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:26.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.724+0000 7fd0f9d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd0fc0b5340 0x7fd0fc0730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51144/0 (socket says 172.21.15.78:51144) 2024-09-15T22:09:26.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.724+0000 7fd0f9d9b640 1 -- 172.21.15.78:0/1969720677 learned_addr learned my addr 172.21.15.78:0/1969720677 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:26.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.724+0000 7fd0fa59c640 1 --2- 172.21.15.78:0/1969720677 >> v2:172.21.15.175:3300/0 conn(0x7fd0fc072d00 0x7fd0fc146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:26.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.724+0000 7fd0f9d9b640 1 -- 172.21.15.78:0/1969720677 >> v2:172.21.15.175:3300/0 conn(0x7fd0fc072d00 msgr2=0x7fd0fc146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:26.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.724+0000 7fd0f9d9b640 1 --2- 172.21.15.78:0/1969720677 >> v2:172.21.15.175:3300/0 conn(0x7fd0fc072d00 0x7fd0fc146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:26.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.724+0000 7fd0f9d9b640 1 -- 172.21.15.78:0/1969720677 >> v1:172.21.15.175:6789/0 conn(0x7fd0fc13f1a0 legacy=0x7fd0fc13f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:26.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.724+0000 7fd0f9d9b640 1 -- 172.21.15.78:0/1969720677 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc073620 con 0x7fd0fc0b5340 2024-09-15T22:09:26.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.725+0000 7fd0f9d9b640 1 --2- 172.21.15.78:0/1969720677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0fc0b5340 0x7fd0fc0730e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0b8f30 tx=0x7fd0f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8876ec344fe262 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:26.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.725+0000 7fd0f959a640 1 -- 172.21.15.78:0/1969720677 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0037070 con 0x7fd0fc0b5340 2024-09-15T22:09:26.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.725+0000 7fd0f959a640 1 -- 172.21.15.78:0/1969720677 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f0032440 con 0x7fd0fc0b5340 2024-09-15T22:09:26.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.725+0000 7fd0f959a640 1 -- 172.21.15.78:0/1969720677 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0032810 con 0x7fd0fc0b5340 2024-09-15T22:09:26.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.726+0000 7fd100e27640 1 -- 172.21.15.78:0/1969720677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0fc0b5340 msgr2=0x7fd0fc0730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:26.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.726+0000 7fd100e27640 1 --2- 172.21.15.78:0/1969720677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0fc0b5340 0x7fd0fc0730e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0b8f30 tx=0x7fd0f002a1a0 comp rx=0 tx=0).stop 2024-09-15T22:09:26.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.726+0000 7fd100e27640 1 -- 172.21.15.78:0/1969720677 shutdown_connections 2024-09-15T22:09:26.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.726+0000 7fd100e27640 1 --2- 172.21.15.78:0/1969720677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0fc0b5340 0x7fd0fc0730e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:26.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.726+0000 7fd100e27640 1 --2- 172.21.15.78:0/1969720677 >> v2:172.21.15.175:3300/0 conn(0x7fd0fc072d00 0x7fd0fc146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:26.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.726+0000 7fd100e27640 1 -- 172.21.15.78:0/1969720677 >> 172.21.15.78:0/1969720677 conn(0x7fd0fc074ba0 msgr2=0x7fd0fc074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:26.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.726+0000 7fd100e27640 1 -- 172.21.15.78:0/1969720677 shutdown_connections 2024-09-15T22:09:26.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.726+0000 7fd100e27640 1 -- 172.21.15.78:0/1969720677 wait complete. 2024-09-15T22:09:26.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.727+0000 7fd100e27640 1 Processor -- start 2024-09-15T22:09:26.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.727+0000 7fd100e27640 1 -- start start 2024-09-15T22:09:26.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.727+0000 7fd100e27640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0fc072d00 0x7fd0fc141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:26.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.727+0000 7fd100e27640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0fc0b5340 0x7fd0fc06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.727+0000 7fd100e27640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0fc13f1a0 0x7fd0fc06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd100e27640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc0718f0 con 0x7fd0fc072d00 2024-09-15T22:09:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd100e27640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc071770 con 0x7fd0fc13f1a0 2024-09-15T22:09:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd100e27640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd0fc071a70 con 0x7fd0fc0b5340 2024-09-15T22:09:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd0fa59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0fc072d00 0x7fd0fc141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd0fa59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0fc072d00 0x7fd0fc141590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51156/0 (socket says 172.21.15.78:51156) 2024-09-15T22:09:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd0fa59c640 1 -- 172.21.15.78:0/2673986599 learned_addr learned my addr 172.21.15.78:0/2673986599 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd0fad9d640 1 --2- 172.21.15.78:0/2673986599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0fc13f1a0 0x7fd0fc06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd0f9d9b640 1 --2- 172.21.15.78:0/2673986599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0fc0b5340 0x7fd0fc06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd0fa59c640 1 -- 172.21.15.78:0/2673986599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0fc0b5340 msgr2=0x7fd0fc06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd0fa59c640 1 --2- 172.21.15.78:0/2673986599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0fc0b5340 0x7fd0fc06c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd0fa59c640 1 -- 172.21.15.78:0/2673986599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0fc13f1a0 msgr2=0x7fd0fc06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:26.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd0fa59c640 1 --2- 172.21.15.78:0/2673986599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0fc13f1a0 0x7fd0fc06c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:26.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd0fa59c640 1 -- 172.21.15.78:0/2673986599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc06d550 con 0x7fd0fc072d00 2024-09-15T22:09:26.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd0fa59c640 1 --2- 172.21.15.78:0/2673986599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0fc072d00 0x7fd0fc141590 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4007e40 tx=0x7fd0f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:26.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd0eaffd640 1 -- 172.21.15.78:0/2673986599 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4014620 con 0x7fd0fc072d00 2024-09-15T22:09:26.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd0eaffd640 1 -- 172.21.15.78:0/2673986599 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f4019070 con 0x7fd0fc072d00 2024-09-15T22:09:26.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd100e27640 1 -- 172.21.15.78:0/2673986599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0fc141c20 con 0x7fd0fc072d00 2024-09-15T22:09:26.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd0eaffd640 1 -- 172.21.15.78:0/2673986599 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4014a00 con 0x7fd0fc072d00 2024-09-15T22:09:26.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.728+0000 7fd100e27640 1 -- 172.21.15.78:0/2673986599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0fc142ef0 con 0x7fd0fc072d00 2024-09-15T22:09:26.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.729+0000 7fd100e27640 1 -- 172.21.15.78:0/2673986599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0fc146350 con 0x7fd0fc072d00 2024-09-15T22:09:26.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.730+0000 7fd0eaffd640 1 -- 172.21.15.78:0/2673986599 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd0f4014ba0 con 0x7fd0fc072d00 2024-09-15T22:09:26.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.730+0000 7fd0eaffd640 1 --2- 172.21.15.78:0/2673986599 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd0dc06c2b0 0x7fd0dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:26.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.730+0000 7fd0eaffd640 1 -- 172.21.15.78:0/2673986599 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd0f408bee0 con 0x7fd0fc072d00 2024-09-15T22:09:26.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.730+0000 7fd0f9d9b640 1 --2- 172.21.15.78:0/2673986599 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd0dc06c2b0 0x7fd0dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:26.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.731+0000 7fd0f9d9b640 1 --2- 172.21.15.78:0/2673986599 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd0dc06c2b0 0x7fd0dc06e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0034000 tx=0x7fd0f002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:26.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.734+0000 7fd0eaffd640 1 -- 172.21.15.78:0/2673986599 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0f405a3a0 con 0x7fd0fc072d00 2024-09-15T22:09:26.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.914+0000 7fd100e27640 1 -- 172.21.15.78:0/2673986599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd0fc143ae0 con 0x7fd0fc072d00 2024-09-15T22:09:26.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.914+0000 7fd0eaffd640 1 -- 172.21.15.78:0/2673986599 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fd0f4059ca0 con 0x7fd0fc072d00 2024-09-15T22:09:26.916 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-09-15T22:09:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.916+0000 7fd100e27640 1 -- 172.21.15.78:0/2673986599 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd0dc06c2b0 msgr2=0x7fd0dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.916+0000 7fd100e27640 1 --2- 172.21.15.78:0/2673986599 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd0dc06c2b0 0x7fd0dc06e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0034000 tx=0x7fd0f002e000 comp rx=0 tx=0).stop 2024-09-15T22:09:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.916+0000 7fd100e27640 1 -- 172.21.15.78:0/2673986599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0fc072d00 msgr2=0x7fd0fc141590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.916+0000 7fd100e27640 1 --2- 172.21.15.78:0/2673986599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0fc072d00 0x7fd0fc141590 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4007e40 tx=0x7fd0f400e4b0 comp rx=0 tx=0).stop 2024-09-15T22:09:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.916+0000 7fd100e27640 1 -- 172.21.15.78:0/2673986599 shutdown_connections 2024-09-15T22:09:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.916+0000 7fd100e27640 1 --2- 172.21.15.78:0/2673986599 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd0dc06c2b0 0x7fd0dc06e770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:26.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.916+0000 7fd100e27640 1 --2- 172.21.15.78:0/2673986599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0fc13f1a0 0x7fd0fc06c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:26.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.916+0000 7fd100e27640 1 --2- 172.21.15.78:0/2673986599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0fc0b5340 0x7fd0fc06c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:26.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.916+0000 7fd100e27640 1 --2- 172.21.15.78:0/2673986599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0fc072d00 0x7fd0fc141590 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:26.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.916+0000 7fd100e27640 1 -- 172.21.15.78:0/2673986599 >> 172.21.15.78:0/2673986599 conn(0x7fd0fc074ba0 msgr2=0x7fd0fc0b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:26.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.916+0000 7fd100e27640 1 -- 172.21.15.78:0/2673986599 shutdown_connections 2024-09-15T22:09:26.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:26.916+0000 7fd100e27640 1 -- 172.21.15.78:0/2673986599 wait complete. 2024-09-15T22:09:26.928 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:09:26.929 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:09:26.944 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:09:27.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.082+0000 7fd145703640 1 Processor -- start 2024-09-15T22:09:27.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.082+0000 7fd145703640 1 -- start start 2024-09-15T22:09:27.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.083+0000 7fd145703640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd140141c30 0x7fd140153a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:27.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.083+0000 7fd145703640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1400b6c90 con 0x7fd1401417f0 2024-09-15T22:09:27.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.083+0000 7fd145703640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1400b7a80 con 0x7fd1400ba270 2024-09-15T22:09:27.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.083+0000 7fd145703640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fd1401420c0 con 0x7fd140141c30 2024-09-15T22:09:27.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.083+0000 7fd13f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd140141c30 0x7fd140153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:27.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.083+0000 7fd1367fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd1401417f0 0x7fd1401502e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38424/0 (socket says 172.21.15.78:38424) 2024-09-15T22:09:27.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.083+0000 7fd1367fc640 1 -- 172.21.15.78:0/3986081556 learned_addr learned my addr 172.21.15.78:0/3986081556 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:27.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.083+0000 7fd13f7fe640 1 -- 172.21.15.78:0/3986081556 >> v1:172.21.15.175:6789/0 conn(0x7fd1400ba270 legacy=0x7fd1400b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:27.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.083+0000 7fd13f7fe640 1 -- 172.21.15.78:0/3986081556 >> v1:172.21.15.78:6789/0 conn(0x7fd1401417f0 legacy=0x7fd1401502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:27.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.083+0000 7fd13f7fe640 1 -- 172.21.15.78:0/3986081556 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1400ba650 con 0x7fd140141c30 2024-09-15T22:09:27.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.084+0000 7fd13f7fe640 1 --2- 172.21.15.78:0/3986081556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd140141c30 0x7fd140153a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd138009d90 tx=0x7fd13802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89f03569caffb40 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:27.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.084+0000 7fd13e7fc640 1 -- 172.21.15.78:0/3986081556 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd138031600 con 0x7fd140141c30 2024-09-15T22:09:27.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.084+0000 7fd13e7fc640 1 -- 172.21.15.78:0/3986081556 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1380317a0 con 0x7fd140141c30 2024-09-15T22:09:27.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.084+0000 7fd13e7fc640 1 -- 172.21.15.78:0/3986081556 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd138031b70 con 0x7fd140141c30 2024-09-15T22:09:27.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.084+0000 7fd145703640 1 -- 172.21.15.78:0/3986081556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd140141c30 msgr2=0x7fd140153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:27.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.084+0000 7fd145703640 1 --2- 172.21.15.78:0/3986081556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd140141c30 0x7fd140153a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd138009d90 tx=0x7fd13802a5d0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.084+0000 7fd145703640 1 -- 172.21.15.78:0/3986081556 shutdown_connections 2024-09-15T22:09:27.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.084+0000 7fd145703640 1 --2- 172.21.15.78:0/3986081556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd140141c30 0x7fd140153a10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.084+0000 7fd145703640 1 -- 172.21.15.78:0/3986081556 >> 172.21.15.78:0/3986081556 conn(0x7fd140074ba0 msgr2=0x7fd140074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:27.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.084+0000 7fd145703640 1 -- 172.21.15.78:0/3986081556 shutdown_connections 2024-09-15T22:09:27.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.084+0000 7fd145703640 1 -- 172.21.15.78:0/3986081556 wait complete. 2024-09-15T22:09:27.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.085+0000 7fd145703640 1 Processor -- start 2024-09-15T22:09:27.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.086+0000 7fd145703640 1 -- start start 2024-09-15T22:09:27.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.086+0000 7fd145703640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1400ba270 0x7fd14013e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:27.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.086+0000 7fd145703640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1401417f0 0x7fd14014a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:27.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.086+0000 7fd145703640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd140141c30 0x7fd140148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:27.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.086+0000 7fd145703640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd1400b74c0 con 0x7fd140141c30 2024-09-15T22:09:27.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.086+0000 7fd145703640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd1400b6f00 con 0x7fd1401417f0 2024-09-15T22:09:27.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.086+0000 7fd145703640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd1400b77a0 con 0x7fd1400ba270 2024-09-15T22:09:27.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.086+0000 7fd13f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd140141c30 0x7fd140148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:27.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.086+0000 7fd13f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd140141c30 0x7fd140148b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51188/0 (socket says 172.21.15.78:51188) 2024-09-15T22:09:27.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.086+0000 7fd13f7fe640 1 -- 172.21.15.78:0/2421979583 learned_addr learned my addr 172.21.15.78:0/2421979583 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:27.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.086+0000 7fd1367fc640 1 --2- 172.21.15.78:0/2421979583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1401417f0 0x7fd14014a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:27.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.086+0000 7fd13effd640 1 --2- 172.21.15.78:0/2421979583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1400ba270 0x7fd14013e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:27.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.087+0000 7fd13f7fe640 1 -- 172.21.15.78:0/2421979583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1400ba270 msgr2=0x7fd14013e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:27.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.087+0000 7fd13f7fe640 1 --2- 172.21.15.78:0/2421979583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1400ba270 0x7fd14013e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.087+0000 7fd13f7fe640 1 -- 172.21.15.78:0/2421979583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1401417f0 msgr2=0x7fd14014a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.087+0000 7fd13f7fe640 1 --2- 172.21.15.78:0/2421979583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1401417f0 0x7fd14014a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.087+0000 7fd13f7fe640 1 -- 172.21.15.78:0/2421979583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd140142300 con 0x7fd140141c30 2024-09-15T22:09:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.087+0000 7fd13effd640 1 --2- 172.21.15.78:0/2421979583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1400ba270 0x7fd14013e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.087+0000 7fd13f7fe640 1 --2- 172.21.15.78:0/2421979583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd140141c30 0x7fd140148b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd138009eb0 tx=0x7fd138004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.087+0000 7fd137fff640 1 -- 172.21.15.78:0/2421979583 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13803f070 con 0x7fd140141c30 2024-09-15T22:09:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.087+0000 7fd137fff640 1 -- 172.21.15.78:0/2421979583 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd138030b60 con 0x7fd140141c30 2024-09-15T22:09:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.087+0000 7fd137fff640 1 -- 172.21.15.78:0/2421979583 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd138044460 con 0x7fd140141c30 2024-09-15T22:09:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.087+0000 7fd145703640 1 -- 172.21.15.78:0/2421979583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd14013f2d0 con 0x7fd140141c30 2024-09-15T22:09:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.087+0000 7fd145703640 1 -- 172.21.15.78:0/2421979583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1400bcfe0 con 0x7fd140141c30 2024-09-15T22:09:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.088+0000 7fd145703640 1 -- 172.21.15.78:0/2421979583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd140142640 con 0x7fd140141c30 2024-09-15T22:09:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.088+0000 7fd137fff640 1 -- 172.21.15.78:0/2421979583 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd13803b410 con 0x7fd140141c30 2024-09-15T22:09:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.089+0000 7fd137fff640 1 --2- 172.21.15.78:0/2421979583 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd12006c2b0 0x7fd12006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.089+0000 7fd13effd640 1 --2- 172.21.15.78:0/2421979583 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd12006c2b0 0x7fd12006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:27.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.089+0000 7fd137fff640 1 -- 172.21.15.78:0/2421979583 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd1380acda0 con 0x7fd140141c30 2024-09-15T22:09:27.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.089+0000 7fd13effd640 1 --2- 172.21.15.78:0/2421979583 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd12006c2b0 0x7fd12006e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd1400bc430 tx=0x7fd130009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:27.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.093+0000 7fd137fff640 1 -- 172.21.15.78:0/2421979583 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd140142640 con 0x7fd140141c30 2024-09-15T22:09:27.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.273+0000 7fd145703640 1 -- 172.21.15.78:0/2421979583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd140145390 con 0x7fd140141c30 2024-09-15T22:09:27.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.273+0000 7fd137fff640 1 -- 172.21.15.78:0/2421979583 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fd13807b320 con 0x7fd140141c30 2024-09-15T22:09:27.275 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-09-15T22:09:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.275+0000 7fd145703640 1 -- 172.21.15.78:0/2421979583 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd12006c2b0 msgr2=0x7fd12006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.275+0000 7fd145703640 1 --2- 172.21.15.78:0/2421979583 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd12006c2b0 0x7fd12006e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd1400bc430 tx=0x7fd130009040 comp rx=0 tx=0).stop 2024-09-15T22:09:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.275+0000 7fd145703640 1 -- 172.21.15.78:0/2421979583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd140141c30 msgr2=0x7fd140148b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.275+0000 7fd145703640 1 --2- 172.21.15.78:0/2421979583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd140141c30 0x7fd140148b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd138009eb0 tx=0x7fd138004a40 comp rx=0 tx=0).stop 2024-09-15T22:09:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.275+0000 7fd145703640 1 -- 172.21.15.78:0/2421979583 shutdown_connections 2024-09-15T22:09:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.275+0000 7fd145703640 1 --2- 172.21.15.78:0/2421979583 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd12006c2b0 0x7fd12006e770 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.275+0000 7fd145703640 1 --2- 172.21.15.78:0/2421979583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd140141c30 0x7fd140148b20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.275+0000 7fd145703640 1 --2- 172.21.15.78:0/2421979583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1401417f0 0x7fd14014a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.275+0000 7fd145703640 1 --2- 172.21.15.78:0/2421979583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1400ba270 0x7fd14013e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.275+0000 7fd145703640 1 -- 172.21.15.78:0/2421979583 >> 172.21.15.78:0/2421979583 conn(0x7fd140074ba0 msgr2=0x7fd140147990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.275+0000 7fd145703640 1 -- 172.21.15.78:0/2421979583 shutdown_connections 2024-09-15T22:09:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:27.275+0000 7fd145703640 1 -- 172.21.15.78:0/2421979583 wait complete. 2024-09-15T22:09:27.288 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi078.front.sepia.ceph.com... 2024-09-15T22:09:27.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:27.288 DEBUG:teuthology.orchestra.run.smithi078:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:09:27.311 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi078.stderr:ceph-fuse[41301]: fuse finished with error 0 and tester_r 0 2024-09-15T22:09:27.313 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:09:33.414 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2024-09-15T22:09:33.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:33.414 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-15T22:09:33.440 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:09:33.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.592+0000 7f7d9cff8640 1 Processor -- start 2024-09-15T22:09:33.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.592+0000 7f7d9cff8640 1 -- start start 2024-09-15T22:09:33.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.592+0000 7f7d9cff8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d980730f0 0x7f7d98073850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:33.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.592+0000 7f7d9cff8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d980b6c20 con 0x7f7d9806d5e0 2024-09-15T22:09:33.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.592+0000 7f7d9cff8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9806bd30 con 0x7f7d9806d9c0 2024-09-15T22:09:33.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.592+0000 7f7d9cff8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7d980b76a0 con 0x7f7d980730f0 2024-09-15T22:09:33.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d9659c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7d9806d5e0 0x7f7d980b5e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56968/0 (socket says 172.21.15.78:56968) 2024-09-15T22:09:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d9659c640 1 -- 172.21.15.78:0/3054535099 learned_addr learned my addr 172.21.15.78:0/3054535099 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d96d9d640 1 --2- 172.21.15.78:0/3054535099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d980730f0 0x7f7d98073850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507821949 0 0) 0x7f7d980b6c20 con 0x7f7d9806d5e0 2024-09-15T22:09:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d84003520 con 0x7f7d9806d5e0 2024-09-15T22:09:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1372618863 0 0) 0x7f7d9806bd30 con 0x7f7d9806d9c0 2024-09-15T22:09:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d980b6c20 con 0x7f7d9806d9c0 2024-09-15T22:09:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1292588068 0 0) 0x7f7d84003520 con 0x7f7d9806d5e0 2024-09-15T22:09:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d980730f0 msgr2=0x7f7d98073850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 --2- 172.21.15.78:0/3054535099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d980730f0 0x7f7d98073850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 >> v1:172.21.15.175:6789/0 conn(0x7f7d9806d9c0 legacy=0x7f7d980b6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d980722a0 con 0x7f7d9806d5e0 2024-09-15T22:09:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3961011974 0 0) 0x7f7d88001670 con 0x7f7d9806d5e0 2024-09-15T22:09:33.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 >> v1:172.21.15.78:6789/0 conn(0x7f7d9806d5e0 legacy=0x7f7d980b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:33.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 --2- 172.21.15.78:0/3054535099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d980730f0 0x7f7d84003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:33.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 --2- 172.21.15.78:0/3054535099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d840040d0 0x7f7d84004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:33.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 --2- 172.21.15.78:0/3054535099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d84004d40 0x7f7d840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:33.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7d980b76a0 con 0x7f7d840040d0 2024-09-15T22:09:33.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8400baa0 con 0x7f7d84004d40 2024-09-15T22:09:33.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8400bca0 con 0x7f7d980730f0 2024-09-15T22:09:33.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d8dd9b640 1 --2- 172.21.15.78:0/3054535099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d840040d0 0x7f7d84004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:33.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d9659c640 1 --2- 172.21.15.78:0/3054535099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d980730f0 0x7f7d84003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:33.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.593+0000 7f7d96d9d640 1 --2- 172.21.15.78:0/3054535099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d84004d40 0x7f7d840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.594+0000 7f7d8dd9b640 1 -- 172.21.15.78:0/3054535099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d980730f0 msgr2=0x7f7d84003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.594+0000 7f7d8dd9b640 1 --2- 172.21.15.78:0/3054535099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d980730f0 0x7f7d84003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.594+0000 7f7d8dd9b640 1 -- 172.21.15.78:0/3054535099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d84004d40 msgr2=0x7f7d840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.594+0000 7f7d8dd9b640 1 --2- 172.21.15.78:0/3054535099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d84004d40 0x7f7d840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.594+0000 7f7d8dd9b640 1 -- 172.21.15.78:0/3054535099 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d84003520 con 0x7f7d840040d0 2024-09-15T22:09:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.594+0000 7f7d8dd9b640 1 --2- 172.21.15.78:0/3054535099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d840040d0 0x7f7d84004800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d800018d0 tx=0x7f7d84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac1b75e9cd55e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.595+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d800014f0 con 0x7f7d840040d0 2024-09-15T22:09:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.595+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d800052d0 con 0x7f7d840040d0 2024-09-15T22:09:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.595+0000 7f7d95d9b640 1 -- 172.21.15.78:0/3054535099 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8002aca0 con 0x7f7d840040d0 2024-09-15T22:09:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.595+0000 7f7d9cff8640 1 -- 172.21.15.78:0/3054535099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d840040d0 msgr2=0x7f7d84004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.595+0000 7f7d9cff8640 1 --2- 172.21.15.78:0/3054535099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d840040d0 0x7f7d84004800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d800018d0 tx=0x7f7d84005830 comp rx=0 tx=0).stop 2024-09-15T22:09:33.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.595+0000 7f7d96d9d640 1 -- 172.21.15.78:0/3054535099 reap_dead start 2024-09-15T22:09:33.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.595+0000 7f7d9cff8640 1 -- 172.21.15.78:0/3054535099 shutdown_connections 2024-09-15T22:09:33.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.595+0000 7f7d9cff8640 1 -- 172.21.15.78:0/3054535099 >> 172.21.15.78:0/3054535099 conn(0x7f7d98074ba0 msgr2=0x7f7d98074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:33.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.595+0000 7f7d9cff8640 1 -- 172.21.15.78:0/3054535099 shutdown_connections 2024-09-15T22:09:33.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.595+0000 7f7d9cff8640 1 -- 172.21.15.78:0/3054535099 wait complete. 2024-09-15T22:09:33.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.597+0000 7f7d9cff8640 1 Processor -- start 2024-09-15T22:09:33.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.597+0000 7f7d9cff8640 1 -- start start 2024-09-15T22:09:33.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.597+0000 7f7d9cff8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d840040d0 0x7f7d980b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.597+0000 7f7d9cff8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d980b3200 0x7f7d98142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.597+0000 7f7d9cff8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d981434b0 0x7f7d981e0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.597+0000 7f7d9cff8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7d98072bd0 con 0x7f7d840040d0 2024-09-15T22:09:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.597+0000 7f7d9cff8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7d98072580 con 0x7f7d980b3200 2024-09-15T22:09:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.597+0000 7f7d9cff8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7d9806cc90 con 0x7f7d981434b0 2024-09-15T22:09:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.597+0000 7f7d9659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d840040d0 0x7f7d980b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.597+0000 7f7d9659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d840040d0 0x7f7d980b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49522/0 (socket says 172.21.15.78:49522) 2024-09-15T22:09:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.597+0000 7f7d9659c640 1 -- 172.21.15.78:0/2310978866 learned_addr learned my addr 172.21.15.78:0/2310978866 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.597+0000 7f7d96d9d640 1 --2- 172.21.15.78:0/2310978866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d981434b0 0x7f7d981e0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.597+0000 7f7d8dd9b640 1 --2- 172.21.15.78:0/2310978866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d980b3200 0x7f7d98142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.598+0000 7f7d9659c640 1 -- 172.21.15.78:0/2310978866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d981434b0 msgr2=0x7f7d981e0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.598+0000 7f7d9659c640 1 --2- 172.21.15.78:0/2310978866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d981434b0 0x7f7d981e0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.598+0000 7f7d9659c640 1 -- 172.21.15.78:0/2310978866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d980b3200 msgr2=0x7f7d98142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.598+0000 7f7d9659c640 1 --2- 172.21.15.78:0/2310978866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d980b3200 0x7f7d98142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.598+0000 7f7d9659c640 1 -- 172.21.15.78:0/2310978866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d980b3ec0 con 0x7f7d840040d0 2024-09-15T22:09:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.598+0000 7f7d9659c640 1 --2- 172.21.15.78:0/2310978866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d840040d0 0x7f7d980b0aa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7d88007340 tx=0x7f7d88007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.598+0000 7f7d8f7fe640 1 -- 172.21.15.78:0/2310978866 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8800f860 con 0x7f7d840040d0 2024-09-15T22:09:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.598+0000 7f7d8f7fe640 1 -- 172.21.15.78:0/2310978866 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d88018070 con 0x7f7d840040d0 2024-09-15T22:09:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.598+0000 7f7d8f7fe640 1 -- 172.21.15.78:0/2310978866 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8800fc60 con 0x7f7d840040d0 2024-09-15T22:09:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.598+0000 7f7d9cff8640 1 -- 172.21.15.78:0/2310978866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d98142790 con 0x7f7d840040d0 2024-09-15T22:09:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.598+0000 7f7d9cff8640 1 -- 172.21.15.78:0/2310978866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d98142a50 con 0x7f7d840040d0 2024-09-15T22:09:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.599+0000 7f7d9cff8640 1 -- 172.21.15.78:0/2310978866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d98073850 con 0x7f7d840040d0 2024-09-15T22:09:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.600+0000 7f7d8f7fe640 1 -- 172.21.15.78:0/2310978866 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7d8801d460 con 0x7f7d840040d0 2024-09-15T22:09:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.600+0000 7f7d8f7fe640 1 --2- 172.21.15.78:0/2310978866 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7d7806c2e0 0x7f7d7806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.600+0000 7f7d8f7fe640 1 -- 172.21.15.78:0/2310978866 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7d8808b5b0 con 0x7f7d840040d0 2024-09-15T22:09:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.600+0000 7f7d8dd9b640 1 --2- 172.21.15.78:0/2310978866 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7d7806c2e0 0x7f7d7806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.600+0000 7f7d8dd9b640 1 --2- 172.21.15.78:0/2310978866 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7d7806c2e0 0x7f7d7806e7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7d80032000 tx=0x7f7d80009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:33.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.604+0000 7f7d8f7fe640 1 -- 172.21.15.78:0/2310978866 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d88059420 con 0x7f7d840040d0 2024-09-15T22:09:33.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.771+0000 7f7d9cff8640 1 -- 172.21.15.78:0/2310978866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d98075a40 con 0x7f7d840040d0 2024-09-15T22:09:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.773+0000 7f7d8f7fe640 1 -- 172.21.15.78:0/2310978866 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7f7d8805d720 con 0x7f7d840040d0 2024-09-15T22:09:33.775 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:33.775 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"34e44e87-1d1a-416f-b208-c16e07980ff5","created":"2024-09-15T22:08:53.842443+0000","modified":"2024-09-15T22:09:21.780555+0000","last_up_change":"2024-09-15T22:09:04.830042+0000","last_in_change":"2024-09-15T22:08:55.864039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:05.999373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:14.532061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:15.710676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:09:19.437681+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"71eb9af6-bf66-4450-a5d1-d4a81f71f95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6817","nonce":3548923409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6819","nonce":3548923409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6823","nonce":3548923409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6821","nonce":3548923409}]},"public_addr":"172.21.15.78:6817/3548923409","cluster_addr":"172.21.15.78:6819/3548923409","heartbeat_back_addr":"172.21.15.78:6823/3548923409","heartbeat_front_addr":"172.21.15.78:6821/3548923409","state":["exists","up"]},{"osd":1,"uuid":"f0070f6d-7998-4ad3-b597-e5777e61d503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6809","nonce":1233827941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6811","nonce":1233827941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6815","nonce":1233827941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6813","nonce":1233827941}]},"public_addr":"172.21.15.78:6809/1233827941","cluster_addr":"172.21.15.78:6811/1233827941","heartbeat_back_addr":"172.21.15.78:6815/1233827941","heartbeat_front_addr":"172.21.15.78:6813/1233827941","state":["exists","up"]},{"osd":2,"uuid":"6d9c91c7-2c8a-48f9-9bef-67ea7320980e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6825","nonce":636523247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6827","nonce":636523247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6831","nonce":636523247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6829","nonce":636523247}]},"public_addr":"172.21.15.78:6825/636523247","cluster_addr":"172.21.15.78:6827/636523247","heartbeat_back_addr":"172.21.15.78:6831/636523247","heartbeat_front_addr":"172.21.15.78:6829/636523247","state":["exists","up"]},{"osd":3,"uuid":"943e38fb-b450-48c0-8f01-d381b0b8e313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6801","nonce":1841812488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6803","nonce":1841812488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6807","nonce":1841812488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6805","nonce":1841812488}]},"public_addr":"172.21.15.78:6801/1841812488","cluster_addr":"172.21.15.78:6803/1841812488","heartbeat_back_addr":"172.21.15.78:6807/1841812488","heartbeat_front_addr":"172.21.15.78:6805/1841812488","state":["exists","up"]},{"osd":4,"uuid":"259f50f8-3223-450d-8cd1-d0d333c278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6817","nonce":1803357070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6819","nonce":1803357070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6823","nonce":1803357070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6821","nonce":1803357070}]},"public_addr":"172.21.15.175:6817/1803357070","cluster_addr":"172.21.15.175:6819/1803357070","heartbeat_back_addr":"172.21.15.175:6823/1803357070","heartbeat_front_addr":"172.21.15.175:6821/1803357070","state":["exists","up"]},{"osd":5,"uuid":"d70426cd-a39b-4a20-8c7b-bedc8352e303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6825","nonce":2221415707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6827","nonce":2221415707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6831","nonce":2221415707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6829","nonce":2221415707}]},"public_addr":"172.21.15.175:6825/2221415707","cluster_addr":"172.21.15.175:6827/2221415707","heartbeat_back_addr":"172.21.15.175:6831/2221415707","heartbeat_front_addr":"172.21.15.175:6829/2221415707","state":["exists","up"]},{"osd":6,"uuid":"95b9ed3a-cbfc-45a5-8967-88db9da099ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6801","nonce":1974018373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6803","nonce":1974018373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6807","nonce":1974018373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6805","nonce":1974018373}]},"public_addr":"172.21.15.175:6801/1974018373","cluster_addr":"172.21.15.175:6803/1974018373","heartbeat_back_addr":"172.21.15.175:6807/1974018373","heartbeat_front_addr":"172.21.15.175:6805/1974018373","state":["exists","up"]},{"osd":7,"uuid":"5fc56286-91e9-4a13-b161-ad7d30fc0119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6809","nonce":2386415083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6811","nonce":2386415083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6815","nonce":2386415083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6813","nonce":2386415083}]},"public_addr":"172.21.15.175:6809/2386415083","cluster_addr":"172.21.15.175:6811/2386415083","heartbeat_back_addr":"172.21.15.175:6815/2386415083","heartbeat_front_addr":"172.21.15.175:6813/2386415083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.191845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.871482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.594323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.463568+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.398880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.490112+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.119097+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.677350+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:09:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.775+0000 7f7d9cff8640 1 -- 172.21.15.78:0/2310978866 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7d7806c2e0 msgr2=0x7f7d7806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.775+0000 7f7d9cff8640 1 --2- 172.21.15.78:0/2310978866 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7d7806c2e0 0x7f7d7806e7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7d80032000 tx=0x7f7d80009030 comp rx=0 tx=0).stop 2024-09-15T22:09:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.775+0000 7f7d9cff8640 1 -- 172.21.15.78:0/2310978866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d840040d0 msgr2=0x7f7d980b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.775+0000 7f7d9cff8640 1 --2- 172.21.15.78:0/2310978866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d840040d0 0x7f7d980b0aa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7d88007340 tx=0x7f7d88007800 comp rx=0 tx=0).stop 2024-09-15T22:09:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.775+0000 7f7d9cff8640 1 -- 172.21.15.78:0/2310978866 shutdown_connections 2024-09-15T22:09:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.775+0000 7f7d9cff8640 1 --2- 172.21.15.78:0/2310978866 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7d7806c2e0 0x7f7d7806e7a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.775+0000 7f7d9cff8640 1 --2- 172.21.15.78:0/2310978866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d981434b0 0x7f7d981e0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.775+0000 7f7d9cff8640 1 --2- 172.21.15.78:0/2310978866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d980b3200 0x7f7d98142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.775+0000 7f7d9cff8640 1 --2- 172.21.15.78:0/2310978866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d840040d0 0x7f7d980b0aa0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.775+0000 7f7d9cff8640 1 -- 172.21.15.78:0/2310978866 >> 172.21.15.78:0/2310978866 conn(0x7f7d98074ba0 msgr2=0x7f7d980b9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.775+0000 7f7d9cff8640 1 -- 172.21.15.78:0/2310978866 shutdown_connections 2024-09-15T22:09:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.775+0000 7f7d9cff8640 1 -- 172.21.15.78:0/2310978866 wait complete. 2024-09-15T22:09:33.788 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:09:33.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.885+0000 7f6e14cac640 1 Processor -- start 2024-09-15T22:09:33.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.885+0000 7f6e14cac640 1 -- start start 2024-09-15T22:09:33.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.886+0000 7f6e14cac640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e10074e10 0x7f6e100b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:33.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.886+0000 7f6e14cac640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e100af380 0x7f6e10141de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:33.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.886+0000 7f6e14cac640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e100751f0 con 0x7f6e100aef50 2024-09-15T22:09:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.886+0000 7f6e14cac640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f6e100b0d00 con 0x7f6e10074e10 2024-09-15T22:09:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.886+0000 7f6e14cac640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6e100b6510 con 0x7f6e100af380 2024-09-15T22:09:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.886+0000 7f6e0e59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e10074e10 0x7f6e100b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.886+0000 7f6e0dd9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6e100aef50 0x7f6e101416d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56972/0 (socket says 172.21.15.78:56972) 2024-09-15T22:09:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.886+0000 7f6e0dd9b640 1 -- 172.21.15.78:0/3893149907 learned_addr learned my addr 172.21.15.78:0/3893149907 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.887+0000 7f6e0ed9d640 1 --2- 172.21.15.78:0/3893149907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e100af380 0x7f6e10141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.887+0000 7f6e0e59c640 1 -- 172.21.15.78:0/3893149907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e100af380 msgr2=0x7f6e10141de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.887+0000 7f6e0e59c640 1 --2- 172.21.15.78:0/3893149907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e100af380 0x7f6e10141de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.887+0000 7f6e0e59c640 1 -- 172.21.15.78:0/3893149907 >> v1:172.21.15.78:6789/0 conn(0x7f6e100aef50 legacy=0x7f6e101416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.887+0000 7f6e0e59c640 1 -- 172.21.15.78:0/3893149907 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e100b0fc0 con 0x7f6e10074e10 2024-09-15T22:09:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.887+0000 7f6e0e59c640 1 --2- 172.21.15.78:0/3893149907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e10074e10 0x7f6e100b5ef0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009d90 tx=0x7f6e0002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7883e906d661b4e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:33.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.888+0000 7f6e0d59a640 1 -- 172.21.15.78:0/3893149907 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00007740 con 0x7f6e10074e10 2024-09-15T22:09:33.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.888+0000 7f6e0d59a640 1 -- 172.21.15.78:0/3893149907 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e000078e0 con 0x7f6e10074e10 2024-09-15T22:09:33.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.888+0000 7f6e0d59a640 1 -- 172.21.15.78:0/3893149907 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00007cb0 con 0x7f6e10074e10 2024-09-15T22:09:33.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.888+0000 7f6e14cac640 1 -- 172.21.15.78:0/3893149907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e10074e10 msgr2=0x7f6e100b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.888+0000 7f6e14cac640 1 --2- 172.21.15.78:0/3893149907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e10074e10 0x7f6e100b5ef0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009d90 tx=0x7f6e0002a660 comp rx=0 tx=0).stop 2024-09-15T22:09:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.888+0000 7f6e14cac640 1 -- 172.21.15.78:0/3893149907 shutdown_connections 2024-09-15T22:09:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.888+0000 7f6e14cac640 1 --2- 172.21.15.78:0/3893149907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e100af380 0x7f6e10141de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.888+0000 7f6e14cac640 1 --2- 172.21.15.78:0/3893149907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e10074e10 0x7f6e100b5ef0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.888+0000 7f6e14cac640 1 -- 172.21.15.78:0/3893149907 >> 172.21.15.78:0/3893149907 conn(0x7f6e1006c3d0 msgr2=0x7f6e100ba380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.888+0000 7f6e14cac640 1 -- 172.21.15.78:0/3893149907 shutdown_connections 2024-09-15T22:09:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.888+0000 7f6e14cac640 1 -- 172.21.15.78:0/3893149907 wait complete. 2024-09-15T22:09:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.889+0000 7f6e14cac640 1 Processor -- start 2024-09-15T22:09:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.889+0000 7f6e14cac640 1 -- start start 2024-09-15T22:09:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.890+0000 7f6e14cac640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e10074e10 0x7f6e1014a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.890+0000 7f6e14cac640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e100aef50 0x7f6e101d2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.890+0000 7f6e14cac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e100af380 0x7f6e100711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.890+0000 7f6e14cac640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6e100ae880 con 0x7f6e100af380 2024-09-15T22:09:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.890+0000 7f6e14cac640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e100b14e0 con 0x7f6e100aef50 2024-09-15T22:09:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.890+0000 7f6e14cac640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6e100aea00 con 0x7f6e10074e10 2024-09-15T22:09:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.890+0000 7f6e0ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e100af380 0x7f6e100711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.890+0000 7f6e0ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e100af380 0x7f6e100711e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49538/0 (socket says 172.21.15.78:49538) 2024-09-15T22:09:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.890+0000 7f6e0ed9d640 1 -- 172.21.15.78:0/3742233975 learned_addr learned my addr 172.21.15.78:0/3742233975 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.890+0000 7f6e0ed9d640 1 -- 172.21.15.78:0/3742233975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e10074e10 msgr2=0x7f6e1014a650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:09:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.890+0000 7f6e0ed9d640 1 --2- 172.21.15.78:0/3742233975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e10074e10 0x7f6e1014a650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.890+0000 7f6e0ed9d640 1 -- 172.21.15.78:0/3742233975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e100aef50 msgr2=0x7f6e101d2350 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:09:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.890+0000 7f6e0ed9d640 1 --2- 172.21.15.78:0/3742233975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e100aef50 0x7f6e101d2350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.890+0000 7f6e0ed9d640 1 -- 172.21.15.78:0/3742233975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e101d2890 con 0x7f6e100af380 2024-09-15T22:09:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.891+0000 7f6e0ed9d640 1 --2- 172.21.15.78:0/3742233975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e100af380 0x7f6e100711e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800d5d0 tx=0x7f6e0800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.891+0000 7f6e06ffd640 1 -- 172.21.15.78:0/3742233975 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e080125f0 con 0x7f6e100af380 2024-09-15T22:09:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.891+0000 7f6e06ffd640 1 -- 172.21.15.78:0/3742233975 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e08019070 con 0x7f6e100af380 2024-09-15T22:09:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.891+0000 7f6e14cac640 1 -- 172.21.15.78:0/3742233975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1014b960 con 0x7f6e100af380 2024-09-15T22:09:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.891+0000 7f6e06ffd640 1 -- 172.21.15.78:0/3742233975 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e080129f0 con 0x7f6e100af380 2024-09-15T22:09:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.891+0000 7f6e14cac640 1 -- 172.21.15.78:0/3742233975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e100719f0 con 0x7f6e100af380 2024-09-15T22:09:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.892+0000 7f6e14cac640 1 -- 172.21.15.78:0/3742233975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e10071d30 con 0x7f6e100af380 2024-09-15T22:09:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.892+0000 7f6e06ffd640 1 -- 172.21.15.78:0/3742233975 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6e08012b90 con 0x7f6e100af380 2024-09-15T22:09:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.893+0000 7f6e06ffd640 1 --2- 172.21.15.78:0/3742233975 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f6df006c2b0 0x7f6df006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.893+0000 7f6e0e59c640 1 --2- 172.21.15.78:0/3742233975 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f6df006c2b0 0x7f6df006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.893+0000 7f6e06ffd640 1 -- 172.21.15.78:0/3742233975 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6e0808bb40 con 0x7f6e100af380 2024-09-15T22:09:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.893+0000 7f6e0e59c640 1 --2- 172.21.15.78:0/3742233975 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f6df006c2b0 0x7f6df006e770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6e00034000 tx=0x7f6e0002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:33.897+0000 7f6e06ffd640 1 -- 172.21.15.78:0/3742233975 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e10071d30 con 0x7f6e100af380 2024-09-15T22:09:34.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.068+0000 7f6e14cac640 1 -- 172.21.15.78:0/3742233975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e100b5ef0 con 0x7f6e100af380 2024-09-15T22:09:34.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.069+0000 7f6e06ffd640 1 -- 172.21.15.78:0/3742233975 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7f6e08059f80 con 0x7f6e100af380 2024-09-15T22:09:34.071 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:34.071 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"34e44e87-1d1a-416f-b208-c16e07980ff5","created":"2024-09-15T22:08:53.842443+0000","modified":"2024-09-15T22:09:21.780555+0000","last_up_change":"2024-09-15T22:09:04.830042+0000","last_in_change":"2024-09-15T22:08:55.864039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:05.999373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:14.532061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:15.710676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:09:19.437681+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"71eb9af6-bf66-4450-a5d1-d4a81f71f95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6817","nonce":3548923409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6819","nonce":3548923409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6823","nonce":3548923409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6821","nonce":3548923409}]},"public_addr":"172.21.15.78:6817/3548923409","cluster_addr":"172.21.15.78:6819/3548923409","heartbeat_back_addr":"172.21.15.78:6823/3548923409","heartbeat_front_addr":"172.21.15.78:6821/3548923409","state":["exists","up"]},{"osd":1,"uuid":"f0070f6d-7998-4ad3-b597-e5777e61d503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6809","nonce":1233827941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6811","nonce":1233827941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6815","nonce":1233827941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6813","nonce":1233827941}]},"public_addr":"172.21.15.78:6809/1233827941","cluster_addr":"172.21.15.78:6811/1233827941","heartbeat_back_addr":"172.21.15.78:6815/1233827941","heartbeat_front_addr":"172.21.15.78:6813/1233827941","state":["exists","up"]},{"osd":2,"uuid":"6d9c91c7-2c8a-48f9-9bef-67ea7320980e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6825","nonce":636523247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6827","nonce":636523247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6831","nonce":636523247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6829","nonce":636523247}]},"public_addr":"172.21.15.78:6825/636523247","cluster_addr":"172.21.15.78:6827/636523247","heartbeat_back_addr":"172.21.15.78:6831/636523247","heartbeat_front_addr":"172.21.15.78:6829/636523247","state":["exists","up"]},{"osd":3,"uuid":"943e38fb-b450-48c0-8f01-d381b0b8e313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6801","nonce":1841812488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6803","nonce":1841812488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6807","nonce":1841812488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6805","nonce":1841812488}]},"public_addr":"172.21.15.78:6801/1841812488","cluster_addr":"172.21.15.78:6803/1841812488","heartbeat_back_addr":"172.21.15.78:6807/1841812488","heartbeat_front_addr":"172.21.15.78:6805/1841812488","state":["exists","up"]},{"osd":4,"uuid":"259f50f8-3223-450d-8cd1-d0d333c278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6817","nonce":1803357070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6819","nonce":1803357070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6823","nonce":1803357070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6821","nonce":1803357070}]},"public_addr":"172.21.15.175:6817/1803357070","cluster_addr":"172.21.15.175:6819/1803357070","heartbeat_back_addr":"172.21.15.175:6823/1803357070","heartbeat_front_addr":"172.21.15.175:6821/1803357070","state":["exists","up"]},{"osd":5,"uuid":"d70426cd-a39b-4a20-8c7b-bedc8352e303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6825","nonce":2221415707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6827","nonce":2221415707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6831","nonce":2221415707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6829","nonce":2221415707}]},"public_addr":"172.21.15.175:6825/2221415707","cluster_addr":"172.21.15.175:6827/2221415707","heartbeat_back_addr":"172.21.15.175:6831/2221415707","heartbeat_front_addr":"172.21.15.175:6829/2221415707","state":["exists","up"]},{"osd":6,"uuid":"95b9ed3a-cbfc-45a5-8967-88db9da099ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6801","nonce":1974018373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6803","nonce":1974018373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6807","nonce":1974018373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6805","nonce":1974018373}]},"public_addr":"172.21.15.175:6801/1974018373","cluster_addr":"172.21.15.175:6803/1974018373","heartbeat_back_addr":"172.21.15.175:6807/1974018373","heartbeat_front_addr":"172.21.15.175:6805/1974018373","state":["exists","up"]},{"osd":7,"uuid":"5fc56286-91e9-4a13-b161-ad7d30fc0119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6809","nonce":2386415083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6811","nonce":2386415083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6815","nonce":2386415083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6813","nonce":2386415083}]},"public_addr":"172.21.15.175:6809/2386415083","cluster_addr":"172.21.15.175:6811/2386415083","heartbeat_back_addr":"172.21.15.175:6815/2386415083","heartbeat_front_addr":"172.21.15.175:6813/2386415083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.191845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.871482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.594323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.463568+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.398880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.490112+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.119097+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.677350+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:09:34.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.071+0000 7f6e14cac640 1 -- 172.21.15.78:0/3742233975 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f6df006c2b0 msgr2=0x7f6df006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:34.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.071+0000 7f6e14cac640 1 --2- 172.21.15.78:0/3742233975 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f6df006c2b0 0x7f6df006e770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6e00034000 tx=0x7f6e0002f000 comp rx=0 tx=0).stop 2024-09-15T22:09:34.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.071+0000 7f6e14cac640 1 -- 172.21.15.78:0/3742233975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e100af380 msgr2=0x7f6e100711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:34.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.071+0000 7f6e14cac640 1 --2- 172.21.15.78:0/3742233975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e100af380 0x7f6e100711e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800d5d0 tx=0x7f6e0800da90 comp rx=0 tx=0).stop 2024-09-15T22:09:34.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.071+0000 7f6e14cac640 1 -- 172.21.15.78:0/3742233975 shutdown_connections 2024-09-15T22:09:34.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.071+0000 7f6e14cac640 1 --2- 172.21.15.78:0/3742233975 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f6df006c2b0 0x7f6df006e770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.071+0000 7f6e14cac640 1 --2- 172.21.15.78:0/3742233975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e100af380 0x7f6e100711e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.071+0000 7f6e14cac640 1 --2- 172.21.15.78:0/3742233975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e100aef50 0x7f6e101d2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.071+0000 7f6e14cac640 1 --2- 172.21.15.78:0/3742233975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e10074e10 0x7f6e1014a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.071+0000 7f6e14cac640 1 -- 172.21.15.78:0/3742233975 >> 172.21.15.78:0/3742233975 conn(0x7f6e1006c3d0 msgr2=0x7f6e10145c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:34.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.071+0000 7f6e14cac640 1 -- 172.21.15.78:0/3742233975 shutdown_connections 2024-09-15T22:09:34.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.071+0000 7f6e14cac640 1 -- 172.21.15.78:0/3742233975 wait complete. 2024-09-15T22:09:34.084 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:09:34.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.183+0000 7f95073bd640 1 Processor -- start 2024-09-15T22:09:34.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.183+0000 7f95073bd640 1 -- start start 2024-09-15T22:09:34.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.184+0000 7f95073bd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f950006d530 0x7f95000737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:34.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.184+0000 7f95073bd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9500073100 0x7f950014b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:34.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.184+0000 7f95073bd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950014bb80 0x7f95000b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:34.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.184+0000 7f95073bd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f95000729b0 con 0x7f950006d530 2024-09-15T22:09:34.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.184+0000 7f95073bd640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9500073d30 con 0x7f9500073100 2024-09-15T22:09:34.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.184+0000 7f95073bd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f950006d910 con 0x7f950014bb80 2024-09-15T22:09:34.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.184+0000 7f9505159640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f950006d530 0x7f95000737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:34.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.184+0000 7f9505159640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f950006d530 0x7f95000737f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49554/0 (socket says 172.21.15.78:49554) 2024-09-15T22:09:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.184+0000 7f9505159640 1 -- 172.21.15.78:0/3056365584 learned_addr learned my addr 172.21.15.78:0/3056365584 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.184+0000 7f9504958640 1 --2- 172.21.15.78:0/3056365584 >> v2:172.21.15.175:3300/0 conn(0x7f9500073100 0x7f950014b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.184+0000 7f950595a640 1 --2- 172.21.15.78:0/3056365584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950014bb80 0x7f95000b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.184+0000 7f9505159640 1 -- 172.21.15.78:0/3056365584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950014bb80 msgr2=0x7f95000b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.184+0000 7f9505159640 1 --2- 172.21.15.78:0/3056365584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950014bb80 0x7f95000b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.184+0000 7f9505159640 1 -- 172.21.15.78:0/3056365584 >> v2:172.21.15.175:3300/0 conn(0x7f9500073100 msgr2=0x7f950014b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.185+0000 7f9505159640 1 --2- 172.21.15.78:0/3056365584 >> v2:172.21.15.175:3300/0 conn(0x7f9500073100 0x7f950014b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.185+0000 7f9505159640 1 -- 172.21.15.78:0/3056365584 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950006ebc0 con 0x7f950006d530 2024-09-15T22:09:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.185+0000 7f950595a640 1 --2- 172.21.15.78:0/3056365584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950014bb80 0x7f95000b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.185+0000 7f9505159640 1 --2- 172.21.15.78:0/3056365584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f950006d530 0x7f95000737f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9500071b30 tx=0x7f94fc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38774c3f5eb761f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.185+0000 7f94f7fff640 1 -- 172.21.15.78:0/3056365584 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc036070 con 0x7f950006d530 2024-09-15T22:09:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.185+0000 7f94f7fff640 1 -- 172.21.15.78:0/3056365584 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94fc031600 con 0x7f950006d530 2024-09-15T22:09:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.185+0000 7f94f7fff640 1 -- 172.21.15.78:0/3056365584 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc0319d0 con 0x7f950006d530 2024-09-15T22:09:34.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.186+0000 7f95073bd640 1 -- 172.21.15.78:0/3056365584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f950006d530 msgr2=0x7f95000737f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:34.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.186+0000 7f95073bd640 1 --2- 172.21.15.78:0/3056365584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f950006d530 0x7f95000737f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9500071b30 tx=0x7f94fc02a610 comp rx=0 tx=0).stop 2024-09-15T22:09:34.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.186+0000 7f95073bd640 1 -- 172.21.15.78:0/3056365584 shutdown_connections 2024-09-15T22:09:34.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.186+0000 7f95073bd640 1 --2- 172.21.15.78:0/3056365584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950014bb80 0x7f95000b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.186+0000 7f95073bd640 1 --2- 172.21.15.78:0/3056365584 >> v2:172.21.15.175:3300/0 conn(0x7f9500073100 0x7f950014b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.186+0000 7f95073bd640 1 --2- 172.21.15.78:0/3056365584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f950006d530 0x7f95000737f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.186+0000 7f95073bd640 1 -- 172.21.15.78:0/3056365584 >> 172.21.15.78:0/3056365584 conn(0x7f95000bb390 msgr2=0x7f95000bb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:34.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.186+0000 7f95073bd640 1 -- 172.21.15.78:0/3056365584 shutdown_connections 2024-09-15T22:09:34.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.186+0000 7f95073bd640 1 -- 172.21.15.78:0/3056365584 wait complete. 2024-09-15T22:09:34.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.187+0000 7f95073bd640 1 Processor -- start 2024-09-15T22:09:34.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.187+0000 7f95073bd640 1 -- start start 2024-09-15T22:09:34.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f95073bd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950006d530 0x7f95001de000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:34.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f95073bd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9500073100 0x7f9500148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:34.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f95073bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f950014bb80 0x7f95001e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:34.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f95073bd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f95000b7350 con 0x7f950014bb80 2024-09-15T22:09:34.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f95073bd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f950006bc10 con 0x7f9500073100 2024-09-15T22:09:34.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f95073bd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9500072be0 con 0x7f950006d530 2024-09-15T22:09:34.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f950595a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f950014bb80 0x7f95001e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:34.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f950595a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f950014bb80 0x7f95001e0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49568/0 (socket says 172.21.15.78:49568) 2024-09-15T22:09:34.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f950595a640 1 -- 172.21.15.78:0/3092371291 learned_addr learned my addr 172.21.15.78:0/3092371291 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:34.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f9504958640 1 --2- 172.21.15.78:0/3092371291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9500073100 0x7f9500148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:34.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f9505159640 1 --2- 172.21.15.78:0/3092371291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950006d530 0x7f95001de000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:34.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f950595a640 1 -- 172.21.15.78:0/3092371291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950006d530 msgr2=0x7f95001de000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:34.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f950595a640 1 --2- 172.21.15.78:0/3092371291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950006d530 0x7f95001de000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f950595a640 1 -- 172.21.15.78:0/3092371291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9500073100 msgr2=0x7f9500148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:34.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f950595a640 1 --2- 172.21.15.78:0/3092371291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9500073100 0x7f9500148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f950595a640 1 -- 172.21.15.78:0/3092371291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95001dd820 con 0x7f950014bb80 2024-09-15T22:09:34.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f950595a640 1 --2- 172.21.15.78:0/3092371291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f950014bb80 0x7f95001e0ba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f94f800d7d0 tx=0x7f94f800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:34.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f94f5ffb640 1 -- 172.21.15.78:0/3092371291 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8004030 con 0x7f950014bb80 2024-09-15T22:09:34.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f94f5ffb640 1 -- 172.21.15.78:0/3092371291 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f80041d0 con 0x7f950014bb80 2024-09-15T22:09:34.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f94f5ffb640 1 -- 172.21.15.78:0/3092371291 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f80096a0 con 0x7f950014bb80 2024-09-15T22:09:34.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.188+0000 7f95073bd640 1 -- 172.21.15.78:0/3092371291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95000b3870 con 0x7f950014bb80 2024-09-15T22:09:34.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.189+0000 7f95073bd640 1 -- 172.21.15.78:0/3092371291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95000b3b50 con 0x7f950014bb80 2024-09-15T22:09:34.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.190+0000 7f95073bd640 1 -- 172.21.15.78:0/3092371291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f950014bfb0 con 0x7f950014bb80 2024-09-15T22:09:34.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.190+0000 7f94f5ffb640 1 -- 172.21.15.78:0/3092371291 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f94f8009840 con 0x7f950014bb80 2024-09-15T22:09:34.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.190+0000 7f94f5ffb640 1 --2- 172.21.15.78:0/3092371291 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f94e406c2b0 0x7f94e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:34.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.191+0000 7f94f5ffb640 1 -- 172.21.15.78:0/3092371291 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f94f808b8c0 con 0x7f950014bb80 2024-09-15T22:09:34.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.191+0000 7f9505159640 1 --2- 172.21.15.78:0/3092371291 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f94e406c2b0 0x7f94e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:34.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.191+0000 7f9505159640 1 --2- 172.21.15.78:0/3092371291 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f94e406c2b0 0x7f94e406e770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f94fc033000 tx=0x7f94fc009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:34.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.195+0000 7f94f5ffb640 1 -- 172.21.15.78:0/3092371291 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94f8059730 con 0x7f950014bb80 2024-09-15T22:09:34.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.395+0000 7f95073bd640 1 -- 172.21.15.78:0/3092371291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f950006bfd0 con 0x7f950014bb80 2024-09-15T22:09:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.457+0000 7f94f5ffb640 1 -- 172.21.15.78:0/3092371291 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f94f805da30 con 0x7f950014bb80 2024-09-15T22:09:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.459+0000 7f95073bd640 1 -- 172.21.15.78:0/3092371291 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f94e406c2b0 msgr2=0x7f94e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.459+0000 7f95073bd640 1 --2- 172.21.15.78:0/3092371291 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f94e406c2b0 0x7f94e406e770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f94fc033000 tx=0x7f94fc009000 comp rx=0 tx=0).stop 2024-09-15T22:09:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.459+0000 7f95073bd640 1 -- 172.21.15.78:0/3092371291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f950014bb80 msgr2=0x7f95001e0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.459+0000 7f95073bd640 1 --2- 172.21.15.78:0/3092371291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f950014bb80 0x7f95001e0ba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f94f800d7d0 tx=0x7f94f800dc90 comp rx=0 tx=0).stop 2024-09-15T22:09:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.459+0000 7f95073bd640 1 -- 172.21.15.78:0/3092371291 shutdown_connections 2024-09-15T22:09:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.459+0000 7f95073bd640 1 --2- 172.21.15.78:0/3092371291 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f94e406c2b0 0x7f94e406e770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.459+0000 7f95073bd640 1 --2- 172.21.15.78:0/3092371291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f950014bb80 0x7f95001e0ba0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.459+0000 7f95073bd640 1 --2- 172.21.15.78:0/3092371291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9500073100 0x7f9500148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.459+0000 7f95073bd640 1 --2- 172.21.15.78:0/3092371291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950006d530 0x7f95001de000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.459+0000 7f95073bd640 1 -- 172.21.15.78:0/3092371291 >> 172.21.15.78:0/3092371291 conn(0x7f95000bb390 msgr2=0x7f95000ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:34.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.460+0000 7f95073bd640 1 -- 172.21.15.78:0/3092371291 shutdown_connections 2024-09-15T22:09:34.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.460+0000 7f95073bd640 1 -- 172.21.15.78:0/3092371291 wait complete. 2024-09-15T22:09:34.472 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-15T22:09:34.472 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:09:34.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.571+0000 7faca3274640 1 Processor -- start 2024-09-15T22:09:34.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.571+0000 7faca3274640 1 -- start start 2024-09-15T22:09:34.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.572+0000 7faca3274640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c0b97b0 0x7fac9c0b9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.572+0000 7faca3274640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fac9c0ba4a0 0x7fac9c141640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.572+0000 7faca3274640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac9c0b6ad0 con 0x7fac9c141b80 2024-09-15T22:09:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.572+0000 7faca3274640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fac9c14aff0 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.572+0000 7faca3274640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fac9c0b6d40 con 0x7fac9c0b97b0 2024-09-15T22:09:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.572+0000 7faca080f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fac9c0ba4a0 0x7fac9c141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.572+0000 7faca080f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fac9c0ba4a0 0x7fac9c141640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49572/0 (socket says 172.21.15.78:49572) 2024-09-15T22:09:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.572+0000 7faca080f640 1 -- 172.21.15.78:0/2726041121 learned_addr learned my addr 172.21.15.78:0/2726041121 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.572+0000 7faca1010640 1 --2- 172.21.15.78:0/2726041121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c0b97b0 0x7fac9c0b9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.572+0000 7faca080f640 1 -- 172.21.15.78:0/2726041121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c0b97b0 msgr2=0x7fac9c0b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.572+0000 7faca080f640 1 --2- 172.21.15.78:0/2726041121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c0b97b0 0x7fac9c0b9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.572+0000 7faca080f640 1 -- 172.21.15.78:0/2726041121 >> v1:172.21.15.175:6789/0 conn(0x7fac9c141b80 legacy=0x7fac9c0b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.572+0000 7faca080f640 1 -- 172.21.15.78:0/2726041121 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9c0b9b90 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.573+0000 7faca080f640 1 --2- 172.21.15.78:0/2726041121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9c0ba4a0 0x7fac9c141640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fac900098a0 tx=0x7fac9002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d06eef6f05042 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.573+0000 7fac8ffff640 1 -- 172.21.15.78:0/2726041121 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90037070 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.573+0000 7fac8ffff640 1 -- 172.21.15.78:0/2726041121 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac90032440 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.573+0000 7fac8ffff640 1 -- 172.21.15.78:0/2726041121 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90032810 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.573+0000 7faca3274640 1 -- 172.21.15.78:0/2726041121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9c0ba4a0 msgr2=0x7fac9c141640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:34.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.573+0000 7faca3274640 1 --2- 172.21.15.78:0/2726041121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9c0ba4a0 0x7fac9c141640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fac900098a0 tx=0x7fac9002a250 comp rx=0 tx=0).stop 2024-09-15T22:09:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.573+0000 7faca3274640 1 -- 172.21.15.78:0/2726041121 shutdown_connections 2024-09-15T22:09:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.573+0000 7faca3274640 1 --2- 172.21.15.78:0/2726041121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9c0ba4a0 0x7fac9c141640 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.573+0000 7faca3274640 1 --2- 172.21.15.78:0/2726041121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c0b97b0 0x7fac9c0b9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.573+0000 7faca3274640 1 -- 172.21.15.78:0/2726041121 >> 172.21.15.78:0/2726041121 conn(0x7fac9c0bd670 msgr2=0x7fac9c0bda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.574+0000 7faca3274640 1 -- 172.21.15.78:0/2726041121 shutdown_connections 2024-09-15T22:09:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.574+0000 7faca3274640 1 -- 172.21.15.78:0/2726041121 wait complete. 2024-09-15T22:09:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca3274640 1 Processor -- start 2024-09-15T22:09:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca3274640 1 -- start start 2024-09-15T22:09:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca3274640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c0b97b0 0x7fac9c145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca3274640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9c0ba4a0 0x7fac9c1dd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca3274640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c141b80 0x7fac9c146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca3274640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c0b5a10 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca3274640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c0b5730 con 0x7fac9c0b97b0 2024-09-15T22:09:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca3274640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fac9c0b5cf0 con 0x7fac9c141b80 2024-09-15T22:09:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca080f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9c0ba4a0 0x7fac9c1dd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca080f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9c0ba4a0 0x7fac9c1dd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49584/0 (socket says 172.21.15.78:49584) 2024-09-15T22:09:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca080f640 1 -- 172.21.15.78:0/2086581129 learned_addr learned my addr 172.21.15.78:0/2086581129 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca1010640 1 --2- 172.21.15.78:0/2086581129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c0b97b0 0x7fac9c145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca1811640 1 --2- 172.21.15.78:0/2086581129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c141b80 0x7fac9c146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca080f640 1 -- 172.21.15.78:0/2086581129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c141b80 msgr2=0x7fac9c146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca080f640 1 --2- 172.21.15.78:0/2086581129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c141b80 0x7fac9c146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca080f640 1 -- 172.21.15.78:0/2086581129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c0b97b0 msgr2=0x7fac9c145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.575+0000 7faca080f640 1 --2- 172.21.15.78:0/2086581129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c0b97b0 0x7fac9c145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.576+0000 7faca080f640 1 -- 172.21.15.78:0/2086581129 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9c147b00 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.576+0000 7faca1010640 1 --2- 172.21.15.78:0/2086581129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c0b97b0 0x7fac9c145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:34.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.576+0000 7faca080f640 1 --2- 172.21.15.78:0/2086581129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9c0ba4a0 0x7fac9c1dd540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac900098a0 tx=0x7fac900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:34.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.576+0000 7fac8dffb640 1 -- 172.21.15.78:0/2086581129 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90041070 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.576+0000 7fac8dffb640 1 -- 172.21.15.78:0/2086581129 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac90004240 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.576+0000 7fac8dffb640 1 -- 172.21.15.78:0/2086581129 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90037040 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.576+0000 7faca3274640 1 -- 172.21.15.78:0/2086581129 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac9c1480c0 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.576+0000 7faca3274640 1 -- 172.21.15.78:0/2086581129 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac9c146be0 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.577+0000 7faca3274640 1 -- 172.21.15.78:0/2086581129 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac9c0b4b70 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.578+0000 7fac8dffb640 1 -- 172.21.15.78:0/2086581129 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fac90030620 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.578+0000 7fac8dffb640 1 --2- 172.21.15.78:0/2086581129 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fac8006c2e0 0x7fac8006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:34.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.578+0000 7fac8dffb640 1 -- 172.21.15.78:0/2086581129 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fac900abf90 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.578+0000 7faca1010640 1 --2- 172.21.15.78:0/2086581129 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fac8006c2e0 0x7fac8006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:34.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.578+0000 7faca1010640 1 --2- 172.21.15.78:0/2086581129 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fac8006c2e0 0x7fac8006e7a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac9800a9d0 tx=0x7fac98008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:34.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.582+0000 7fac8dffb640 1 -- 172.21.15.78:0/2086581129 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac9007a450 con 0x7fac9c0ba4a0 2024-09-15T22:09:34.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:34.781+0000 7faca3274640 1 -- 172.21.15.78:0/2086581129 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fac9c0b6780 con 0x7fac9c0ba4a0 2024-09-15T22:09:35.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.463+0000 7fac8dffb640 1 -- 172.21.15.78:0/2086581129 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7fac90079d50 con 0x7fac9c0ba4a0 2024-09-15T22:09:35.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.466+0000 7faca3274640 1 -- 172.21.15.78:0/2086581129 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fac8006c2e0 msgr2=0x7fac8006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:35.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.466+0000 7faca3274640 1 --2- 172.21.15.78:0/2086581129 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fac8006c2e0 0x7fac8006e7a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac9800a9d0 tx=0x7fac98008040 comp rx=0 tx=0).stop 2024-09-15T22:09:35.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.466+0000 7faca3274640 1 -- 172.21.15.78:0/2086581129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9c0ba4a0 msgr2=0x7fac9c1dd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:35.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.466+0000 7faca3274640 1 --2- 172.21.15.78:0/2086581129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9c0ba4a0 0x7fac9c1dd540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac900098a0 tx=0x7fac900046c0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.466+0000 7faca3274640 1 -- 172.21.15.78:0/2086581129 shutdown_connections 2024-09-15T22:09:35.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.466+0000 7faca3274640 1 --2- 172.21.15.78:0/2086581129 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fac8006c2e0 0x7fac8006e7a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.466+0000 7faca3274640 1 --2- 172.21.15.78:0/2086581129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c141b80 0x7fac9c146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.466+0000 7faca3274640 1 --2- 172.21.15.78:0/2086581129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9c0ba4a0 0x7fac9c1dd540 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.466+0000 7faca3274640 1 --2- 172.21.15.78:0/2086581129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c0b97b0 0x7fac9c145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.466+0000 7faca3274640 1 -- 172.21.15.78:0/2086581129 >> 172.21.15.78:0/2086581129 conn(0x7fac9c0bd670 msgr2=0x7fac9c149950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:35.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.466+0000 7faca3274640 1 -- 172.21.15.78:0/2086581129 shutdown_connections 2024-09-15T22:09:35.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.466+0000 7faca3274640 1 -- 172.21.15.78:0/2086581129 wait complete. 2024-09-15T22:09:35.480 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:09:35.480 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:09:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.578+0000 7f4a65931640 1 Processor -- start 2024-09-15T22:09:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.578+0000 7f4a65931640 1 -- start start 2024-09-15T22:09:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.579+0000 7f4a65931640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4a601417f0 0x7f4a60141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.579+0000 7f4a65931640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4a601502e0 0x7f4a601526d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.579+0000 7f4a65931640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a600b6c90 con 0x7f4a600ba270 2024-09-15T22:09:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.579+0000 7f4a65931640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f4a600b6f00 con 0x7f4a601417f0 2024-09-15T22:09:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.579+0000 7f4a65931640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4a600b7a80 con 0x7f4a601502e0 2024-09-15T22:09:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.579+0000 7f4a5e7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4a601417f0 0x7f4a60141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.579+0000 7f4a5e7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4a601417f0 0x7f4a60141c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49598/0 (socket says 172.21.15.78:49598) 2024-09-15T22:09:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.579+0000 7f4a5e7fc640 1 -- 172.21.15.78:0/3426634018 learned_addr learned my addr 172.21.15.78:0/3426634018 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.579+0000 7f4a5e7fc640 1 -- 172.21.15.78:0/3426634018 >> v2:172.21.15.175:3300/0 conn(0x7f4a601502e0 msgr2=0x7f4a601526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.579+0000 7f4a5f7fe640 1 --2- 172.21.15.78:0/3426634018 >> v2:172.21.15.175:3300/0 conn(0x7f4a601502e0 0x7f4a601526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.579+0000 7f4a5e7fc640 1 --2- 172.21.15.78:0/3426634018 >> v2:172.21.15.175:3300/0 conn(0x7f4a601502e0 0x7f4a601526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.579+0000 7f4a5e7fc640 1 -- 172.21.15.78:0/3426634018 >> v1:172.21.15.175:6789/0 conn(0x7f4a600ba270 legacy=0x7f4a600b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.579+0000 7f4a5e7fc640 1 -- 172.21.15.78:0/3426634018 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a600ba650 con 0x7f4a601417f0 2024-09-15T22:09:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.580+0000 7f4a5e7fc640 1 --2- 172.21.15.78:0/3426634018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a601417f0 0x7f4a60141c30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009870 tx=0x7f4a5402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a67de4608c5d809 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.580+0000 7f4a5dffb640 1 -- 172.21.15.78:0/3426634018 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a54037070 con 0x7f4a601417f0 2024-09-15T22:09:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.580+0000 7f4a5dffb640 1 -- 172.21.15.78:0/3426634018 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5402ae40 con 0x7f4a601417f0 2024-09-15T22:09:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.580+0000 7f4a5dffb640 1 -- 172.21.15.78:0/3426634018 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a54032660 con 0x7f4a601417f0 2024-09-15T22:09:35.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.580+0000 7f4a65931640 1 -- 172.21.15.78:0/3426634018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a601417f0 msgr2=0x7f4a60141c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:35.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.580+0000 7f4a65931640 1 --2- 172.21.15.78:0/3426634018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a601417f0 0x7f4a60141c30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009870 tx=0x7f4a5402a130 comp rx=0 tx=0).stop 2024-09-15T22:09:35.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.581+0000 7f4a65931640 1 -- 172.21.15.78:0/3426634018 shutdown_connections 2024-09-15T22:09:35.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.581+0000 7f4a65931640 1 --2- 172.21.15.78:0/3426634018 >> v2:172.21.15.175:3300/0 conn(0x7f4a601502e0 0x7f4a601526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.581+0000 7f4a65931640 1 --2- 172.21.15.78:0/3426634018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a601417f0 0x7f4a60141c30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.581+0000 7f4a65931640 1 -- 172.21.15.78:0/3426634018 >> 172.21.15.78:0/3426634018 conn(0x7f4a60074ba0 msgr2=0x7f4a60074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.581+0000 7f4a65931640 1 -- 172.21.15.78:0/3426634018 shutdown_connections 2024-09-15T22:09:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.581+0000 7f4a65931640 1 -- 172.21.15.78:0/3426634018 wait complete. 2024-09-15T22:09:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.582+0000 7f4a65931640 1 Processor -- start 2024-09-15T22:09:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.582+0000 7f4a65931640 1 -- start start 2024-09-15T22:09:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.582+0000 7f4a65931640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a600ba270 0x7f4a6014e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.582+0000 7f4a65931640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a601417f0 0x7f4a6014ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.582+0000 7f4a65931640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a601502e0 0x7f4a6014ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.582+0000 7f4a65931640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4a600b77a0 con 0x7f4a600ba270 2024-09-15T22:09:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.582+0000 7f4a65931640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4a600b74c0 con 0x7f4a601417f0 2024-09-15T22:09:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.582+0000 7f4a65931640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4a600b4a70 con 0x7f4a601502e0 2024-09-15T22:09:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.582+0000 7f4a5effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a600ba270 0x7f4a6014e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.582+0000 7f4a5effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a600ba270 0x7f4a6014e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49602/0 (socket says 172.21.15.78:49602) 2024-09-15T22:09:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.582+0000 7f4a5effd640 1 -- 172.21.15.78:0/1988814744 learned_addr learned my addr 172.21.15.78:0/1988814744 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.583+0000 7f4a5e7fc640 1 --2- 172.21.15.78:0/1988814744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a601417f0 0x7f4a6014ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.583+0000 7f4a5f7fe640 1 --2- 172.21.15.78:0/1988814744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a601502e0 0x7f4a6014ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.583+0000 7f4a5effd640 1 -- 172.21.15.78:0/1988814744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a601502e0 msgr2=0x7f4a6014ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.583+0000 7f4a5effd640 1 --2- 172.21.15.78:0/1988814744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a601502e0 0x7f4a6014ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.583+0000 7f4a5effd640 1 -- 172.21.15.78:0/1988814744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a601417f0 msgr2=0x7f4a6014ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.583+0000 7f4a5effd640 1 --2- 172.21.15.78:0/1988814744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a601417f0 0x7f4a6014ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.583+0000 7f4a5effd640 1 -- 172.21.15.78:0/1988814744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6014bf30 con 0x7f4a600ba270 2024-09-15T22:09:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.583+0000 7f4a5f7fe640 1 --2- 172.21.15.78:0/1988814744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a601502e0 0x7f4a6014ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.583+0000 7f4a5effd640 1 --2- 172.21.15.78:0/1988814744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a600ba270 0x7f4a6014e780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000b3f0 tx=0x7f4a5000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.583+0000 7f4a47fff640 1 -- 172.21.15.78:0/1988814744 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50015020 con 0x7f4a600ba270 2024-09-15T22:09:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.583+0000 7f4a47fff640 1 -- 172.21.15.78:0/1988814744 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a50011830 con 0x7f4a600ba270 2024-09-15T22:09:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.583+0000 7f4a47fff640 1 -- 172.21.15.78:0/1988814744 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50011c20 con 0x7f4a600ba270 2024-09-15T22:09:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.583+0000 7f4a65931640 1 -- 172.21.15.78:0/1988814744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a6014f3a0 con 0x7f4a600ba270 2024-09-15T22:09:35.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.583+0000 7f4a65931640 1 -- 172.21.15.78:0/1988814744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a6014d870 con 0x7f4a600ba270 2024-09-15T22:09:35.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.584+0000 7f4a65931640 1 -- 172.21.15.78:0/1988814744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a600b53d0 con 0x7f4a600ba270 2024-09-15T22:09:35.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.585+0000 7f4a47fff640 1 -- 172.21.15.78:0/1988814744 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4a50018020 con 0x7f4a600ba270 2024-09-15T22:09:35.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.585+0000 7f4a47fff640 1 --2- 172.21.15.78:0/1988814744 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f4a4c06c2b0 0x7f4a4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.585+0000 7f4a5e7fc640 1 --2- 172.21.15.78:0/1988814744 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f4a4c06c2b0 0x7f4a4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.585+0000 7f4a47fff640 1 -- 172.21.15.78:0/1988814744 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4a5008b240 con 0x7f4a600ba270 2024-09-15T22:09:35.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.585+0000 7f4a5e7fc640 1 --2- 172.21.15.78:0/1988814744 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f4a4c06c2b0 0x7f4a4c06e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a54034000 tx=0x7f4a5402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:35.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.589+0000 7f4a47fff640 1 -- 172.21.15.78:0/1988814744 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a600b53d0 con 0x7f4a600ba270 2024-09-15T22:09:35.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.788+0000 7f4a65931640 1 -- 172.21.15.78:0/1988814744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a600b5ce0 con 0x7f4a600ba270 2024-09-15T22:09:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.789+0000 7f4a47fff640 1 -- 172.21.15.78:0/1988814744 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3574 (secure 0 0 0) 0x7f4a5001f030 con 0x7f4a600ba270 2024-09-15T22:09:35.791 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:35.791 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"btime":"2024-09-15T22:09:35:458988+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1036052633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1036052633},{"type":"v1","addr":"172.21.15.78:6835","nonce":1036052633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:09:16.727586+0000","modified":"2024-09-15T22:09:34.782979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6833/4038139714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":4038139714},{"type":"v1","addr":"172.21.15.175:6833","nonce":4038139714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-09-15T22:09:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2024-09-15T22:09:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.791+0000 7f4a65931640 1 -- 172.21.15.78:0/1988814744 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f4a4c06c2b0 msgr2=0x7f4a4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.791+0000 7f4a65931640 1 --2- 172.21.15.78:0/1988814744 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f4a4c06c2b0 0x7f4a4c06e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a54034000 tx=0x7f4a5402e000 comp rx=0 tx=0).stop 2024-09-15T22:09:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.791+0000 7f4a65931640 1 -- 172.21.15.78:0/1988814744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a600ba270 msgr2=0x7f4a6014e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.791+0000 7f4a65931640 1 --2- 172.21.15.78:0/1988814744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a600ba270 0x7f4a6014e780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000b3f0 tx=0x7f4a5000b8b0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.791+0000 7f4a65931640 1 -- 172.21.15.78:0/1988814744 shutdown_connections 2024-09-15T22:09:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.791+0000 7f4a65931640 1 --2- 172.21.15.78:0/1988814744 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f4a4c06c2b0 0x7f4a4c06e770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.792+0000 7f4a65931640 1 --2- 172.21.15.78:0/1988814744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a601502e0 0x7f4a6014ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.792+0000 7f4a65931640 1 --2- 172.21.15.78:0/1988814744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a601417f0 0x7f4a6014ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.792+0000 7f4a65931640 1 --2- 172.21.15.78:0/1988814744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a600ba270 0x7f4a6014e780 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.792+0000 7f4a65931640 1 -- 172.21.15.78:0/1988814744 >> 172.21.15.78:0/1988814744 conn(0x7f4a60074ba0 msgr2=0x7f4a601479e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.792+0000 7f4a65931640 1 -- 172.21.15.78:0/1988814744 shutdown_connections 2024-09-15T22:09:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.792+0000 7f4a65931640 1 -- 172.21.15.78:0/1988814744 wait complete. 2024-09-15T22:09:35.805 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:09:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.902+0000 7f412f01e640 1 Processor -- start 2024-09-15T22:09:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.902+0000 7f412f01e640 1 -- start start 2024-09-15T22:09:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412f01e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4128075520 0x7f412814bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412f01e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4128147a50 0x7f412809cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412f01e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41281417e0 0x7f4128141c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412f01e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f412814b6b0 con 0x7f4128075520 2024-09-15T22:09:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412f01e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f412809d090 con 0x7f41281417e0 2024-09-15T22:09:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412f01e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4128075900 con 0x7f4128147a50 2024-09-15T22:09:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412cdba640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4128075520 0x7f412814bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412cdba640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4128075520 0x7f412814bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49606/0 (socket says 172.21.15.78:49606) 2024-09-15T22:09:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412cdba640 1 -- 172.21.15.78:0/1867763094 learned_addr learned my addr 172.21.15.78:0/1867763094 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412d5bb640 1 --2- 172.21.15.78:0/1867763094 >> v2:172.21.15.175:3300/0 conn(0x7f41281417e0 0x7f4128141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f4127fff640 1 --2- 172.21.15.78:0/1867763094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4128147a50 0x7f412809cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412cdba640 1 -- 172.21.15.78:0/1867763094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4128147a50 msgr2=0x7f412809cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412cdba640 1 --2- 172.21.15.78:0/1867763094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4128147a50 0x7f412809cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412cdba640 1 -- 172.21.15.78:0/1867763094 >> v2:172.21.15.175:3300/0 conn(0x7f41281417e0 msgr2=0x7f4128141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412cdba640 1 --2- 172.21.15.78:0/1867763094 >> v2:172.21.15.175:3300/0 conn(0x7f41281417e0 0x7f4128141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412cdba640 1 -- 172.21.15.78:0/1867763094 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f412806dc00 con 0x7f4128075520 2024-09-15T22:09:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.903+0000 7f412d5bb640 1 --2- 172.21.15.78:0/1867763094 >> v2:172.21.15.175:3300/0 conn(0x7f41281417e0 0x7f4128141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.904+0000 7f412cdba640 1 --2- 172.21.15.78:0/1867763094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128075520 0x7f412814bb40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f41280a2800 tx=0x7f412002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbb94d4cb65777a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.904+0000 7f41277fe640 1 -- 172.21.15.78:0/1867763094 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120036070 con 0x7f4128075520 2024-09-15T22:09:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.904+0000 7f41277fe640 1 -- 172.21.15.78:0/1867763094 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4120031600 con 0x7f4128075520 2024-09-15T22:09:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.904+0000 7f41277fe640 1 -- 172.21.15.78:0/1867763094 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41200319d0 con 0x7f4128075520 2024-09-15T22:09:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.904+0000 7f412f01e640 1 -- 172.21.15.78:0/1867763094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128075520 msgr2=0x7f412814bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.904+0000 7f412f01e640 1 --2- 172.21.15.78:0/1867763094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128075520 0x7f412814bb40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f41280a2800 tx=0x7f412002a610 comp rx=0 tx=0).stop 2024-09-15T22:09:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.905+0000 7f412f01e640 1 -- 172.21.15.78:0/1867763094 shutdown_connections 2024-09-15T22:09:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.905+0000 7f412f01e640 1 --2- 172.21.15.78:0/1867763094 >> v2:172.21.15.175:3300/0 conn(0x7f41281417e0 0x7f4128141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.905+0000 7f412f01e640 1 --2- 172.21.15.78:0/1867763094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4128147a50 0x7f412809cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.905+0000 7f412f01e640 1 --2- 172.21.15.78:0/1867763094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128075520 0x7f412814bb40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.905+0000 7f412f01e640 1 -- 172.21.15.78:0/1867763094 >> 172.21.15.78:0/1867763094 conn(0x7f41280bdcb0 msgr2=0x7f4128074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.905+0000 7f412f01e640 1 -- 172.21.15.78:0/1867763094 shutdown_connections 2024-09-15T22:09:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.905+0000 7f412f01e640 1 -- 172.21.15.78:0/1867763094 wait complete. 2024-09-15T22:09:35.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.906+0000 7f412f01e640 1 Processor -- start 2024-09-15T22:09:35.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.906+0000 7f412f01e640 1 -- start start 2024-09-15T22:09:35.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.906+0000 7f412f01e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4128075520 0x7f4128144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.906+0000 7f412f01e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41281417e0 0x7f412814a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.906+0000 7f412f01e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128147a50 0x7f41281dd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.906+0000 7f412f01e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f41281421b0 con 0x7f4128147a50 2024-09-15T22:09:35.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.906+0000 7f412f01e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f412814b340 con 0x7f41281417e0 2024-09-15T22:09:35.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.906+0000 7f412f01e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4128147e90 con 0x7f4128075520 2024-09-15T22:09:35.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.906+0000 7f412d5bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128147a50 0x7f41281dd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.906+0000 7f412d5bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128147a50 0x7f41281dd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49612/0 (socket says 172.21.15.78:49612) 2024-09-15T22:09:35.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.906+0000 7f412d5bb640 1 -- 172.21.15.78:0/197100987 learned_addr learned my addr 172.21.15.78:0/197100987 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:35.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.907+0000 7f4127fff640 1 --2- 172.21.15.78:0/197100987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41281417e0 0x7f412814a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.907+0000 7f412cdba640 1 --2- 172.21.15.78:0/197100987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4128075520 0x7f4128144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.907+0000 7f412d5bb640 1 -- 172.21.15.78:0/197100987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4128075520 msgr2=0x7f4128144f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:35.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.907+0000 7f412d5bb640 1 --2- 172.21.15.78:0/197100987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4128075520 0x7f4128144f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.907+0000 7f412d5bb640 1 -- 172.21.15.78:0/197100987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41281417e0 msgr2=0x7f412814a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:35.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.907+0000 7f412d5bb640 1 --2- 172.21.15.78:0/197100987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41281417e0 0x7f412814a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.907+0000 7f412d5bb640 1 -- 172.21.15.78:0/197100987 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41280b6080 con 0x7f4128147a50 2024-09-15T22:09:35.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.907+0000 7f4127fff640 1 --2- 172.21.15.78:0/197100987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41281417e0 0x7f412814a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:35.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.907+0000 7f412d5bb640 1 --2- 172.21.15.78:0/197100987 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128147a50 0x7f41281dd3a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f411800e7e0 tx=0x7f411800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:35.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.907+0000 7f41257fa640 1 -- 172.21.15.78:0/197100987 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411800f040 con 0x7f4128147a50 2024-09-15T22:09:35.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.907+0000 7f41257fa640 1 -- 172.21.15.78:0/197100987 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4118004030 con 0x7f4128147a50 2024-09-15T22:09:35.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.907+0000 7f412f01e640 1 -- 172.21.15.78:0/197100987 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f412814ab70 con 0x7f4128147a50 2024-09-15T22:09:35.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.907+0000 7f41257fa640 1 -- 172.21.15.78:0/197100987 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41180043e0 con 0x7f4128147a50 2024-09-15T22:09:35.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.907+0000 7f412f01e640 1 -- 172.21.15.78:0/197100987 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41280b4da0 con 0x7f4128147a50 2024-09-15T22:09:35.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.908+0000 7f412f01e640 1 -- 172.21.15.78:0/197100987 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41280a2a60 con 0x7f4128147a50 2024-09-15T22:09:35.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.909+0000 7f41257fa640 1 -- 172.21.15.78:0/197100987 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f411800c6d0 con 0x7f4128147a50 2024-09-15T22:09:35.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.909+0000 7f41257fa640 1 --2- 172.21.15.78:0/197100987 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f411406c2b0 0x7f411406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.909+0000 7f41257fa640 1 -- 172.21.15.78:0/197100987 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f411808b790 con 0x7f4128147a50 2024-09-15T22:09:35.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.909+0000 7f412cdba640 1 --2- 172.21.15.78:0/197100987 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f411406c2b0 0x7f411406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.910+0000 7f412cdba640 1 --2- 172.21.15.78:0/197100987 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f411406c2b0 0x7f411406e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4120033000 tx=0x7f4120009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:35.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:35.913+0000 7f41257fa640 1 -- 172.21.15.78:0/197100987 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4118017020 con 0x7f4128147a50 2024-09-15T22:09:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.079+0000 7f412f01e640 1 -- 172.21.15.78:0/197100987 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41280b5da0 con 0x7f4128147a50 2024-09-15T22:09:36.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.080+0000 7f41257fa640 1 -- 172.21.15.78:0/197100987 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7f4118059c50 con 0x7f4128147a50 2024-09-15T22:09:36.082 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:36.082 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"34e44e87-1d1a-416f-b208-c16e07980ff5","created":"2024-09-15T22:08:53.842443+0000","modified":"2024-09-15T22:09:21.780555+0000","last_up_change":"2024-09-15T22:09:04.830042+0000","last_in_change":"2024-09-15T22:08:55.864039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:05.999373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:14.532061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:15.710676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:09:19.437681+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"71eb9af6-bf66-4450-a5d1-d4a81f71f95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6817","nonce":3548923409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6819","nonce":3548923409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6823","nonce":3548923409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6821","nonce":3548923409}]},"public_addr":"172.21.15.78:6817/3548923409","cluster_addr":"172.21.15.78:6819/3548923409","heartbeat_back_addr":"172.21.15.78:6823/3548923409","heartbeat_front_addr":"172.21.15.78:6821/3548923409","state":["exists","up"]},{"osd":1,"uuid":"f0070f6d-7998-4ad3-b597-e5777e61d503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6809","nonce":1233827941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6811","nonce":1233827941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6815","nonce":1233827941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6813","nonce":1233827941}]},"public_addr":"172.21.15.78:6809/1233827941","cluster_addr":"172.21.15.78:6811/1233827941","heartbeat_back_addr":"172.21.15.78:6815/1233827941","heartbeat_front_addr":"172.21.15.78:6813/1233827941","state":["exists","up"]},{"osd":2,"uuid":"6d9c91c7-2c8a-48f9-9bef-67ea7320980e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6825","nonce":636523247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6827","nonce":636523247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6831","nonce":636523247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6829","nonce":636523247}]},"public_addr":"172.21.15.78:6825/636523247","cluster_addr":"172.21.15.78:6827/636523247","heartbeat_back_addr":"172.21.15.78:6831/636523247","heartbeat_front_addr":"172.21.15.78:6829/636523247","state":["exists","up"]},{"osd":3,"uuid":"943e38fb-b450-48c0-8f01-d381b0b8e313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6801","nonce":1841812488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6803","nonce":1841812488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6807","nonce":1841812488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6805","nonce":1841812488}]},"public_addr":"172.21.15.78:6801/1841812488","cluster_addr":"172.21.15.78:6803/1841812488","heartbeat_back_addr":"172.21.15.78:6807/1841812488","heartbeat_front_addr":"172.21.15.78:6805/1841812488","state":["exists","up"]},{"osd":4,"uuid":"259f50f8-3223-450d-8cd1-d0d333c278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6817","nonce":1803357070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6819","nonce":1803357070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6823","nonce":1803357070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6821","nonce":1803357070}]},"public_addr":"172.21.15.175:6817/1803357070","cluster_addr":"172.21.15.175:6819/1803357070","heartbeat_back_addr":"172.21.15.175:6823/1803357070","heartbeat_front_addr":"172.21.15.175:6821/1803357070","state":["exists","up"]},{"osd":5,"uuid":"d70426cd-a39b-4a20-8c7b-bedc8352e303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6825","nonce":2221415707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6827","nonce":2221415707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6831","nonce":2221415707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6829","nonce":2221415707}]},"public_addr":"172.21.15.175:6825/2221415707","cluster_addr":"172.21.15.175:6827/2221415707","heartbeat_back_addr":"172.21.15.175:6831/2221415707","heartbeat_front_addr":"172.21.15.175:6829/2221415707","state":["exists","up"]},{"osd":6,"uuid":"95b9ed3a-cbfc-45a5-8967-88db9da099ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6801","nonce":1974018373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6803","nonce":1974018373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6807","nonce":1974018373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6805","nonce":1974018373}]},"public_addr":"172.21.15.175:6801/1974018373","cluster_addr":"172.21.15.175:6803/1974018373","heartbeat_back_addr":"172.21.15.175:6807/1974018373","heartbeat_front_addr":"172.21.15.175:6805/1974018373","state":["exists","up"]},{"osd":7,"uuid":"5fc56286-91e9-4a13-b161-ad7d30fc0119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6809","nonce":2386415083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6811","nonce":2386415083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6815","nonce":2386415083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6813","nonce":2386415083}]},"public_addr":"172.21.15.175:6809/2386415083","cluster_addr":"172.21.15.175:6811/2386415083","heartbeat_back_addr":"172.21.15.175:6815/2386415083","heartbeat_front_addr":"172.21.15.175:6813/2386415083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.191845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.871482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.594323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.463568+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.398880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.490112+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.119097+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.677350+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:09:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.083+0000 7f412f01e640 1 -- 172.21.15.78:0/197100987 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f411406c2b0 msgr2=0x7f411406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.083+0000 7f412f01e640 1 --2- 172.21.15.78:0/197100987 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f411406c2b0 0x7f411406e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4120033000 tx=0x7f4120009000 comp rx=0 tx=0).stop 2024-09-15T22:09:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.083+0000 7f412f01e640 1 -- 172.21.15.78:0/197100987 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128147a50 msgr2=0x7f41281dd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.083+0000 7f412f01e640 1 --2- 172.21.15.78:0/197100987 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128147a50 0x7f41281dd3a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f411800e7e0 tx=0x7f411800eca0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.083+0000 7f412f01e640 1 -- 172.21.15.78:0/197100987 shutdown_connections 2024-09-15T22:09:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.083+0000 7f412f01e640 1 --2- 172.21.15.78:0/197100987 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f411406c2b0 0x7f411406e770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.083+0000 7f412f01e640 1 --2- 172.21.15.78:0/197100987 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128147a50 0x7f41281dd3a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.083+0000 7f412f01e640 1 --2- 172.21.15.78:0/197100987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41281417e0 0x7f412814a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.083+0000 7f412f01e640 1 --2- 172.21.15.78:0/197100987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4128075520 0x7f4128144f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.083+0000 7f412f01e640 1 -- 172.21.15.78:0/197100987 >> 172.21.15.78:0/197100987 conn(0x7f41280bdcb0 msgr2=0x7f4128145f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.083+0000 7f412f01e640 1 -- 172.21.15.78:0/197100987 shutdown_connections 2024-09-15T22:09:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.083+0000 7f412f01e640 1 -- 172.21.15.78:0/197100987 wait complete. 2024-09-15T22:09:36.096 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:09:36.096 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:09:36.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.191+0000 7fb297aaf640 1 Processor -- start 2024-09-15T22:09:36.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.192+0000 7fb297aaf640 1 -- start start 2024-09-15T22:09:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.192+0000 7fb297aaf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb290074e10 0x7fb2900b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.192+0000 7fb297aaf640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb2900aef50 0x7fb2901416d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.192+0000 7fb297aaf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb2900af350 0x7fb290141c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.192+0000 7fb297aaf640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fb2900751f0 con 0x7fb2900af350 2024-09-15T22:09:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.192+0000 7fb297aaf640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb2900b0d00 con 0x7fb2900aef50 2024-09-15T22:09:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.192+0000 7fb297aaf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb290142150 con 0x7fb290074e10 2024-09-15T22:09:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.192+0000 7fb29604c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb2900af350 0x7fb290141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.192+0000 7fb29604c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb2900af350 0x7fb290141c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49624/0 (socket says 172.21.15.78:49624) 2024-09-15T22:09:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.192+0000 7fb29604c640 1 -- 172.21.15.78:0/1614895500 learned_addr learned my addr 172.21.15.78:0/1614895500 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.193+0000 7fb29504a640 1 --2- 172.21.15.78:0/1614895500 >> v2:172.21.15.175:3300/0 conn(0x7fb2900aef50 0x7fb2901416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.193+0000 7fb29584b640 1 --2- 172.21.15.78:0/1614895500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb290074e10 0x7fb2900b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.193+0000 7fb29604c640 1 -- 172.21.15.78:0/1614895500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb290074e10 msgr2=0x7fb2900b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.193+0000 7fb29604c640 1 --2- 172.21.15.78:0/1614895500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb290074e10 0x7fb2900b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.193+0000 7fb29604c640 1 -- 172.21.15.78:0/1614895500 >> v2:172.21.15.175:3300/0 conn(0x7fb2900aef50 msgr2=0x7fb2901416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.193+0000 7fb29604c640 1 --2- 172.21.15.78:0/1614895500 >> v2:172.21.15.175:3300/0 conn(0x7fb2900aef50 0x7fb2901416d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.193+0000 7fb29604c640 1 -- 172.21.15.78:0/1614895500 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2900b6510 con 0x7fb2900af350 2024-09-15T22:09:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.193+0000 7fb29604c640 1 --2- 172.21.15.78:0/1614895500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2900af350 0x7fb290141c10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb2900bb070 tx=0x7fb28002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1a1eb9b147874d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.194+0000 7fb294849640 1 -- 172.21.15.78:0/1614895500 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb280037070 con 0x7fb2900af350 2024-09-15T22:09:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.194+0000 7fb294849640 1 -- 172.21.15.78:0/1614895500 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb280032440 con 0x7fb2900af350 2024-09-15T22:09:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.194+0000 7fb294849640 1 -- 172.21.15.78:0/1614895500 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb280032810 con 0x7fb2900af350 2024-09-15T22:09:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.194+0000 7fb297aaf640 1 -- 172.21.15.78:0/1614895500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2900af350 msgr2=0x7fb290141c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.194+0000 7fb297aaf640 1 --2- 172.21.15.78:0/1614895500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2900af350 0x7fb290141c10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb2900bb070 tx=0x7fb28002a140 comp rx=0 tx=0).stop 2024-09-15T22:09:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.194+0000 7fb297aaf640 1 -- 172.21.15.78:0/1614895500 shutdown_connections 2024-09-15T22:09:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.194+0000 7fb297aaf640 1 --2- 172.21.15.78:0/1614895500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2900af350 0x7fb290141c10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.194+0000 7fb297aaf640 1 --2- 172.21.15.78:0/1614895500 >> v2:172.21.15.175:3300/0 conn(0x7fb2900aef50 0x7fb2901416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.194+0000 7fb297aaf640 1 --2- 172.21.15.78:0/1614895500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb290074e10 0x7fb2900b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.194+0000 7fb297aaf640 1 -- 172.21.15.78:0/1614895500 >> 172.21.15.78:0/1614895500 conn(0x7fb29006c3d0 msgr2=0x7fb2900ba380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.194+0000 7fb297aaf640 1 -- 172.21.15.78:0/1614895500 shutdown_connections 2024-09-15T22:09:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.194+0000 7fb297aaf640 1 -- 172.21.15.78:0/1614895500 wait complete. 2024-09-15T22:09:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.195+0000 7fb297aaf640 1 Processor -- start 2024-09-15T22:09:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.195+0000 7fb297aaf640 1 -- start start 2024-09-15T22:09:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb297aaf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb290074e10 0x7fb2901dd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb297aaf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2900aef50 0x7fb290143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb297aaf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2900af350 0x7fb290144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb297aaf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb2900b14e0 con 0x7fb290074e10 2024-09-15T22:09:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb297aaf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb290075a20 con 0x7fb2900af350 2024-09-15T22:09:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb297aaf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb2900ae880 con 0x7fb2900aef50 2024-09-15T22:09:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb29584b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb290074e10 0x7fb2901dd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb29584b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb290074e10 0x7fb2901dd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49640/0 (socket says 172.21.15.78:49640) 2024-09-15T22:09:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb29584b640 1 -- 172.21.15.78:0/3534848304 learned_addr learned my addr 172.21.15.78:0/3534848304 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb29604c640 1 --2- 172.21.15.78:0/3534848304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2900af350 0x7fb290144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb29504a640 1 --2- 172.21.15.78:0/3534848304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2900aef50 0x7fb290143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb29584b640 1 -- 172.21.15.78:0/3534848304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2900aef50 msgr2=0x7fb290143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb29584b640 1 --2- 172.21.15.78:0/3534848304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2900aef50 0x7fb290143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb29584b640 1 -- 172.21.15.78:0/3534848304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2900af350 msgr2=0x7fb290144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb29584b640 1 --2- 172.21.15.78:0/3534848304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2900af350 0x7fb290144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb29584b640 1 -- 172.21.15.78:0/3534848304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2900b1940 con 0x7fb290074e10 2024-09-15T22:09:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb29604c640 1 --2- 172.21.15.78:0/3534848304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2900af350 0x7fb290144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb29584b640 1 --2- 172.21.15.78:0/3534848304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb290074e10 0x7fb2901dd360 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb28800d800 tx=0x7fb28800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.196+0000 7fb28e7fc640 1 -- 172.21.15.78:0/3534848304 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28800b6c0 con 0x7fb290074e10 2024-09-15T22:09:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.197+0000 7fb28e7fc640 1 -- 172.21.15.78:0/3534848304 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb288019070 con 0x7fb290074e10 2024-09-15T22:09:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.197+0000 7fb297aaf640 1 -- 172.21.15.78:0/3534848304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb290143710 con 0x7fb290074e10 2024-09-15T22:09:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.197+0000 7fb28e7fc640 1 -- 172.21.15.78:0/3534848304 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28800ba80 con 0x7fb290074e10 2024-09-15T22:09:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.197+0000 7fb297aaf640 1 -- 172.21.15.78:0/3534848304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb29013f2e0 con 0x7fb290074e10 2024-09-15T22:09:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.197+0000 7fb297aaf640 1 -- 172.21.15.78:0/3534848304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb290140850 con 0x7fb290074e10 2024-09-15T22:09:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.198+0000 7fb28e7fc640 1 -- 172.21.15.78:0/3534848304 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb28800bc20 con 0x7fb290074e10 2024-09-15T22:09:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.198+0000 7fb28e7fc640 1 --2- 172.21.15.78:0/3534848304 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb27c06c2b0 0x7fb27c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.198+0000 7fb28e7fc640 1 -- 172.21.15.78:0/3534848304 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb28808bb70 con 0x7fb290074e10 2024-09-15T22:09:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.198+0000 7fb29504a640 1 --2- 172.21.15.78:0/3534848304 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb27c06c2b0 0x7fb27c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.199+0000 7fb29504a640 1 --2- 172.21.15.78:0/3534848304 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb27c06c2b0 0x7fb27c06e770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb290140e30 tx=0x7fb284003cd0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:36.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.202+0000 7fb28e7fc640 1 -- 172.21.15.78:0/3534848304 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb290140850 con 0x7fb290074e10 2024-09-15T22:09:36.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.366+0000 7fb297aaf640 1 -- 172.21.15.78:0/3534848304 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2900b5ef0 con 0x7fb27c06c2b0 2024-09-15T22:09:36.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.375+0000 7fb28e7fc640 1 -- 172.21.15.78:0/3534848304 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332611 (secure 0 0 0) 0x7fb2900b5ef0 con 0x7fb27c06c2b0 2024-09-15T22:09:36.380 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:36.382 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-15T22:09:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.378+0000 7fb297aaf640 1 -- 172.21.15.78:0/3534848304 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb27c06c2b0 msgr2=0x7fb27c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.378+0000 7fb297aaf640 1 --2- 172.21.15.78:0/3534848304 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb27c06c2b0 0x7fb27c06e770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb290140e30 tx=0x7fb284003cd0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.378+0000 7fb297aaf640 1 -- 172.21.15.78:0/3534848304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb290074e10 msgr2=0x7fb2901dd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.378+0000 7fb297aaf640 1 --2- 172.21.15.78:0/3534848304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb290074e10 0x7fb2901dd360 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb28800d800 tx=0x7fb28800dcc0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.378+0000 7fb297aaf640 1 -- 172.21.15.78:0/3534848304 shutdown_connections 2024-09-15T22:09:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.378+0000 7fb297aaf640 1 --2- 172.21.15.78:0/3534848304 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb27c06c2b0 0x7fb27c06e770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.378+0000 7fb297aaf640 1 --2- 172.21.15.78:0/3534848304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2900af350 0x7fb290144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.378+0000 7fb297aaf640 1 --2- 172.21.15.78:0/3534848304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2900aef50 0x7fb290143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.378+0000 7fb297aaf640 1 --2- 172.21.15.78:0/3534848304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb290074e10 0x7fb2901dd360 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.378+0000 7fb297aaf640 1 -- 172.21.15.78:0/3534848304 >> 172.21.15.78:0/3534848304 conn(0x7fb29006c3d0 msgr2=0x7fb2900b6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:36.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.378+0000 7fb297aaf640 1 -- 172.21.15.78:0/3534848304 shutdown_connections 2024-09-15T22:09:36.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.378+0000 7fb297aaf640 1 -- 172.21.15.78:0/3534848304 wait complete. 2024-09-15T22:09:36.392 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-15T22:09:35.974346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218476,"kb_used_data":2240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756244,"statfs":{"total":773094113280,"available":772870393856,"internally_reserved":0,"allocated":2293760,"data_stored":2015420,"data_compressed":65044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002528"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857105+0000","last_change":"2024-09-15T22:09:16.403008+0000","last_active":"2024-09-15T22:09:22.857105+0000","last_peered":"2024-09-15T22:09:22.857105+0000","last_clean":"2024-09-15T22:09:22.857105+0000","last_became_active":"2024-09-15T22:09:16.402725+0000","last_became_peered":"2024-09-15T22:09:16.402725+0000","last_unstale":"2024-09-15T22:09:22.857105+0000","last_undegraded":"2024-09-15T22:09:22.857105+0000","last_fullsized":"2024-09-15T22:09:22.857105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:32.659951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432405+0000","last_change":"2024-09-15T22:09:17.400698+0000","last_active":"2024-09-15T22:09:22.432405+0000","last_peered":"2024-09-15T22:09:22.432405+0000","last_clean":"2024-09-15T22:09:22.432405+0000","last_became_active":"2024-09-15T22:09:17.400428+0000","last_became_peered":"2024-09-15T22:09:17.400428+0000","last_unstale":"2024-09-15T22:09:22.432405+0000","last_undegraded":"2024-09-15T22:09:22.432405+0000","last_fullsized":"2024-09-15T22:09:22.432405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:15.431072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432024+0000","last_change":"2024-09-15T22:09:21.449737+0000","last_active":"2024-09-15T22:09:22.432024+0000","last_peered":"2024-09-15T22:09:22.432024+0000","last_clean":"2024-09-15T22:09:22.432024+0000","last_became_active":"2024-09-15T22:09:21.449376+0000","last_became_peered":"2024-09-15T22:09:21.449376+0000","last_unstale":"2024-09-15T22:09:22.432024+0000","last_undegraded":"2024-09-15T22:09:22.432024+0000","last_fullsized":"2024-09-15T22:09:22.432024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:13.943283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432590+0000","last_change":"2024-09-15T22:09:16.407728+0000","last_active":"2024-09-15T22:09:22.432590+0000","last_peered":"2024-09-15T22:09:22.432590+0000","last_clean":"2024-09-15T22:09:22.432590+0000","last_became_active":"2024-09-15T22:09:16.407458+0000","last_became_peered":"2024-09-15T22:09:16.407458+0000","last_unstale":"2024-09-15T22:09:22.432590+0000","last_undegraded":"2024-09-15T22:09:22.432590+0000","last_fullsized":"2024-09-15T22:09:22.432590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856796+0000","last_change":"2024-09-15T22:09:17.415311+0000","last_active":"2024-09-15T22:09:22.856796+0000","last_peered":"2024-09-15T22:09:22.856796+0000","last_clean":"2024-09-15T22:09:22.856796+0000","last_became_active":"2024-09-15T22:09:17.414966+0000","last_became_peered":"2024-09-15T22:09:17.414966+0000","last_unstale":"2024-09-15T22:09:22.856796+0000","last_undegraded":"2024-09-15T22:09:22.856796+0000","last_fullsized":"2024-09-15T22:09:22.856796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432860+0000","last_change":"2024-09-15T22:09:21.454087+0000","last_active":"2024-09-15T22:09:22.432860+0000","last_peered":"2024-09-15T22:09:22.432860+0000","last_clean":"2024-09-15T22:09:22.432860+0000","last_became_active":"2024-09-15T22:09:21.453701+0000","last_became_peered":"2024-09-15T22:09:21.453701+0000","last_unstale":"2024-09-15T22:09:22.432860+0000","last_undegraded":"2024-09-15T22:09:22.432860+0000","last_fullsized":"2024-09-15T22:09:22.432860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:29.697947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433861+0000","last_change":"2024-09-15T22:09:16.405902+0000","last_active":"2024-09-15T22:09:22.433861+0000","last_peered":"2024-09-15T22:09:22.433861+0000","last_clean":"2024-09-15T22:09:22.433861+0000","last_became_active":"2024-09-15T22:09:16.405626+0000","last_became_peered":"2024-09-15T22:09:16.405626+0000","last_unstale":"2024-09-15T22:09:22.433861+0000","last_undegraded":"2024-09-15T22:09:22.433861+0000","last_fullsized":"2024-09-15T22:09:22.433861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:03.001838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446948+0000","last_change":"2024-09-15T22:09:17.416894+0000","last_active":"2024-09-15T22:09:22.446948+0000","last_peered":"2024-09-15T22:09:22.446948+0000","last_clean":"2024-09-15T22:09:22.446948+0000","last_became_active":"2024-09-15T22:09:17.416367+0000","last_became_peered":"2024-09-15T22:09:17.416367+0000","last_unstale":"2024-09-15T22:09:22.446948+0000","last_undegraded":"2024-09-15T22:09:22.446948+0000","last_fullsized":"2024-09-15T22:09:22.446948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:15.431072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434492+0000","last_change":"2024-09-15T22:09:21.455260+0000","last_active":"2024-09-15T22:09:22.434492+0000","last_peered":"2024-09-15T22:09:22.434492+0000","last_clean":"2024-09-15T22:09:22.434492+0000","last_became_active":"2024-09-15T22:09:21.454850+0000","last_became_peered":"2024-09-15T22:09:21.454850+0000","last_unstale":"2024-09-15T22:09:22.434492+0000","last_undegraded":"2024-09-15T22:09:22.434492+0000","last_fullsized":"2024-09-15T22:09:22.434492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:08.904123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434195+0000","last_change":"2024-09-15T22:09:16.407670+0000","last_active":"2024-09-15T22:09:22.434195+0000","last_peered":"2024-09-15T22:09:22.434195+0000","last_clean":"2024-09-15T22:09:22.434195+0000","last_became_active":"2024-09-15T22:09:16.407364+0000","last_became_peered":"2024-09-15T22:09:16.407364+0000","last_unstale":"2024-09-15T22:09:22.434195+0000","last_undegraded":"2024-09-15T22:09:22.434195+0000","last_fullsized":"2024-09-15T22:09:22.434195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:01.284777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447188+0000","last_change":"2024-09-15T22:09:17.408224+0000","last_active":"2024-09-15T22:09:22.447188+0000","last_peered":"2024-09-15T22:09:22.447188+0000","last_clean":"2024-09-15T22:09:22.447188+0000","last_became_active":"2024-09-15T22:09:17.407881+0000","last_became_peered":"2024-09-15T22:09:17.407881+0000","last_unstale":"2024-09-15T22:09:22.447188+0000","last_undegraded":"2024-09-15T22:09:22.447188+0000","last_fullsized":"2024-09-15T22:09:22.447188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:22.003479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432971+0000","last_change":"2024-09-15T22:09:21.450705+0000","last_active":"2024-09-15T22:09:22.432971+0000","last_peered":"2024-09-15T22:09:22.432971+0000","last_clean":"2024-09-15T22:09:22.432971+0000","last_became_active":"2024-09-15T22:09:21.450265+0000","last_became_peered":"2024-09-15T22:09:21.450265+0000","last_unstale":"2024-09-15T22:09:22.432971+0000","last_undegraded":"2024-09-15T22:09:22.432971+0000","last_fullsized":"2024-09-15T22:09:22.432971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:21.477522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856481+0000","last_change":"2024-09-15T22:09:17.410686+0000","last_active":"2024-09-15T22:09:22.856481+0000","last_peered":"2024-09-15T22:09:22.856481+0000","last_clean":"2024-09-15T22:09:22.856481+0000","last_became_active":"2024-09-15T22:09:17.410383+0000","last_became_peered":"2024-09-15T22:09:17.410383+0000","last_unstale":"2024-09-15T22:09:22.856481+0000","last_undegraded":"2024-09-15T22:09:22.856481+0000","last_fullsized":"2024-09-15T22:09:22.856481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433896+0000","last_change":"2024-09-15T22:09:16.405335+0000","last_active":"2024-09-15T22:09:22.433896+0000","last_peered":"2024-09-15T22:09:22.433896+0000","last_clean":"2024-09-15T22:09:22.433896+0000","last_became_active":"2024-09-15T22:09:16.405010+0000","last_became_peered":"2024-09-15T22:09:16.405010+0000","last_unstale":"2024-09-15T22:09:22.433896+0000","last_undegraded":"2024-09-15T22:09:22.433896+0000","last_fullsized":"2024-09-15T22:09:22.433896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:00.202736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433953+0000","last_change":"2024-09-15T22:09:21.453670+0000","last_active":"2024-09-15T22:09:22.433953+0000","last_peered":"2024-09-15T22:09:22.433953+0000","last_clean":"2024-09-15T22:09:22.433953+0000","last_became_active":"2024-09-15T22:09:21.453219+0000","last_became_peered":"2024-09-15T22:09:21.453219+0000","last_unstale":"2024-09-15T22:09:22.433953+0000","last_undegraded":"2024-09-15T22:09:22.433953+0000","last_fullsized":"2024-09-15T22:09:22.433953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:28.271273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432427+0000","last_change":"2024-09-15T22:09:17.405327+0000","last_active":"2024-09-15T22:09:22.432427+0000","last_peered":"2024-09-15T22:09:22.432427+0000","last_clean":"2024-09-15T22:09:22.432427+0000","last_became_active":"2024-09-15T22:09:17.405065+0000","last_became_peered":"2024-09-15T22:09:17.405065+0000","last_unstale":"2024-09-15T22:09:22.432427+0000","last_undegraded":"2024-09-15T22:09:22.432427+0000","last_fullsized":"2024-09-15T22:09:22.432427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857701+0000","last_change":"2024-09-15T22:09:16.406705+0000","last_active":"2024-09-15T22:09:22.857701+0000","last_peered":"2024-09-15T22:09:22.857701+0000","last_clean":"2024-09-15T22:09:22.857701+0000","last_became_active":"2024-09-15T22:09:16.406454+0000","last_became_peered":"2024-09-15T22:09:16.406454+0000","last_unstale":"2024-09-15T22:09:22.857701+0000","last_undegraded":"2024-09-15T22:09:22.857701+0000","last_fullsized":"2024-09-15T22:09:22.857701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:02.444245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433842+0000","last_change":"2024-09-15T22:09:21.456243+0000","last_active":"2024-09-15T22:09:22.433842+0000","last_peered":"2024-09-15T22:09:22.433842+0000","last_clean":"2024-09-15T22:09:22.433842+0000","last_became_active":"2024-09-15T22:09:21.455819+0000","last_became_peered":"2024-09-15T22:09:21.455819+0000","last_unstale":"2024-09-15T22:09:22.433842+0000","last_undegraded":"2024-09-15T22:09:22.433842+0000","last_fullsized":"2024-09-15T22:09:22.433842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:02.526090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432175+0000","last_change":"2024-09-15T22:09:17.399551+0000","last_active":"2024-09-15T22:09:22.432175+0000","last_peered":"2024-09-15T22:09:22.432175+0000","last_clean":"2024-09-15T22:09:22.432175+0000","last_became_active":"2024-09-15T22:09:17.399290+0000","last_became_peered":"2024-09-15T22:09:17.399290+0000","last_unstale":"2024-09-15T22:09:22.432175+0000","last_undegraded":"2024-09-15T22:09:22.432175+0000","last_fullsized":"2024-09-15T22:09:22.432175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857365+0000","last_change":"2024-09-15T22:09:16.408974+0000","last_active":"2024-09-15T22:09:22.857365+0000","last_peered":"2024-09-15T22:09:22.857365+0000","last_clean":"2024-09-15T22:09:22.857365+0000","last_became_active":"2024-09-15T22:09:16.408691+0000","last_became_peered":"2024-09-15T22:09:16.408691+0000","last_unstale":"2024-09-15T22:09:22.857365+0000","last_undegraded":"2024-09-15T22:09:22.857365+0000","last_fullsized":"2024-09-15T22:09:22.857365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:26:32.412274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857068+0000","last_change":"2024-09-15T22:09:21.458893+0000","last_active":"2024-09-15T22:09:22.857068+0000","last_peered":"2024-09-15T22:09:22.857068+0000","last_clean":"2024-09-15T22:09:22.857068+0000","last_became_active":"2024-09-15T22:09:21.458548+0000","last_became_peered":"2024-09-15T22:09:21.458548+0000","last_unstale":"2024-09-15T22:09:22.857068+0000","last_undegraded":"2024-09-15T22:09:22.857068+0000","last_fullsized":"2024-09-15T22:09:22.857068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:29.163692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434430+0000","last_change":"2024-09-15T22:09:17.400823+0000","last_active":"2024-09-15T22:09:22.434430+0000","last_peered":"2024-09-15T22:09:22.434430+0000","last_clean":"2024-09-15T22:09:22.434430+0000","last_became_active":"2024-09-15T22:09:17.400494+0000","last_became_peered":"2024-09-15T22:09:17.400494+0000","last_unstale":"2024-09-15T22:09:22.434430+0000","last_undegraded":"2024-09-15T22:09:22.434430+0000","last_fullsized":"2024-09-15T22:09:22.434430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:02.290840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432593+0000","last_change":"2024-09-15T22:09:16.409156+0000","last_active":"2024-09-15T22:09:22.432593+0000","last_peered":"2024-09-15T22:09:22.432593+0000","last_clean":"2024-09-15T22:09:22.432593+0000","last_became_active":"2024-09-15T22:09:16.408603+0000","last_became_peered":"2024-09-15T22:09:16.408603+0000","last_unstale":"2024-09-15T22:09:22.432593+0000","last_undegraded":"2024-09-15T22:09:22.432593+0000","last_fullsized":"2024-09-15T22:09:22.432593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:12.245902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433463+0000","last_change":"2024-09-15T22:09:21.447940+0000","last_active":"2024-09-15T22:09:22.433463+0000","last_peered":"2024-09-15T22:09:22.433463+0000","last_clean":"2024-09-15T22:09:22.433463+0000","last_became_active":"2024-09-15T22:09:21.447348+0000","last_became_peered":"2024-09-15T22:09:21.447348+0000","last_unstale":"2024-09-15T22:09:22.433463+0000","last_undegraded":"2024-09-15T22:09:22.433463+0000","last_fullsized":"2024-09-15T22:09:22.433463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:19.466950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.858001+0000","last_change":"2024-09-15T22:09:17.402826+0000","last_active":"2024-09-15T22:09:22.858001+0000","last_peered":"2024-09-15T22:09:22.858001+0000","last_clean":"2024-09-15T22:09:22.858001+0000","last_became_active":"2024-09-15T22:09:17.402585+0000","last_became_peered":"2024-09-15T22:09:17.402585+0000","last_unstale":"2024-09-15T22:09:22.858001+0000","last_undegraded":"2024-09-15T22:09:22.858001+0000","last_fullsized":"2024-09-15T22:09:22.858001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857204+0000","last_change":"2024-09-15T22:09:16.408097+0000","last_active":"2024-09-15T22:09:22.857204+0000","last_peered":"2024-09-15T22:09:22.857204+0000","last_clean":"2024-09-15T22:09:22.857204+0000","last_became_active":"2024-09-15T22:09:16.407657+0000","last_became_peered":"2024-09-15T22:09:16.407657+0000","last_unstale":"2024-09-15T22:09:22.857204+0000","last_undegraded":"2024-09-15T22:09:22.857204+0000","last_fullsized":"2024-09-15T22:09:22.857204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433301+0000","last_change":"2024-09-15T22:09:21.451205+0000","last_active":"2024-09-15T22:09:22.433301+0000","last_peered":"2024-09-15T22:09:22.433301+0000","last_clean":"2024-09-15T22:09:22.433301+0000","last_became_active":"2024-09-15T22:09:21.450731+0000","last_became_peered":"2024-09-15T22:09:21.450731+0000","last_unstale":"2024-09-15T22:09:22.433301+0000","last_undegraded":"2024-09-15T22:09:22.433301+0000","last_fullsized":"2024-09-15T22:09:22.433301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:38.650786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432489+0000","last_change":"2024-09-15T22:09:17.421690+0000","last_active":"2024-09-15T22:09:22.432489+0000","last_peered":"2024-09-15T22:09:22.432489+0000","last_clean":"2024-09-15T22:09:22.432489+0000","last_became_active":"2024-09-15T22:09:17.421379+0000","last_became_peered":"2024-09-15T22:09:17.421379+0000","last_unstale":"2024-09-15T22:09:22.432489+0000","last_undegraded":"2024-09-15T22:09:22.432489+0000","last_fullsized":"2024-09-15T22:09:22.432489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857039+0000","last_change":"2024-09-15T22:09:16.408662+0000","last_active":"2024-09-15T22:09:22.857039+0000","last_peered":"2024-09-15T22:09:22.857039+0000","last_clean":"2024-09-15T22:09:22.857039+0000","last_became_active":"2024-09-15T22:09:16.408068+0000","last_became_peered":"2024-09-15T22:09:16.408068+0000","last_unstale":"2024-09-15T22:09:22.857039+0000","last_undegraded":"2024-09-15T22:09:22.857039+0000","last_fullsized":"2024-09-15T22:09:22.857039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:29.217773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.431852+0000","last_change":"2024-09-15T22:09:21.457447+0000","last_active":"2024-09-15T22:09:22.431852+0000","last_peered":"2024-09-15T22:09:22.431852+0000","last_clean":"2024-09-15T22:09:22.431852+0000","last_became_active":"2024-09-15T22:09:21.457031+0000","last_became_peered":"2024-09-15T22:09:21.457031+0000","last_unstale":"2024-09-15T22:09:22.431852+0000","last_undegraded":"2024-09-15T22:09:22.431852+0000","last_fullsized":"2024-09-15T22:09:22.431852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:45.457068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856945+0000","last_change":"2024-09-15T22:09:17.400043+0000","last_active":"2024-09-15T22:09:22.856945+0000","last_peered":"2024-09-15T22:09:22.856945+0000","last_clean":"2024-09-15T22:09:22.856945+0000","last_became_active":"2024-09-15T22:09:17.399815+0000","last_became_peered":"2024-09-15T22:09:17.399815+0000","last_unstale":"2024-09-15T22:09:22.856945+0000","last_undegraded":"2024-09-15T22:09:22.856945+0000","last_fullsized":"2024-09-15T22:09:22.856945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:38.779044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434071+0000","last_change":"2024-09-15T22:09:16.407483+0000","last_active":"2024-09-15T22:09:22.434071+0000","last_peered":"2024-09-15T22:09:22.434071+0000","last_clean":"2024-09-15T22:09:22.434071+0000","last_became_active":"2024-09-15T22:09:16.407199+0000","last_became_peered":"2024-09-15T22:09:16.407199+0000","last_unstale":"2024-09-15T22:09:22.434071+0000","last_undegraded":"2024-09-15T22:09:22.434071+0000","last_fullsized":"2024-09-15T22:09:22.434071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:24.102281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857257+0000","last_change":"2024-09-15T22:09:21.449620+0000","last_active":"2024-09-15T22:09:22.857257+0000","last_peered":"2024-09-15T22:09:22.857257+0000","last_clean":"2024-09-15T22:09:22.857257+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:09:22.857257+0000","last_undegraded":"2024-09-15T22:09:22.857257+0000","last_fullsized":"2024-09-15T22:09:22.857257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:40.690811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447282+0000","last_change":"2024-09-15T22:09:17.414930+0000","last_active":"2024-09-15T22:09:22.447282+0000","last_peered":"2024-09-15T22:09:22.447282+0000","last_clean":"2024-09-15T22:09:22.447282+0000","last_became_active":"2024-09-15T22:09:17.414645+0000","last_became_peered":"2024-09-15T22:09:17.414645+0000","last_unstale":"2024-09-15T22:09:22.447282+0000","last_undegraded":"2024-09-15T22:09:22.447282+0000","last_fullsized":"2024-09-15T22:09:22.447282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:22.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857058+0000","last_change":"2024-09-15T22:09:16.408794+0000","last_active":"2024-09-15T22:09:22.857058+0000","last_peered":"2024-09-15T22:09:22.857058+0000","last_clean":"2024-09-15T22:09:22.857058+0000","last_became_active":"2024-09-15T22:09:16.408530+0000","last_became_peered":"2024-09-15T22:09:16.408530+0000","last_unstale":"2024-09-15T22:09:22.857058+0000","last_undegraded":"2024-09-15T22:09:22.857058+0000","last_fullsized":"2024-09-15T22:09:22.857058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:45.460989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857342+0000","last_change":"2024-09-15T22:09:21.451875+0000","last_active":"2024-09-15T22:09:22.857342+0000","last_peered":"2024-09-15T22:09:22.857342+0000","last_clean":"2024-09-15T22:09:22.857342+0000","last_became_active":"2024-09-15T22:09:21.451491+0000","last_became_peered":"2024-09-15T22:09:21.451491+0000","last_unstale":"2024-09-15T22:09:22.857342+0000","last_undegraded":"2024-09-15T22:09:22.857342+0000","last_fullsized":"2024-09-15T22:09:22.857342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:11.279572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434545+0000","last_change":"2024-09-15T22:09:17.409336+0000","last_active":"2024-09-15T22:09:22.434545+0000","last_peered":"2024-09-15T22:09:22.434545+0000","last_clean":"2024-09-15T22:09:22.434545+0000","last_became_active":"2024-09-15T22:09:17.409038+0000","last_became_peered":"2024-09-15T22:09:17.409038+0000","last_unstale":"2024-09-15T22:09:22.434545+0000","last_undegraded":"2024-09-15T22:09:22.434545+0000","last_fullsized":"2024-09-15T22:09:22.434545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:06.946537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447132+0000","last_change":"2024-09-15T22:09:16.409869+0000","last_active":"2024-09-15T22:09:22.447132+0000","last_peered":"2024-09-15T22:09:22.447132+0000","last_clean":"2024-09-15T22:09:22.447132+0000","last_became_active":"2024-09-15T22:09:16.409532+0000","last_became_peered":"2024-09-15T22:09:16.409532+0000","last_unstale":"2024-09-15T22:09:22.447132+0000","last_undegraded":"2024-09-15T22:09:22.447132+0000","last_fullsized":"2024-09-15T22:09:22.447132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:05.940474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857020+0000","last_change":"2024-09-15T22:09:21.458201+0000","last_active":"2024-09-15T22:09:22.857020+0000","last_peered":"2024-09-15T22:09:22.857020+0000","last_clean":"2024-09-15T22:09:22.857020+0000","last_became_active":"2024-09-15T22:09:21.457818+0000","last_became_peered":"2024-09-15T22:09:21.457818+0000","last_unstale":"2024-09-15T22:09:22.857020+0000","last_undegraded":"2024-09-15T22:09:22.857020+0000","last_fullsized":"2024-09-15T22:09:22.857020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:16.163530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857554+0000","last_change":"2024-09-15T22:09:17.399405+0000","last_active":"2024-09-15T22:09:22.857554+0000","last_peered":"2024-09-15T22:09:22.857554+0000","last_clean":"2024-09-15T22:09:22.857554+0000","last_became_active":"2024-09-15T22:09:17.399148+0000","last_became_peered":"2024-09-15T22:09:17.399148+0000","last_unstale":"2024-09-15T22:09:22.857554+0000","last_undegraded":"2024-09-15T22:09:22.857554+0000","last_fullsized":"2024-09-15T22:09:22.857554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:29.126156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856466+0000","last_change":"2024-09-15T22:09:16.402885+0000","last_active":"2024-09-15T22:09:22.856466+0000","last_peered":"2024-09-15T22:09:22.856466+0000","last_clean":"2024-09-15T22:09:22.856466+0000","last_became_active":"2024-09-15T22:09:16.402575+0000","last_became_peered":"2024-09-15T22:09:16.402575+0000","last_unstale":"2024-09-15T22:09:22.856466+0000","last_undegraded":"2024-09-15T22:09:22.856466+0000","last_fullsized":"2024-09-15T22:09:22.856466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857231+0000","last_change":"2024-09-15T22:09:21.457254+0000","last_active":"2024-09-15T22:09:22.857231+0000","last_peered":"2024-09-15T22:09:22.857231+0000","last_clean":"2024-09-15T22:09:22.857231+0000","last_became_active":"2024-09-15T22:09:21.456858+0000","last_became_peered":"2024-09-15T22:09:21.456858+0000","last_unstale":"2024-09-15T22:09:22.857231+0000","last_undegraded":"2024-09-15T22:09:22.857231+0000","last_fullsized":"2024-09-15T22:09:22.857231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:52.339264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856356+0000","last_change":"2024-09-15T22:09:17.411196+0000","last_active":"2024-09-15T22:09:22.856356+0000","last_peered":"2024-09-15T22:09:22.856356+0000","last_clean":"2024-09-15T22:09:22.856356+0000","last_became_active":"2024-09-15T22:09:17.409905+0000","last_became_peered":"2024-09-15T22:09:17.409905+0000","last_unstale":"2024-09-15T22:09:22.856356+0000","last_undegraded":"2024-09-15T22:09:22.856356+0000","last_fullsized":"2024-09-15T22:09:22.856356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:10.299704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432708+0000","last_change":"2024-09-15T22:09:16.409152+0000","last_active":"2024-09-15T22:09:22.432708+0000","last_peered":"2024-09-15T22:09:22.432708+0000","last_clean":"2024-09-15T22:09:22.432708+0000","last_became_active":"2024-09-15T22:09:16.408793+0000","last_became_peered":"2024-09-15T22:09:16.408793+0000","last_unstale":"2024-09-15T22:09:22.432708+0000","last_undegraded":"2024-09-15T22:09:22.432708+0000","last_fullsized":"2024-09-15T22:09:22.432708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:09.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857950+0000","last_change":"2024-09-15T22:09:21.456804+0000","last_active":"2024-09-15T22:09:22.857950+0000","last_peered":"2024-09-15T22:09:22.857950+0000","last_clean":"2024-09-15T22:09:22.857950+0000","last_became_active":"2024-09-15T22:09:21.456416+0000","last_became_peered":"2024-09-15T22:09:21.456416+0000","last_unstale":"2024-09-15T22:09:22.857950+0000","last_undegraded":"2024-09-15T22:09:22.857950+0000","last_fullsized":"2024-09-15T22:09:22.857950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:28.462550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432088+0000","last_change":"2024-09-15T22:09:17.415024+0000","last_active":"2024-09-15T22:09:22.432088+0000","last_peered":"2024-09-15T22:09:22.432088+0000","last_clean":"2024-09-15T22:09:22.432088+0000","last_became_active":"2024-09-15T22:09:17.414773+0000","last_became_peered":"2024-09-15T22:09:17.414773+0000","last_unstale":"2024-09-15T22:09:22.432088+0000","last_undegraded":"2024-09-15T22:09:22.432088+0000","last_fullsized":"2024-09-15T22:09:22.432088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446804+0000","last_change":"2024-09-15T22:09:16.401625+0000","last_active":"2024-09-15T22:09:22.446804+0000","last_peered":"2024-09-15T22:09:22.446804+0000","last_clean":"2024-09-15T22:09:22.446804+0000","last_became_active":"2024-09-15T22:09:16.401328+0000","last_became_peered":"2024-09-15T22:09:16.401328+0000","last_unstale":"2024-09-15T22:09:22.446804+0000","last_undegraded":"2024-09-15T22:09:22.446804+0000","last_fullsized":"2024-09-15T22:09:22.446804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432814+0000","last_change":"2024-09-15T22:09:07.243631+0000","last_active":"2024-09-15T22:09:22.432814+0000","last_peered":"2024-09-15T22:09:22.432814+0000","last_clean":"2024-09-15T22:09:22.432814+0000","last_became_active":"2024-09-15T22:09:07.243223+0000","last_became_peered":"2024-09-15T22:09:07.243223+0000","last_unstale":"2024-09-15T22:09:22.432814+0000","last_undegraded":"2024-09-15T22:09:22.432814+0000","last_fullsized":"2024-09-15T22:09:22.432814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_clean_scrub_stamp":"2024-09-15T22:09:06.009777+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:17:18.429315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856944+0000","last_change":"2024-09-15T22:09:21.453536+0000","last_active":"2024-09-15T22:09:22.856944+0000","last_peered":"2024-09-15T22:09:22.856944+0000","last_clean":"2024-09-15T22:09:22.856944+0000","last_became_active":"2024-09-15T22:09:21.453022+0000","last_became_peered":"2024-09-15T22:09:21.453022+0000","last_unstale":"2024-09-15T22:09:22.856944+0000","last_undegraded":"2024-09-15T22:09:22.856944+0000","last_fullsized":"2024-09-15T22:09:22.856944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:26.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433676+0000","last_change":"2024-09-15T22:09:17.421914+0000","last_active":"2024-09-15T22:09:22.433676+0000","last_peered":"2024-09-15T22:09:22.433676+0000","last_clean":"2024-09-15T22:09:22.433676+0000","last_became_active":"2024-09-15T22:09:17.420783+0000","last_became_peered":"2024-09-15T22:09:17.420783+0000","last_unstale":"2024-09-15T22:09:22.433676+0000","last_undegraded":"2024-09-15T22:09:22.433676+0000","last_fullsized":"2024-09-15T22:09:22.433676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:24.426671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856694+0000","last_change":"2024-09-15T22:09:16.404982+0000","last_active":"2024-09-15T22:09:22.856694+0000","last_peered":"2024-09-15T22:09:22.856694+0000","last_clean":"2024-09-15T22:09:22.856694+0000","last_became_active":"2024-09-15T22:09:16.404639+0000","last_became_peered":"2024-09-15T22:09:16.404639+0000","last_unstale":"2024-09-15T22:09:22.856694+0000","last_undegraded":"2024-09-15T22:09:22.856694+0000","last_fullsized":"2024-09-15T22:09:22.856694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856609+0000","last_change":"2024-09-15T22:09:21.457352+0000","last_active":"2024-09-15T22:09:22.856609+0000","last_peered":"2024-09-15T22:09:22.856609+0000","last_clean":"2024-09-15T22:09:22.856609+0000","last_became_active":"2024-09-15T22:09:21.456906+0000","last_became_peered":"2024-09-15T22:09:21.456906+0000","last_unstale":"2024-09-15T22:09:22.856609+0000","last_undegraded":"2024-09-15T22:09:22.856609+0000","last_fullsized":"2024-09-15T22:09:22.856609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:28.271273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447025+0000","last_change":"2024-09-15T22:09:17.416652+0000","last_active":"2024-09-15T22:09:22.447025+0000","last_peered":"2024-09-15T22:09:22.447025+0000","last_clean":"2024-09-15T22:09:22.447025+0000","last_became_active":"2024-09-15T22:09:17.415597+0000","last_became_peered":"2024-09-15T22:09:17.415597+0000","last_unstale":"2024-09-15T22:09:22.447025+0000","last_undegraded":"2024-09-15T22:09:22.447025+0000","last_fullsized":"2024-09-15T22:09:22.447025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:36.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856534+0000","last_change":"2024-09-15T22:09:16.405689+0000","last_active":"2024-09-15T22:09:22.856534+0000","last_peered":"2024-09-15T22:09:22.856534+0000","last_clean":"2024-09-15T22:09:22.856534+0000","last_became_active":"2024-09-15T22:09:16.405433+0000","last_became_peered":"2024-09-15T22:09:16.405433+0000","last_unstale":"2024-09-15T22:09:22.856534+0000","last_undegraded":"2024-09-15T22:09:22.856534+0000","last_fullsized":"2024-09-15T22:09:22.856534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.332999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857836+0000","last_change":"2024-09-15T22:09:21.448031+0000","last_active":"2024-09-15T22:09:22.857836+0000","last_peered":"2024-09-15T22:09:22.857836+0000","last_clean":"2024-09-15T22:09:22.857836+0000","last_became_active":"2024-09-15T22:09:21.447464+0000","last_became_peered":"2024-09-15T22:09:21.447464+0000","last_unstale":"2024-09-15T22:09:22.857836+0000","last_undegraded":"2024-09-15T22:09:22.857836+0000","last_fullsized":"2024-09-15T22:09:22.857836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:26.039358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434380+0000","last_change":"2024-09-15T22:09:17.412910+0000","last_active":"2024-09-15T22:09:22.434380+0000","last_peered":"2024-09-15T22:09:22.434380+0000","last_clean":"2024-09-15T22:09:22.434380+0000","last_became_active":"2024-09-15T22:09:17.412079+0000","last_became_peered":"2024-09-15T22:09:17.412079+0000","last_unstale":"2024-09-15T22:09:22.434380+0000","last_undegraded":"2024-09-15T22:09:22.434380+0000","last_fullsized":"2024-09-15T22:09:22.434380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:04.536343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856351+0000","last_change":"2024-09-15T22:09:16.405941+0000","last_active":"2024-09-15T22:09:22.856351+0000","last_peered":"2024-09-15T22:09:22.856351+0000","last_clean":"2024-09-15T22:09:22.856351+0000","last_became_active":"2024-09-15T22:09:16.405621+0000","last_became_peered":"2024-09-15T22:09:16.405621+0000","last_unstale":"2024-09-15T22:09:22.856351+0000","last_undegraded":"2024-09-15T22:09:22.856351+0000","last_fullsized":"2024-09-15T22:09:22.856351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446643+0000","last_change":"2024-09-15T22:09:21.449669+0000","last_active":"2024-09-15T22:09:22.446643+0000","last_peered":"2024-09-15T22:09:22.446643+0000","last_clean":"2024-09-15T22:09:22.446643+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:09:22.446643+0000","last_undegraded":"2024-09-15T22:09:22.446643+0000","last_fullsized":"2024-09-15T22:09:22.446643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:45.457068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433550+0000","last_change":"2024-09-15T22:09:17.410475+0000","last_active":"2024-09-15T22:09:22.433550+0000","last_peered":"2024-09-15T22:09:22.433550+0000","last_clean":"2024-09-15T22:09:22.433550+0000","last_became_active":"2024-09-15T22:09:17.410176+0000","last_became_peered":"2024-09-15T22:09:17.410176+0000","last_unstale":"2024-09-15T22:09:22.433550+0000","last_undegraded":"2024-09-15T22:09:22.433550+0000","last_fullsized":"2024-09-15T22:09:22.433550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434085+0000","last_change":"2024-09-15T22:09:16.399090+0000","last_active":"2024-09-15T22:09:22.434085+0000","last_peered":"2024-09-15T22:09:22.434085+0000","last_clean":"2024-09-15T22:09:22.434085+0000","last_became_active":"2024-09-15T22:09:16.398789+0000","last_became_peered":"2024-09-15T22:09:16.398789+0000","last_unstale":"2024-09-15T22:09:22.434085+0000","last_undegraded":"2024-09-15T22:09:22.434085+0000","last_fullsized":"2024-09-15T22:09:22.434085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:14.477432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433128+0000","last_change":"2024-09-15T22:09:21.448270+0000","last_active":"2024-09-15T22:09:22.433128+0000","last_peered":"2024-09-15T22:09:22.433128+0000","last_clean":"2024-09-15T22:09:22.433128+0000","last_became_active":"2024-09-15T22:09:21.447541+0000","last_became_peered":"2024-09-15T22:09:21.447541+0000","last_unstale":"2024-09-15T22:09:22.433128+0000","last_undegraded":"2024-09-15T22:09:22.433128+0000","last_fullsized":"2024-09-15T22:09:22.433128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:51.175728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433007+0000","last_change":"2024-09-15T22:09:17.410762+0000","last_active":"2024-09-15T22:09:22.433007+0000","last_peered":"2024-09-15T22:09:22.433007+0000","last_clean":"2024-09-15T22:09:22.433007+0000","last_became_active":"2024-09-15T22:09:17.410431+0000","last_became_peered":"2024-09-15T22:09:17.410431+0000","last_unstale":"2024-09-15T22:09:22.433007+0000","last_undegraded":"2024-09-15T22:09:22.433007+0000","last_fullsized":"2024-09-15T22:09:22.433007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:15.123863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.855905+0000","last_change":"2024-09-15T22:09:16.409298+0000","last_active":"2024-09-15T22:09:22.855905+0000","last_peered":"2024-09-15T22:09:22.855905+0000","last_clean":"2024-09-15T22:09:22.855905+0000","last_became_active":"2024-09-15T22:09:16.408991+0000","last_became_peered":"2024-09-15T22:09:16.408991+0000","last_unstale":"2024-09-15T22:09:22.855905+0000","last_undegraded":"2024-09-15T22:09:22.855905+0000","last_fullsized":"2024-09-15T22:09:22.855905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.799831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857935+0000","last_change":"2024-09-15T22:09:21.453936+0000","last_active":"2024-09-15T22:09:22.857935+0000","last_peered":"2024-09-15T22:09:22.857935+0000","last_clean":"2024-09-15T22:09:22.857935+0000","last_became_active":"2024-09-15T22:09:21.453526+0000","last_became_peered":"2024-09-15T22:09:21.453526+0000","last_unstale":"2024-09-15T22:09:22.857935+0000","last_undegraded":"2024-09-15T22:09:22.857935+0000","last_fullsized":"2024-09-15T22:09:22.857935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:19.159742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856612+0000","last_change":"2024-09-15T22:09:17.404617+0000","last_active":"2024-09-15T22:09:22.856612+0000","last_peered":"2024-09-15T22:09:22.856612+0000","last_clean":"2024-09-15T22:09:22.856612+0000","last_became_active":"2024-09-15T22:09:17.404310+0000","last_became_peered":"2024-09-15T22:09:17.404310+0000","last_unstale":"2024-09-15T22:09:22.856612+0000","last_undegraded":"2024-09-15T22:09:22.856612+0000","last_fullsized":"2024-09-15T22:09:22.856612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:17.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856611+0000","last_change":"2024-09-15T22:09:16.403439+0000","last_active":"2024-09-15T22:09:22.856611+0000","last_peered":"2024-09-15T22:09:22.856611+0000","last_clean":"2024-09-15T22:09:22.856611+0000","last_became_active":"2024-09-15T22:09:16.403137+0000","last_became_peered":"2024-09-15T22:09:16.403137+0000","last_unstale":"2024-09-15T22:09:22.856611+0000","last_undegraded":"2024-09-15T22:09:22.856611+0000","last_fullsized":"2024-09-15T22:09:22.856611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:05.940474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432504+0000","last_change":"2024-09-15T22:09:21.451370+0000","last_active":"2024-09-15T22:09:22.432504+0000","last_peered":"2024-09-15T22:09:22.432504+0000","last_clean":"2024-09-15T22:09:22.432504+0000","last_became_active":"2024-09-15T22:09:21.451016+0000","last_became_peered":"2024-09-15T22:09:21.451016+0000","last_unstale":"2024-09-15T22:09:22.432504+0000","last_undegraded":"2024-09-15T22:09:22.432504+0000","last_fullsized":"2024-09-15T22:09:22.432504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:54.480340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433466+0000","last_change":"2024-09-15T22:09:17.412953+0000","last_active":"2024-09-15T22:09:22.433466+0000","last_peered":"2024-09-15T22:09:22.433466+0000","last_clean":"2024-09-15T22:09:22.433466+0000","last_became_active":"2024-09-15T22:09:17.412680+0000","last_became_peered":"2024-09-15T22:09:17.412680+0000","last_unstale":"2024-09-15T22:09:22.433466+0000","last_undegraded":"2024-09-15T22:09:22.433466+0000","last_fullsized":"2024-09-15T22:09:22.433466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:36.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446965+0000","last_change":"2024-09-15T22:09:16.406833+0000","last_active":"2024-09-15T22:09:22.446965+0000","last_peered":"2024-09-15T22:09:22.446965+0000","last_clean":"2024-09-15T22:09:22.446965+0000","last_became_active":"2024-09-15T22:09:16.406550+0000","last_became_peered":"2024-09-15T22:09:16.406550+0000","last_unstale":"2024-09-15T22:09:22.446965+0000","last_undegraded":"2024-09-15T22:09:22.446965+0000","last_fullsized":"2024-09-15T22:09:22.446965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432709+0000","last_change":"2024-09-15T22:09:21.450825+0000","last_active":"2024-09-15T22:09:22.432709+0000","last_peered":"2024-09-15T22:09:22.432709+0000","last_clean":"2024-09-15T22:09:22.432709+0000","last_became_active":"2024-09-15T22:09:21.450200+0000","last_became_peered":"2024-09-15T22:09:21.450200+0000","last_unstale":"2024-09-15T22:09:22.432709+0000","last_undegraded":"2024-09-15T22:09:22.432709+0000","last_fullsized":"2024-09-15T22:09:22.432709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:10.812526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857874+0000","last_change":"2024-09-15T22:09:17.421088+0000","last_active":"2024-09-15T22:09:22.857874+0000","last_peered":"2024-09-15T22:09:22.857874+0000","last_clean":"2024-09-15T22:09:22.857874+0000","last_became_active":"2024-09-15T22:09:17.420802+0000","last_became_peered":"2024-09-15T22:09:17.420802+0000","last_unstale":"2024-09-15T22:09:22.857874+0000","last_undegraded":"2024-09-15T22:09:22.857874+0000","last_fullsized":"2024-09-15T22:09:22.857874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:57.079300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857630+0000","last_change":"2024-09-15T22:09:16.395676+0000","last_active":"2024-09-15T22:09:22.857630+0000","last_peered":"2024-09-15T22:09:22.857630+0000","last_clean":"2024-09-15T22:09:22.857630+0000","last_became_active":"2024-09-15T22:09:16.394355+0000","last_became_peered":"2024-09-15T22:09:16.394355+0000","last_unstale":"2024-09-15T22:09:22.857630+0000","last_undegraded":"2024-09-15T22:09:22.857630+0000","last_fullsized":"2024-09-15T22:09:22.857630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:53.845610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447248+0000","last_change":"2024-09-15T22:09:21.454458+0000","last_active":"2024-09-15T22:09:22.447248+0000","last_peered":"2024-09-15T22:09:22.447248+0000","last_clean":"2024-09-15T22:09:22.447248+0000","last_became_active":"2024-09-15T22:09:21.453992+0000","last_became_peered":"2024-09-15T22:09:21.453992+0000","last_unstale":"2024-09-15T22:09:22.447248+0000","last_undegraded":"2024-09-15T22:09:22.447248+0000","last_fullsized":"2024-09-15T22:09:22.447248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:08.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433584+0000","last_change":"2024-09-15T22:09:17.404161+0000","last_active":"2024-09-15T22:09:22.433584+0000","last_peered":"2024-09-15T22:09:22.433584+0000","last_clean":"2024-09-15T22:09:22.433584+0000","last_became_active":"2024-09-15T22:09:17.403899+0000","last_became_peered":"2024-09-15T22:09:17.403899+0000","last_unstale":"2024-09-15T22:09:22.433584+0000","last_undegraded":"2024-09-15T22:09:22.433584+0000","last_fullsized":"2024-09-15T22:09:22.433584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:22.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:26.561882+0000","last_change":"2024-09-15T22:09:16.403905+0000","last_active":"2024-09-15T22:09:26.561882+0000","last_peered":"2024-09-15T22:09:26.561882+0000","last_clean":"2024-09-15T22:09:26.561882+0000","last_became_active":"2024-09-15T22:09:16.403624+0000","last_became_peered":"2024-09-15T22:09:16.403624+0000","last_unstale":"2024-09-15T22:09:26.561882+0000","last_undegraded":"2024-09-15T22:09:26.561882+0000","last_fullsized":"2024-09-15T22:09:26.561882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857547+0000","last_change":"2024-09-15T22:09:21.452045+0000","last_active":"2024-09-15T22:09:22.857547+0000","last_peered":"2024-09-15T22:09:22.857547+0000","last_clean":"2024-09-15T22:09:22.857547+0000","last_became_active":"2024-09-15T22:09:21.451617+0000","last_became_peered":"2024-09-15T22:09:21.451617+0000","last_unstale":"2024-09-15T22:09:22.857547+0000","last_undegraded":"2024-09-15T22:09:22.857547+0000","last_fullsized":"2024-09-15T22:09:22.857547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:32.189930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434073+0000","last_change":"2024-09-15T22:09:17.399198+0000","last_active":"2024-09-15T22:09:22.434073+0000","last_peered":"2024-09-15T22:09:22.434073+0000","last_clean":"2024-09-15T22:09:22.434073+0000","last_became_active":"2024-09-15T22:09:17.398881+0000","last_became_peered":"2024-09-15T22:09:17.398881+0000","last_unstale":"2024-09-15T22:09:22.434073+0000","last_undegraded":"2024-09-15T22:09:22.434073+0000","last_fullsized":"2024-09-15T22:09:22.434073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:44.868956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856437+0000","last_change":"2024-09-15T22:09:16.408365+0000","last_active":"2024-09-15T22:09:22.856437+0000","last_peered":"2024-09-15T22:09:22.856437+0000","last_clean":"2024-09-15T22:09:22.856437+0000","last_became_active":"2024-09-15T22:09:16.408064+0000","last_became_peered":"2024-09-15T22:09:16.408064+0000","last_unstale":"2024-09-15T22:09:22.856437+0000","last_undegraded":"2024-09-15T22:09:22.856437+0000","last_fullsized":"2024-09-15T22:09:22.856437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:01.032313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434291+0000","last_change":"2024-09-15T22:09:21.455334+0000","last_active":"2024-09-15T22:09:22.434291+0000","last_peered":"2024-09-15T22:09:22.434291+0000","last_clean":"2024-09-15T22:09:22.434291+0000","last_became_active":"2024-09-15T22:09:21.454907+0000","last_became_peered":"2024-09-15T22:09:21.454907+0000","last_unstale":"2024-09-15T22:09:22.434291+0000","last_undegraded":"2024-09-15T22:09:22.434291+0000","last_fullsized":"2024-09-15T22:09:22.434291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:26.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856952+0000","last_change":"2024-09-15T22:09:17.415215+0000","last_active":"2024-09-15T22:09:22.856952+0000","last_peered":"2024-09-15T22:09:22.856952+0000","last_clean":"2024-09-15T22:09:22.856952+0000","last_became_active":"2024-09-15T22:09:17.414951+0000","last_became_peered":"2024-09-15T22:09:17.414951+0000","last_unstale":"2024-09-15T22:09:22.856952+0000","last_undegraded":"2024-09-15T22:09:22.856952+0000","last_fullsized":"2024-09-15T22:09:22.856952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447106+0000","last_change":"2024-09-15T22:09:16.405521+0000","last_active":"2024-09-15T22:09:22.447106+0000","last_peered":"2024-09-15T22:09:22.447106+0000","last_clean":"2024-09-15T22:09:22.447106+0000","last_became_active":"2024-09-15T22:09:16.405230+0000","last_became_peered":"2024-09-15T22:09:16.405230+0000","last_unstale":"2024-09-15T22:09:22.447106+0000","last_undegraded":"2024-09-15T22:09:22.447106+0000","last_fullsized":"2024-09-15T22:09:22.447106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:03.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432020+0000","last_change":"2024-09-15T22:09:21.450431+0000","last_active":"2024-09-15T22:09:22.432020+0000","last_peered":"2024-09-15T22:09:22.432020+0000","last_clean":"2024-09-15T22:09:22.432020+0000","last_became_active":"2024-09-15T22:09:21.449896+0000","last_became_peered":"2024-09-15T22:09:21.449896+0000","last_unstale":"2024-09-15T22:09:22.432020+0000","last_undegraded":"2024-09-15T22:09:22.432020+0000","last_fullsized":"2024-09-15T22:09:22.432020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:18.430595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447073+0000","last_change":"2024-09-15T22:09:17.422669+0000","last_active":"2024-09-15T22:09:22.447073+0000","last_peered":"2024-09-15T22:09:22.447073+0000","last_clean":"2024-09-15T22:09:22.447073+0000","last_became_active":"2024-09-15T22:09:17.422401+0000","last_became_peered":"2024-09-15T22:09:17.422401+0000","last_unstale":"2024-09-15T22:09:22.447073+0000","last_undegraded":"2024-09-15T22:09:22.447073+0000","last_fullsized":"2024-09-15T22:09:22.447073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857139+0000","last_change":"2024-09-15T22:09:16.405552+0000","last_active":"2024-09-15T22:09:22.857139+0000","last_peered":"2024-09-15T22:09:22.857139+0000","last_clean":"2024-09-15T22:09:22.857139+0000","last_became_active":"2024-09-15T22:09:16.405208+0000","last_became_peered":"2024-09-15T22:09:16.405208+0000","last_unstale":"2024-09-15T22:09:22.857139+0000","last_undegraded":"2024-09-15T22:09:22.857139+0000","last_fullsized":"2024-09-15T22:09:22.857139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432030+0000","last_change":"2024-09-15T22:09:21.448849+0000","last_active":"2024-09-15T22:09:22.432030+0000","last_peered":"2024-09-15T22:09:22.432030+0000","last_clean":"2024-09-15T22:09:22.432030+0000","last_became_active":"2024-09-15T22:09:21.448356+0000","last_became_peered":"2024-09-15T22:09:21.448356+0000","last_unstale":"2024-09-15T22:09:22.432030+0000","last_undegraded":"2024-09-15T22:09:22.432030+0000","last_fullsized":"2024-09-15T22:09:22.432030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:08.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857853+0000","last_change":"2024-09-15T22:09:21.458815+0000","last_active":"2024-09-15T22:09:22.857853+0000","last_peered":"2024-09-15T22:09:22.857853+0000","last_clean":"2024-09-15T22:09:22.857853+0000","last_became_active":"2024-09-15T22:09:21.458418+0000","last_became_peered":"2024-09-15T22:09:21.458418+0000","last_unstale":"2024-09-15T22:09:22.857853+0000","last_undegraded":"2024-09-15T22:09:22.857853+0000","last_fullsized":"2024-09-15T22:09:22.857853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:26.187414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857180+0000","last_change":"2024-09-15T22:09:17.401001+0000","last_active":"2024-09-15T22:09:22.857180+0000","last_peered":"2024-09-15T22:09:22.857180+0000","last_clean":"2024-09-15T22:09:22.857180+0000","last_became_active":"2024-09-15T22:09:17.400754+0000","last_became_peered":"2024-09-15T22:09:17.400754+0000","last_unstale":"2024-09-15T22:09:22.857180+0000","last_undegraded":"2024-09-15T22:09:22.857180+0000","last_fullsized":"2024-09-15T22:09:22.857180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:33.878828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446850+0000","last_change":"2024-09-15T22:09:16.404987+0000","last_active":"2024-09-15T22:09:22.446850+0000","last_peered":"2024-09-15T22:09:22.446850+0000","last_clean":"2024-09-15T22:09:22.446850+0000","last_became_active":"2024-09-15T22:09:16.404694+0000","last_became_peered":"2024-09-15T22:09:16.404694+0000","last_unstale":"2024-09-15T22:09:22.446850+0000","last_undegraded":"2024-09-15T22:09:22.446850+0000","last_fullsized":"2024-09-15T22:09:22.446850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857090+0000","last_change":"2024-09-15T22:09:21.457334+0000","last_active":"2024-09-15T22:09:22.857090+0000","last_peered":"2024-09-15T22:09:22.857090+0000","last_clean":"2024-09-15T22:09:22.857090+0000","last_became_active":"2024-09-15T22:09:21.456871+0000","last_became_peered":"2024-09-15T22:09:21.456871+0000","last_unstale":"2024-09-15T22:09:22.857090+0000","last_undegraded":"2024-09-15T22:09:22.857090+0000","last_fullsized":"2024-09-15T22:09:22.857090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:08.904123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432074+0000","last_change":"2024-09-15T22:09:17.402872+0000","last_active":"2024-09-15T22:09:22.432074+0000","last_peered":"2024-09-15T22:09:22.432074+0000","last_clean":"2024-09-15T22:09:22.432074+0000","last_became_active":"2024-09-15T22:09:17.402625+0000","last_became_peered":"2024-09-15T22:09:17.402625+0000","last_unstale":"2024-09-15T22:09:22.432074+0000","last_undegraded":"2024-09-15T22:09:22.432074+0000","last_fullsized":"2024-09-15T22:09:22.432074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432270+0000","last_change":"2024-09-15T22:09:16.405821+0000","last_active":"2024-09-15T22:09:22.432270+0000","last_peered":"2024-09-15T22:09:22.432270+0000","last_clean":"2024-09-15T22:09:22.432270+0000","last_became_active":"2024-09-15T22:09:16.405561+0000","last_became_peered":"2024-09-15T22:09:16.405561+0000","last_unstale":"2024-09-15T22:09:22.432270+0000","last_undegraded":"2024-09-15T22:09:22.432270+0000","last_fullsized":"2024-09-15T22:09:22.432270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856909+0000","last_change":"2024-09-15T22:09:16.403455+0000","last_active":"2024-09-15T22:09:22.856909+0000","last_peered":"2024-09-15T22:09:22.856909+0000","last_clean":"2024-09-15T22:09:22.856909+0000","last_became_active":"2024-09-15T22:09:16.403172+0000","last_became_peered":"2024-09-15T22:09:16.403172+0000","last_unstale":"2024-09-15T22:09:22.856909+0000","last_undegraded":"2024-09-15T22:09:22.856909+0000","last_fullsized":"2024-09-15T22:09:22.856909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:03.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857480+0000","last_change":"2024-09-15T22:09:17.416335+0000","last_active":"2024-09-15T22:09:22.857480+0000","last_peered":"2024-09-15T22:09:22.857480+0000","last_clean":"2024-09-15T22:09:22.857480+0000","last_became_active":"2024-09-15T22:09:17.416102+0000","last_became_peered":"2024-09-15T22:09:17.416102+0000","last_unstale":"2024-09-15T22:09:22.857480+0000","last_undegraded":"2024-09-15T22:09:22.857480+0000","last_fullsized":"2024-09-15T22:09:22.857480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856673+0000","last_change":"2024-09-15T22:09:21.448449+0000","last_active":"2024-09-15T22:09:22.856673+0000","last_peered":"2024-09-15T22:09:22.856673+0000","last_clean":"2024-09-15T22:09:22.856673+0000","last_became_active":"2024-09-15T22:09:21.448020+0000","last_became_peered":"2024-09-15T22:09:21.448020+0000","last_unstale":"2024-09-15T22:09:22.856673+0000","last_undegraded":"2024-09-15T22:09:22.856673+0000","last_fullsized":"2024-09-15T22:09:22.856673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:05.244676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432514+0000","last_change":"2024-09-15T22:09:16.401331+0000","last_active":"2024-09-15T22:09:22.432514+0000","last_peered":"2024-09-15T22:09:22.432514+0000","last_clean":"2024-09-15T22:09:22.432514+0000","last_became_active":"2024-09-15T22:09:16.401040+0000","last_became_peered":"2024-09-15T22:09:16.401040+0000","last_unstale":"2024-09-15T22:09:22.432514+0000","last_undegraded":"2024-09-15T22:09:22.432514+0000","last_fullsized":"2024-09-15T22:09:22.432514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.799831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433188+0000","last_change":"2024-09-15T22:09:17.405328+0000","last_active":"2024-09-15T22:09:22.433188+0000","last_peered":"2024-09-15T22:09:22.433188+0000","last_clean":"2024-09-15T22:09:22.433188+0000","last_became_active":"2024-09-15T22:09:17.404772+0000","last_became_peered":"2024-09-15T22:09:17.404772+0000","last_unstale":"2024-09-15T22:09:22.433188+0000","last_undegraded":"2024-09-15T22:09:22.433188+0000","last_fullsized":"2024-09-15T22:09:22.433188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:33.377260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432644+0000","last_change":"2024-09-15T22:09:21.458359+0000","last_active":"2024-09-15T22:09:22.432644+0000","last_peered":"2024-09-15T22:09:22.432644+0000","last_clean":"2024-09-15T22:09:22.432644+0000","last_became_active":"2024-09-15T22:09:21.457977+0000","last_became_peered":"2024-09-15T22:09:21.457977+0000","last_unstale":"2024-09-15T22:09:22.432644+0000","last_undegraded":"2024-09-15T22:09:22.432644+0000","last_fullsized":"2024-09-15T22:09:22.432644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.055754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856459+0000","last_change":"2024-09-15T22:09:17.405556+0000","last_active":"2024-09-15T22:09:22.856459+0000","last_peered":"2024-09-15T22:09:22.856459+0000","last_clean":"2024-09-15T22:09:22.856459+0000","last_became_active":"2024-09-15T22:09:17.405129+0000","last_became_peered":"2024-09-15T22:09:17.405129+0000","last_unstale":"2024-09-15T22:09:22.856459+0000","last_undegraded":"2024-09-15T22:09:22.856459+0000","last_fullsized":"2024-09-15T22:09:22.856459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856332+0000","last_change":"2024-09-15T22:09:17.408189+0000","last_active":"2024-09-15T22:09:22.856332+0000","last_peered":"2024-09-15T22:09:22.856332+0000","last_clean":"2024-09-15T22:09:22.856332+0000","last_became_active":"2024-09-15T22:09:17.407877+0000","last_became_peered":"2024-09-15T22:09:17.407877+0000","last_unstale":"2024-09-15T22:09:22.856332+0000","last_undegraded":"2024-09-15T22:09:22.856332+0000","last_fullsized":"2024-09-15T22:09:22.856332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:02.290840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446878+0000","last_change":"2024-09-15T22:09:17.415666+0000","last_active":"2024-09-15T22:09:22.446878+0000","last_peered":"2024-09-15T22:09:22.446878+0000","last_clean":"2024-09-15T22:09:22.446878+0000","last_became_active":"2024-09-15T22:09:17.415399+0000","last_became_peered":"2024-09-15T22:09:17.415399+0000","last_unstale":"2024-09-15T22:09:22.446878+0000","last_undegraded":"2024-09-15T22:09:22.446878+0000","last_fullsized":"2024-09-15T22:09:22.446878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857393+0000","last_change":"2024-09-15T22:09:17.406140+0000","last_active":"2024-09-15T22:09:22.857393+0000","last_peered":"2024-09-15T22:09:22.857393+0000","last_clean":"2024-09-15T22:09:22.857393+0000","last_became_active":"2024-09-15T22:09:17.405142+0000","last_became_peered":"2024-09-15T22:09:17.405142+0000","last_unstale":"2024-09-15T22:09:22.857393+0000","last_undegraded":"2024-09-15T22:09:22.857393+0000","last_fullsized":"2024-09-15T22:09:22.857393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:17.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432765+0000","last_change":"2024-09-15T22:09:17.411027+0000","last_active":"2024-09-15T22:09:22.432765+0000","last_peered":"2024-09-15T22:09:22.432765+0000","last_clean":"2024-09-15T22:09:22.432765+0000","last_became_active":"2024-09-15T22:09:17.408913+0000","last_became_peered":"2024-09-15T22:09:17.408913+0000","last_unstale":"2024-09-15T22:09:22.432765+0000","last_undegraded":"2024-09-15T22:09:22.432765+0000","last_fullsized":"2024-09-15T22:09:22.432765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:34.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856265+0000","last_change":"2024-09-15T22:09:17.401385+0000","last_active":"2024-09-15T22:09:22.856265+0000","last_peered":"2024-09-15T22:09:22.856265+0000","last_clean":"2024-09-15T22:09:22.856265+0000","last_became_active":"2024-09-15T22:09:17.400916+0000","last_became_peered":"2024-09-15T22:09:17.400916+0000","last_unstale":"2024-09-15T22:09:22.856265+0000","last_undegraded":"2024-09-15T22:09:22.856265+0000","last_fullsized":"2024-09-15T22:09:22.856265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:31.994148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857149+0000","last_change":"2024-09-15T22:09:17.405622+0000","last_active":"2024-09-15T22:09:22.857149+0000","last_peered":"2024-09-15T22:09:22.857149+0000","last_clean":"2024-09-15T22:09:22.857149+0000","last_became_active":"2024-09-15T22:09:17.405319+0000","last_became_peered":"2024-09-15T22:09:17.405319+0000","last_unstale":"2024-09-15T22:09:22.857149+0000","last_undegraded":"2024-09-15T22:09:22.857149+0000","last_fullsized":"2024-09-15T22:09:22.857149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432397+0000","last_change":"2024-09-15T22:09:17.409317+0000","last_active":"2024-09-15T22:09:22.432397+0000","last_peered":"2024-09-15T22:09:22.432397+0000","last_clean":"2024-09-15T22:09:22.432397+0000","last_became_active":"2024-09-15T22:09:17.408949+0000","last_became_peered":"2024-09-15T22:09:17.408949+0000","last_unstale":"2024-09-15T22:09:22.432397+0000","last_undegraded":"2024-09-15T22:09:22.432397+0000","last_fullsized":"2024-09-15T22:09:22.432397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446723+0000","last_change":"2024-09-15T22:09:17.416439+0000","last_active":"2024-09-15T22:09:22.446723+0000","last_peered":"2024-09-15T22:09:22.446723+0000","last_clean":"2024-09-15T22:09:22.446723+0000","last_became_active":"2024-09-15T22:09:17.416170+0000","last_became_peered":"2024-09-15T22:09:17.416170+0000","last_unstale":"2024-09-15T22:09:22.446723+0000","last_undegraded":"2024-09-15T22:09:22.446723+0000","last_fullsized":"2024-09-15T22:09:22.446723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432211+0000","last_change":"2024-09-15T22:09:17.409471+0000","last_active":"2024-09-15T22:09:22.432211+0000","last_peered":"2024-09-15T22:09:22.432211+0000","last_clean":"2024-09-15T22:09:22.432211+0000","last_became_active":"2024-09-15T22:09:17.408969+0000","last_became_peered":"2024-09-15T22:09:17.408969+0000","last_unstale":"2024-09-15T22:09:22.432211+0000","last_undegraded":"2024-09-15T22:09:22.432211+0000","last_fullsized":"2024-09-15T22:09:22.432211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446844+0000","last_change":"2024-09-15T22:09:17.422118+0000","last_active":"2024-09-15T22:09:22.446844+0000","last_peered":"2024-09-15T22:09:22.446844+0000","last_clean":"2024-09-15T22:09:22.446844+0000","last_became_active":"2024-09-15T22:09:17.421846+0000","last_became_peered":"2024-09-15T22:09:17.421846+0000","last_unstale":"2024-09-15T22:09:22.446844+0000","last_undegraded":"2024-09-15T22:09:22.446844+0000","last_fullsized":"2024-09-15T22:09:22.446844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:34.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857299+0000","last_change":"2024-09-15T22:09:17.421168+0000","last_active":"2024-09-15T22:09:22.857299+0000","last_peered":"2024-09-15T22:09:22.857299+0000","last_clean":"2024-09-15T22:09:22.857299+0000","last_became_active":"2024-09-15T22:09:17.420849+0000","last_became_peered":"2024-09-15T22:09:17.420849+0000","last_unstale":"2024-09-15T22:09:22.857299+0000","last_undegraded":"2024-09-15T22:09:22.857299+0000","last_fullsized":"2024-09-15T22:09:22.857299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:25.108343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856803+0000","last_change":"2024-09-15T22:09:17.410112+0000","last_active":"2024-09-15T22:09:22.856803+0000","last_peered":"2024-09-15T22:09:22.856803+0000","last_clean":"2024-09-15T22:09:22.856803+0000","last_became_active":"2024-09-15T22:09:17.409837+0000","last_became_peered":"2024-09-15T22:09:17.409837+0000","last_unstale":"2024-09-15T22:09:22.856803+0000","last_undegraded":"2024-09-15T22:09:22.856803+0000","last_fullsized":"2024-09-15T22:09:22.856803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433979+0000","last_change":"2024-09-15T22:09:17.400115+0000","last_active":"2024-09-15T22:09:22.433979+0000","last_peered":"2024-09-15T22:09:22.433979+0000","last_clean":"2024-09-15T22:09:22.433979+0000","last_became_active":"2024-09-15T22:09:17.399835+0000","last_became_peered":"2024-09-15T22:09:17.399835+0000","last_unstale":"2024-09-15T22:09:22.433979+0000","last_undegraded":"2024-09-15T22:09:22.433979+0000","last_fullsized":"2024-09-15T22:09:22.433979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:13.972528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856270+0000","last_change":"2024-09-15T22:09:17.401680+0000","last_active":"2024-09-15T22:09:22.856270+0000","last_peered":"2024-09-15T22:09:22.856270+0000","last_clean":"2024-09-15T22:09:22.856270+0000","last_became_active":"2024-09-15T22:09:17.401413+0000","last_became_peered":"2024-09-15T22:09:17.401413+0000","last_unstale":"2024-09-15T22:09:22.856270+0000","last_undegraded":"2024-09-15T22:09:22.856270+0000","last_fullsized":"2024-09-15T22:09:22.856270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:04.007901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447310+0000","last_change":"2024-09-15T22:09:17.421910+0000","last_active":"2024-09-15T22:09:22.447310+0000","last_peered":"2024-09-15T22:09:22.447310+0000","last_clean":"2024-09-15T22:09:22.447310+0000","last_became_active":"2024-09-15T22:09:17.421469+0000","last_became_peered":"2024-09-15T22:09:17.421469+0000","last_unstale":"2024-09-15T22:09:22.447310+0000","last_undegraded":"2024-09-15T22:09:22.447310+0000","last_fullsized":"2024-09-15T22:09:22.447310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:15.123863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446601+0000","last_change":"2024-09-15T22:09:17.411524+0000","last_active":"2024-09-15T22:09:22.446601+0000","last_peered":"2024-09-15T22:09:22.446601+0000","last_clean":"2024-09-15T22:09:22.446601+0000","last_became_active":"2024-09-15T22:09:17.411244+0000","last_became_peered":"2024-09-15T22:09:17.411244+0000","last_unstale":"2024-09-15T22:09:22.446601+0000","last_undegraded":"2024-09-15T22:09:22.446601+0000","last_fullsized":"2024-09-15T22:09:22.446601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857274+0000","last_change":"2024-09-15T22:09:17.409933+0000","last_active":"2024-09-15T22:09:22.857274+0000","last_peered":"2024-09-15T22:09:22.857274+0000","last_clean":"2024-09-15T22:09:22.857274+0000","last_became_active":"2024-09-15T22:09:17.409681+0000","last_became_peered":"2024-09-15T22:09:17.409681+0000","last_unstale":"2024-09-15T22:09:22.857274+0000","last_undegraded":"2024-09-15T22:09:22.857274+0000","last_fullsized":"2024-09-15T22:09:22.857274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:37.130999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857870+0000","last_change":"2024-09-15T22:09:17.403522+0000","last_active":"2024-09-15T22:09:22.857870+0000","last_peered":"2024-09-15T22:09:22.857870+0000","last_clean":"2024-09-15T22:09:22.857870+0000","last_became_active":"2024-09-15T22:09:17.403220+0000","last_became_peered":"2024-09-15T22:09:17.403220+0000","last_unstale":"2024-09-15T22:09:22.857870+0000","last_undegraded":"2024-09-15T22:09:22.857870+0000","last_fullsized":"2024-09-15T22:09:22.857870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:01.208798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432332+0000","last_change":"2024-09-15T22:09:17.400537+0000","last_active":"2024-09-15T22:09:22.432332+0000","last_peered":"2024-09-15T22:09:22.432332+0000","last_clean":"2024-09-15T22:09:22.432332+0000","last_became_active":"2024-09-15T22:09:17.400288+0000","last_became_peered":"2024-09-15T22:09:17.400288+0000","last_unstale":"2024-09-15T22:09:22.432332+0000","last_undegraded":"2024-09-15T22:09:22.432332+0000","last_fullsized":"2024-09-15T22:09:22.432332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433969+0000","last_change":"2024-09-15T22:09:17.404318+0000","last_active":"2024-09-15T22:09:22.433969+0000","last_peered":"2024-09-15T22:09:22.433969+0000","last_clean":"2024-09-15T22:09:22.433969+0000","last_became_active":"2024-09-15T22:09:17.404038+0000","last_became_peered":"2024-09-15T22:09:17.404038+0000","last_unstale":"2024-09-15T22:09:22.433969+0000","last_undegraded":"2024-09-15T22:09:22.433969+0000","last_fullsized":"2024-09-15T22:09:22.433969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:04.314746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856907+0000","last_change":"2024-09-15T22:09:17.415645+0000","last_active":"2024-09-15T22:09:22.856907+0000","last_peered":"2024-09-15T22:09:22.856907+0000","last_clean":"2024-09-15T22:09:22.856907+0000","last_became_active":"2024-09-15T22:09:17.415354+0000","last_became_peered":"2024-09-15T22:09:17.415354+0000","last_unstale":"2024-09-15T22:09:22.856907+0000","last_undegraded":"2024-09-15T22:09:22.856907+0000","last_fullsized":"2024-09-15T22:09:22.856907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857144+0000","last_change":"2024-09-15T22:09:17.415171+0000","last_active":"2024-09-15T22:09:22.857144+0000","last_peered":"2024-09-15T22:09:22.857144+0000","last_clean":"2024-09-15T22:09:22.857144+0000","last_became_active":"2024-09-15T22:09:17.414875+0000","last_became_peered":"2024-09-15T22:09:17.414875+0000","last_unstale":"2024-09-15T22:09:22.857144+0000","last_undegraded":"2024-09-15T22:09:22.857144+0000","last_fullsized":"2024-09-15T22:09:22.857144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434378+0000","last_change":"2024-09-15T22:09:17.420121+0000","last_active":"2024-09-15T22:09:22.434378+0000","last_peered":"2024-09-15T22:09:22.434378+0000","last_clean":"2024-09-15T22:09:22.434378+0000","last_became_active":"2024-09-15T22:09:17.419854+0000","last_became_peered":"2024-09-15T22:09:17.419854+0000","last_unstale":"2024-09-15T22:09:22.434378+0000","last_undegraded":"2024-09-15T22:09:22.434378+0000","last_fullsized":"2024-09-15T22:09:22.434378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:41.421190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.431873+0000","last_change":"2024-09-15T22:09:17.414316+0000","last_active":"2024-09-15T22:09:22.431873+0000","last_peered":"2024-09-15T22:09:22.431873+0000","last_clean":"2024-09-15T22:09:22.431873+0000","last_became_active":"2024-09-15T22:09:17.414020+0000","last_became_peered":"2024-09-15T22:09:17.414020+0000","last_unstale":"2024-09-15T22:09:22.431873+0000","last_undegraded":"2024-09-15T22:09:22.431873+0000","last_fullsized":"2024-09-15T22:09:22.431873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432910+0000","last_change":"2024-09-15T22:09:17.404509+0000","last_active":"2024-09-15T22:09:22.432910+0000","last_peered":"2024-09-15T22:09:22.432910+0000","last_clean":"2024-09-15T22:09:22.432910+0000","last_became_active":"2024-09-15T22:09:17.404181+0000","last_became_peered":"2024-09-15T22:09:17.404181+0000","last_unstale":"2024-09-15T22:09:22.432910+0000","last_undegraded":"2024-09-15T22:09:22.432910+0000","last_fullsized":"2024-09-15T22:09:22.432910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:22.003479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446713+0000","last_change":"2024-09-15T22:09:17.414252+0000","last_active":"2024-09-15T22:09:22.446713+0000","last_peered":"2024-09-15T22:09:22.446713+0000","last_clean":"2024-09-15T22:09:22.446713+0000","last_became_active":"2024-09-15T22:09:17.413987+0000","last_became_peered":"2024-09-15T22:09:17.413987+0000","last_unstale":"2024-09-15T22:09:22.446713+0000","last_undegraded":"2024-09-15T22:09:22.446713+0000","last_fullsized":"2024-09-15T22:09:22.446713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433226+0000","last_change":"2024-09-15T22:09:17.399744+0000","last_active":"2024-09-15T22:09:22.433226+0000","last_peered":"2024-09-15T22:09:22.433226+0000","last_clean":"2024-09-15T22:09:22.433226+0000","last_became_active":"2024-09-15T22:09:17.399470+0000","last_became_peered":"2024-09-15T22:09:17.399470+0000","last_unstale":"2024-09-15T22:09:22.433226+0000","last_undegraded":"2024-09-15T22:09:22.433226+0000","last_fullsized":"2024-09-15T22:09:22.433226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:04.868244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446913+0000","last_change":"2024-09-15T22:09:17.416763+0000","last_active":"2024-09-15T22:09:22.446913+0000","last_peered":"2024-09-15T22:09:22.446913+0000","last_clean":"2024-09-15T22:09:22.446913+0000","last_became_active":"2024-09-15T22:09:17.415987+0000","last_became_peered":"2024-09-15T22:09:17.415987+0000","last_unstale":"2024-09-15T22:09:22.446913+0000","last_undegraded":"2024-09-15T22:09:22.446913+0000","last_fullsized":"2024-09-15T22:09:22.446913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:04.868244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856619+0000","last_change":"2024-09-15T22:09:17.404558+0000","last_active":"2024-09-15T22:09:22.856619+0000","last_peered":"2024-09-15T22:09:22.856619+0000","last_clean":"2024-09-15T22:09:22.856619+0000","last_became_active":"2024-09-15T22:09:17.404301+0000","last_became_peered":"2024-09-15T22:09:17.404301+0000","last_unstale":"2024-09-15T22:09:22.856619+0000","last_undegraded":"2024-09-15T22:09:22.856619+0000","last_fullsized":"2024-09-15T22:09:22.856619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856943+0000","last_change":"2024-09-15T22:09:17.402881+0000","last_active":"2024-09-15T22:09:22.856943+0000","last_peered":"2024-09-15T22:09:22.856943+0000","last_clean":"2024-09-15T22:09:22.856943+0000","last_became_active":"2024-09-15T22:09:17.402632+0000","last_became_peered":"2024-09-15T22:09:17.402632+0000","last_unstale":"2024-09-15T22:09:22.856943+0000","last_undegraded":"2024-09-15T22:09:22.856943+0000","last_fullsized":"2024-09-15T22:09:22.856943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:30.142651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434291+0000","last_change":"2024-09-15T22:09:17.403017+0000","last_active":"2024-09-15T22:09:22.434291+0000","last_peered":"2024-09-15T22:09:22.434291+0000","last_clean":"2024-09-15T22:09:22.434291+0000","last_became_active":"2024-09-15T22:09:17.402751+0000","last_became_peered":"2024-09-15T22:09:17.402751+0000","last_unstale":"2024-09-15T22:09:22.434291+0000","last_undegraded":"2024-09-15T22:09:22.434291+0000","last_fullsized":"2024-09-15T22:09:22.434291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:26.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":331776,"data_stored":694125,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":103265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":103301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":339968,"data_stored":694181,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":103335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:09:36.398 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:09:36.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.529+0000 7fe21d65a640 1 Processor -- start 2024-09-15T22:09:36.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.529+0000 7fe21d65a640 1 -- start start 2024-09-15T22:09:36.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.530+0000 7fe21d65a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe21806d4e0 0x7fe218073130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.530+0000 7fe21d65a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe21806cc20 0x7fe21806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.530+0000 7fe21d65a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2180b76a0 con 0x7fe218073890 2024-09-15T22:09:36.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.530+0000 7fe21d65a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fe2180722e0 con 0x7fe21806cc20 2024-09-15T22:09:36.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.530+0000 7fe21d65a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fe2180b73c0 con 0x7fe21806d4e0 2024-09-15T22:09:36.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.530+0000 7fe2167fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe21806cc20 0x7fe21806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.530+0000 7fe2177fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe218073890 0x7fe21814b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56988/0 (socket says 172.21.15.78:56988) 2024-09-15T22:09:36.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.530+0000 7fe2177fe640 1 -- 172.21.15.78:0/3345289341 learned_addr learned my addr 172.21.15.78:0/3345289341 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:36.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.530+0000 7fe216ffd640 1 --2- 172.21.15.78:0/3345289341 >> v2:172.21.15.175:3300/0 conn(0x7fe21806d4e0 0x7fe218073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.530+0000 7fe2167fc640 1 -- 172.21.15.78:0/3345289341 >> v2:172.21.15.175:3300/0 conn(0x7fe21806d4e0 msgr2=0x7fe218073130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:36.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.530+0000 7fe2167fc640 1 --2- 172.21.15.78:0/3345289341 >> v2:172.21.15.175:3300/0 conn(0x7fe21806d4e0 0x7fe218073130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.530+0000 7fe2167fc640 1 -- 172.21.15.78:0/3345289341 >> v1:172.21.15.78:6789/0 conn(0x7fe218073890 legacy=0x7fe21814b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.530+0000 7fe2167fc640 1 -- 172.21.15.78:0/3345289341 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe218072c10 con 0x7fe21806cc20 2024-09-15T22:09:36.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.530+0000 7fe215ffb640 1 -- 172.21.15.78:0/3345289341 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071504848 0 0) 0x7fe2180b76a0 con 0x7fe218073890 2024-09-15T22:09:36.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.531+0000 7fe2167fc640 1 --2- 172.21.15.78:0/3345289341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe21806cc20 0x7fe21806d8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2180bc3d0 tx=0x7fe20c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12855e7f99e8e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:36.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.531+0000 7fe215ffb640 1 -- 172.21.15.78:0/3345289341 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c037070 con 0x7fe21806cc20 2024-09-15T22:09:36.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.531+0000 7fe215ffb640 1 -- 172.21.15.78:0/3345289341 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe20c032440 con 0x7fe21806cc20 2024-09-15T22:09:36.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.531+0000 7fe215ffb640 1 -- 172.21.15.78:0/3345289341 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c02ae60 con 0x7fe21806cc20 2024-09-15T22:09:36.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.532+0000 7fe21d65a640 1 -- 172.21.15.78:0/3345289341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe21806cc20 msgr2=0x7fe21806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.532+0000 7fe21d65a640 1 --2- 172.21.15.78:0/3345289341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe21806cc20 0x7fe21806d8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2180bc3d0 tx=0x7fe20c02a110 comp rx=0 tx=0).stop 2024-09-15T22:09:36.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.532+0000 7fe21d65a640 1 -- 172.21.15.78:0/3345289341 shutdown_connections 2024-09-15T22:09:36.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.532+0000 7fe21d65a640 1 --2- 172.21.15.78:0/3345289341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe21806cc20 0x7fe21806d8c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.532+0000 7fe21d65a640 1 --2- 172.21.15.78:0/3345289341 >> v2:172.21.15.175:3300/0 conn(0x7fe21806d4e0 0x7fe218073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.532+0000 7fe21d65a640 1 -- 172.21.15.78:0/3345289341 >> 172.21.15.78:0/3345289341 conn(0x7fe218074ba0 msgr2=0x7fe218074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:36.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.532+0000 7fe21d65a640 1 -- 172.21.15.78:0/3345289341 shutdown_connections 2024-09-15T22:09:36.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.532+0000 7fe21d65a640 1 -- 172.21.15.78:0/3345289341 wait complete. 2024-09-15T22:09:36.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.533+0000 7fe21d65a640 1 Processor -- start 2024-09-15T22:09:36.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.533+0000 7fe21d65a640 1 -- start start 2024-09-15T22:09:36.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe21d65a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe21806d4e0 0x7fe2181429c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe21d65a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe218073890 0x7fe218141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe21d65a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2181e06a0 0x7fe2181e0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe21d65a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe21814bd30 con 0x7fe2181e06a0 2024-09-15T22:09:36.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe21d65a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe218071f20 con 0x7fe21806d4e0 2024-09-15T22:09:36.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe21d65a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe21814beb0 con 0x7fe218073890 2024-09-15T22:09:36.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe2177fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2181e06a0 0x7fe2181e0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe2177fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2181e06a0 0x7fe2181e0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49652/0 (socket says 172.21.15.78:49652) 2024-09-15T22:09:36.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe2177fe640 1 -- 172.21.15.78:0/3786960440 learned_addr learned my addr 172.21.15.78:0/3786960440 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:36.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe216ffd640 1 --2- 172.21.15.78:0/3786960440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe21806d4e0 0x7fe2181429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe2177fe640 1 -- 172.21.15.78:0/3786960440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe218073890 msgr2=0x7fe218141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe2177fe640 1 --2- 172.21.15.78:0/3786960440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe218073890 0x7fe218141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe2177fe640 1 -- 172.21.15.78:0/3786960440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe21806d4e0 msgr2=0x7fe2181429c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe2177fe640 1 --2- 172.21.15.78:0/3786960440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe21806d4e0 0x7fe2181429c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe2177fe640 1 -- 172.21.15.78:0/3786960440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2181e1070 con 0x7fe2181e06a0 2024-09-15T22:09:36.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe2177fe640 1 --2- 172.21.15.78:0/3786960440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2181e06a0 0x7fe2181e0b30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe21000c700 tx=0x7fe21000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:36.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe1ff7fe640 1 -- 172.21.15.78:0/3786960440 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210018070 con 0x7fe2181e06a0 2024-09-15T22:09:36.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe1ff7fe640 1 -- 172.21.15.78:0/3786960440 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21000ce10 con 0x7fe2181e06a0 2024-09-15T22:09:36.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe1ff7fe640 1 -- 172.21.15.78:0/3786960440 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21000a880 con 0x7fe2181e06a0 2024-09-15T22:09:36.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe21d65a640 1 -- 172.21.15.78:0/3786960440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21814a300 con 0x7fe2181e06a0 2024-09-15T22:09:36.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.534+0000 7fe21d65a640 1 -- 172.21.15.78:0/3786960440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe218141ed0 con 0x7fe2181e06a0 2024-09-15T22:09:36.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.535+0000 7fe21d65a640 1 -- 172.21.15.78:0/3786960440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe21806d8c0 con 0x7fe2181e06a0 2024-09-15T22:09:36.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.536+0000 7fe1ff7fe640 1 -- 172.21.15.78:0/3786960440 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe21001b070 con 0x7fe2181e06a0 2024-09-15T22:09:36.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.536+0000 7fe1ff7fe640 1 --2- 172.21.15.78:0/3786960440 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe20406c2b0 0x7fe20406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.536+0000 7fe1ff7fe640 1 -- 172.21.15.78:0/3786960440 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe21008ac80 con 0x7fe2181e06a0 2024-09-15T22:09:36.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.536+0000 7fe216ffd640 1 --2- 172.21.15.78:0/3786960440 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe20406c2b0 0x7fe20406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.537+0000 7fe216ffd640 1 --2- 172.21.15.78:0/3786960440 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe20406c2b0 0x7fe20406e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe208006fd0 tx=0x7fe208008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:36.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.541+0000 7fe1ff7fe640 1 -- 172.21.15.78:0/3786960440 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe210059140 con 0x7fe2181e06a0 2024-09-15T22:09:36.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.702+0000 7fe21d65a640 1 -- 172.21.15.78:0/3786960440 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe218142520 con 0x7fe20406c2b0 2024-09-15T22:09:36.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.710+0000 7fe1ff7fe640 1 -- 172.21.15.78:0/3786960440 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332611 (secure 0 0 0) 0x7fe218142520 con 0x7fe20406c2b0 2024-09-15T22:09:36.715 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:36.717 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-15T22:09:36.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.713+0000 7fe21d65a640 1 -- 172.21.15.78:0/3786960440 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe20406c2b0 msgr2=0x7fe20406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.713+0000 7fe21d65a640 1 --2- 172.21.15.78:0/3786960440 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe20406c2b0 0x7fe20406e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe208006fd0 tx=0x7fe208008040 comp rx=0 tx=0).stop 2024-09-15T22:09:36.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.713+0000 7fe21d65a640 1 -- 172.21.15.78:0/3786960440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2181e06a0 msgr2=0x7fe2181e0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.713+0000 7fe21d65a640 1 --2- 172.21.15.78:0/3786960440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2181e06a0 0x7fe2181e0b30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe21000c700 tx=0x7fe21000cbc0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.713+0000 7fe21d65a640 1 -- 172.21.15.78:0/3786960440 shutdown_connections 2024-09-15T22:09:36.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.713+0000 7fe21d65a640 1 --2- 172.21.15.78:0/3786960440 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe20406c2b0 0x7fe20406e770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.713+0000 7fe21d65a640 1 --2- 172.21.15.78:0/3786960440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2181e06a0 0x7fe2181e0b30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.713+0000 7fe21d65a640 1 --2- 172.21.15.78:0/3786960440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe218073890 0x7fe218141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.713+0000 7fe21d65a640 1 --2- 172.21.15.78:0/3786960440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe21806d4e0 0x7fe2181429c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.713+0000 7fe21d65a640 1 -- 172.21.15.78:0/3786960440 >> 172.21.15.78:0/3786960440 conn(0x7fe218074ba0 msgr2=0x7fe2180b9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:36.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.713+0000 7fe21d65a640 1 -- 172.21.15.78:0/3786960440 shutdown_connections 2024-09-15T22:09:36.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.713+0000 7fe21d65a640 1 -- 172.21.15.78:0/3786960440 wait complete. 2024-09-15T22:09:36.727 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-15T22:09:35.974346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218476,"kb_used_data":2240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756244,"statfs":{"total":773094113280,"available":772870393856,"internally_reserved":0,"allocated":2293760,"data_stored":2015420,"data_compressed":65044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002528"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857105+0000","last_change":"2024-09-15T22:09:16.403008+0000","last_active":"2024-09-15T22:09:22.857105+0000","last_peered":"2024-09-15T22:09:22.857105+0000","last_clean":"2024-09-15T22:09:22.857105+0000","last_became_active":"2024-09-15T22:09:16.402725+0000","last_became_peered":"2024-09-15T22:09:16.402725+0000","last_unstale":"2024-09-15T22:09:22.857105+0000","last_undegraded":"2024-09-15T22:09:22.857105+0000","last_fullsized":"2024-09-15T22:09:22.857105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:32.659951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432405+0000","last_change":"2024-09-15T22:09:17.400698+0000","last_active":"2024-09-15T22:09:22.432405+0000","last_peered":"2024-09-15T22:09:22.432405+0000","last_clean":"2024-09-15T22:09:22.432405+0000","last_became_active":"2024-09-15T22:09:17.400428+0000","last_became_peered":"2024-09-15T22:09:17.400428+0000","last_unstale":"2024-09-15T22:09:22.432405+0000","last_undegraded":"2024-09-15T22:09:22.432405+0000","last_fullsized":"2024-09-15T22:09:22.432405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:15.431072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432024+0000","last_change":"2024-09-15T22:09:21.449737+0000","last_active":"2024-09-15T22:09:22.432024+0000","last_peered":"2024-09-15T22:09:22.432024+0000","last_clean":"2024-09-15T22:09:22.432024+0000","last_became_active":"2024-09-15T22:09:21.449376+0000","last_became_peered":"2024-09-15T22:09:21.449376+0000","last_unstale":"2024-09-15T22:09:22.432024+0000","last_undegraded":"2024-09-15T22:09:22.432024+0000","last_fullsized":"2024-09-15T22:09:22.432024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:13.943283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432590+0000","last_change":"2024-09-15T22:09:16.407728+0000","last_active":"2024-09-15T22:09:22.432590+0000","last_peered":"2024-09-15T22:09:22.432590+0000","last_clean":"2024-09-15T22:09:22.432590+0000","last_became_active":"2024-09-15T22:09:16.407458+0000","last_became_peered":"2024-09-15T22:09:16.407458+0000","last_unstale":"2024-09-15T22:09:22.432590+0000","last_undegraded":"2024-09-15T22:09:22.432590+0000","last_fullsized":"2024-09-15T22:09:22.432590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856796+0000","last_change":"2024-09-15T22:09:17.415311+0000","last_active":"2024-09-15T22:09:22.856796+0000","last_peered":"2024-09-15T22:09:22.856796+0000","last_clean":"2024-09-15T22:09:22.856796+0000","last_became_active":"2024-09-15T22:09:17.414966+0000","last_became_peered":"2024-09-15T22:09:17.414966+0000","last_unstale":"2024-09-15T22:09:22.856796+0000","last_undegraded":"2024-09-15T22:09:22.856796+0000","last_fullsized":"2024-09-15T22:09:22.856796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432860+0000","last_change":"2024-09-15T22:09:21.454087+0000","last_active":"2024-09-15T22:09:22.432860+0000","last_peered":"2024-09-15T22:09:22.432860+0000","last_clean":"2024-09-15T22:09:22.432860+0000","last_became_active":"2024-09-15T22:09:21.453701+0000","last_became_peered":"2024-09-15T22:09:21.453701+0000","last_unstale":"2024-09-15T22:09:22.432860+0000","last_undegraded":"2024-09-15T22:09:22.432860+0000","last_fullsized":"2024-09-15T22:09:22.432860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:29.697947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433861+0000","last_change":"2024-09-15T22:09:16.405902+0000","last_active":"2024-09-15T22:09:22.433861+0000","last_peered":"2024-09-15T22:09:22.433861+0000","last_clean":"2024-09-15T22:09:22.433861+0000","last_became_active":"2024-09-15T22:09:16.405626+0000","last_became_peered":"2024-09-15T22:09:16.405626+0000","last_unstale":"2024-09-15T22:09:22.433861+0000","last_undegraded":"2024-09-15T22:09:22.433861+0000","last_fullsized":"2024-09-15T22:09:22.433861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:03.001838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446948+0000","last_change":"2024-09-15T22:09:17.416894+0000","last_active":"2024-09-15T22:09:22.446948+0000","last_peered":"2024-09-15T22:09:22.446948+0000","last_clean":"2024-09-15T22:09:22.446948+0000","last_became_active":"2024-09-15T22:09:17.416367+0000","last_became_peered":"2024-09-15T22:09:17.416367+0000","last_unstale":"2024-09-15T22:09:22.446948+0000","last_undegraded":"2024-09-15T22:09:22.446948+0000","last_fullsized":"2024-09-15T22:09:22.446948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:15.431072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434492+0000","last_change":"2024-09-15T22:09:21.455260+0000","last_active":"2024-09-15T22:09:22.434492+0000","last_peered":"2024-09-15T22:09:22.434492+0000","last_clean":"2024-09-15T22:09:22.434492+0000","last_became_active":"2024-09-15T22:09:21.454850+0000","last_became_peered":"2024-09-15T22:09:21.454850+0000","last_unstale":"2024-09-15T22:09:22.434492+0000","last_undegraded":"2024-09-15T22:09:22.434492+0000","last_fullsized":"2024-09-15T22:09:22.434492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:08.904123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434195+0000","last_change":"2024-09-15T22:09:16.407670+0000","last_active":"2024-09-15T22:09:22.434195+0000","last_peered":"2024-09-15T22:09:22.434195+0000","last_clean":"2024-09-15T22:09:22.434195+0000","last_became_active":"2024-09-15T22:09:16.407364+0000","last_became_peered":"2024-09-15T22:09:16.407364+0000","last_unstale":"2024-09-15T22:09:22.434195+0000","last_undegraded":"2024-09-15T22:09:22.434195+0000","last_fullsized":"2024-09-15T22:09:22.434195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:01.284777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447188+0000","last_change":"2024-09-15T22:09:17.408224+0000","last_active":"2024-09-15T22:09:22.447188+0000","last_peered":"2024-09-15T22:09:22.447188+0000","last_clean":"2024-09-15T22:09:22.447188+0000","last_became_active":"2024-09-15T22:09:17.407881+0000","last_became_peered":"2024-09-15T22:09:17.407881+0000","last_unstale":"2024-09-15T22:09:22.447188+0000","last_undegraded":"2024-09-15T22:09:22.447188+0000","last_fullsized":"2024-09-15T22:09:22.447188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:22.003479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432971+0000","last_change":"2024-09-15T22:09:21.450705+0000","last_active":"2024-09-15T22:09:22.432971+0000","last_peered":"2024-09-15T22:09:22.432971+0000","last_clean":"2024-09-15T22:09:22.432971+0000","last_became_active":"2024-09-15T22:09:21.450265+0000","last_became_peered":"2024-09-15T22:09:21.450265+0000","last_unstale":"2024-09-15T22:09:22.432971+0000","last_undegraded":"2024-09-15T22:09:22.432971+0000","last_fullsized":"2024-09-15T22:09:22.432971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:21.477522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856481+0000","last_change":"2024-09-15T22:09:17.410686+0000","last_active":"2024-09-15T22:09:22.856481+0000","last_peered":"2024-09-15T22:09:22.856481+0000","last_clean":"2024-09-15T22:09:22.856481+0000","last_became_active":"2024-09-15T22:09:17.410383+0000","last_became_peered":"2024-09-15T22:09:17.410383+0000","last_unstale":"2024-09-15T22:09:22.856481+0000","last_undegraded":"2024-09-15T22:09:22.856481+0000","last_fullsized":"2024-09-15T22:09:22.856481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433896+0000","last_change":"2024-09-15T22:09:16.405335+0000","last_active":"2024-09-15T22:09:22.433896+0000","last_peered":"2024-09-15T22:09:22.433896+0000","last_clean":"2024-09-15T22:09:22.433896+0000","last_became_active":"2024-09-15T22:09:16.405010+0000","last_became_peered":"2024-09-15T22:09:16.405010+0000","last_unstale":"2024-09-15T22:09:22.433896+0000","last_undegraded":"2024-09-15T22:09:22.433896+0000","last_fullsized":"2024-09-15T22:09:22.433896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:00.202736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433953+0000","last_change":"2024-09-15T22:09:21.453670+0000","last_active":"2024-09-15T22:09:22.433953+0000","last_peered":"2024-09-15T22:09:22.433953+0000","last_clean":"2024-09-15T22:09:22.433953+0000","last_became_active":"2024-09-15T22:09:21.453219+0000","last_became_peered":"2024-09-15T22:09:21.453219+0000","last_unstale":"2024-09-15T22:09:22.433953+0000","last_undegraded":"2024-09-15T22:09:22.433953+0000","last_fullsized":"2024-09-15T22:09:22.433953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:28.271273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432427+0000","last_change":"2024-09-15T22:09:17.405327+0000","last_active":"2024-09-15T22:09:22.432427+0000","last_peered":"2024-09-15T22:09:22.432427+0000","last_clean":"2024-09-15T22:09:22.432427+0000","last_became_active":"2024-09-15T22:09:17.405065+0000","last_became_peered":"2024-09-15T22:09:17.405065+0000","last_unstale":"2024-09-15T22:09:22.432427+0000","last_undegraded":"2024-09-15T22:09:22.432427+0000","last_fullsized":"2024-09-15T22:09:22.432427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857701+0000","last_change":"2024-09-15T22:09:16.406705+0000","last_active":"2024-09-15T22:09:22.857701+0000","last_peered":"2024-09-15T22:09:22.857701+0000","last_clean":"2024-09-15T22:09:22.857701+0000","last_became_active":"2024-09-15T22:09:16.406454+0000","last_became_peered":"2024-09-15T22:09:16.406454+0000","last_unstale":"2024-09-15T22:09:22.857701+0000","last_undegraded":"2024-09-15T22:09:22.857701+0000","last_fullsized":"2024-09-15T22:09:22.857701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:02.444245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433842+0000","last_change":"2024-09-15T22:09:21.456243+0000","last_active":"2024-09-15T22:09:22.433842+0000","last_peered":"2024-09-15T22:09:22.433842+0000","last_clean":"2024-09-15T22:09:22.433842+0000","last_became_active":"2024-09-15T22:09:21.455819+0000","last_became_peered":"2024-09-15T22:09:21.455819+0000","last_unstale":"2024-09-15T22:09:22.433842+0000","last_undegraded":"2024-09-15T22:09:22.433842+0000","last_fullsized":"2024-09-15T22:09:22.433842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:02.526090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432175+0000","last_change":"2024-09-15T22:09:17.399551+0000","last_active":"2024-09-15T22:09:22.432175+0000","last_peered":"2024-09-15T22:09:22.432175+0000","last_clean":"2024-09-15T22:09:22.432175+0000","last_became_active":"2024-09-15T22:09:17.399290+0000","last_became_peered":"2024-09-15T22:09:17.399290+0000","last_unstale":"2024-09-15T22:09:22.432175+0000","last_undegraded":"2024-09-15T22:09:22.432175+0000","last_fullsized":"2024-09-15T22:09:22.432175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857365+0000","last_change":"2024-09-15T22:09:16.408974+0000","last_active":"2024-09-15T22:09:22.857365+0000","last_peered":"2024-09-15T22:09:22.857365+0000","last_clean":"2024-09-15T22:09:22.857365+0000","last_became_active":"2024-09-15T22:09:16.408691+0000","last_became_peered":"2024-09-15T22:09:16.408691+0000","last_unstale":"2024-09-15T22:09:22.857365+0000","last_undegraded":"2024-09-15T22:09:22.857365+0000","last_fullsized":"2024-09-15T22:09:22.857365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:26:32.412274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857068+0000","last_change":"2024-09-15T22:09:21.458893+0000","last_active":"2024-09-15T22:09:22.857068+0000","last_peered":"2024-09-15T22:09:22.857068+0000","last_clean":"2024-09-15T22:09:22.857068+0000","last_became_active":"2024-09-15T22:09:21.458548+0000","last_became_peered":"2024-09-15T22:09:21.458548+0000","last_unstale":"2024-09-15T22:09:22.857068+0000","last_undegraded":"2024-09-15T22:09:22.857068+0000","last_fullsized":"2024-09-15T22:09:22.857068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:29.163692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434430+0000","last_change":"2024-09-15T22:09:17.400823+0000","last_active":"2024-09-15T22:09:22.434430+0000","last_peered":"2024-09-15T22:09:22.434430+0000","last_clean":"2024-09-15T22:09:22.434430+0000","last_became_active":"2024-09-15T22:09:17.400494+0000","last_became_peered":"2024-09-15T22:09:17.400494+0000","last_unstale":"2024-09-15T22:09:22.434430+0000","last_undegraded":"2024-09-15T22:09:22.434430+0000","last_fullsized":"2024-09-15T22:09:22.434430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:02.290840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432593+0000","last_change":"2024-09-15T22:09:16.409156+0000","last_active":"2024-09-15T22:09:22.432593+0000","last_peered":"2024-09-15T22:09:22.432593+0000","last_clean":"2024-09-15T22:09:22.432593+0000","last_became_active":"2024-09-15T22:09:16.408603+0000","last_became_peered":"2024-09-15T22:09:16.408603+0000","last_unstale":"2024-09-15T22:09:22.432593+0000","last_undegraded":"2024-09-15T22:09:22.432593+0000","last_fullsized":"2024-09-15T22:09:22.432593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:12.245902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433463+0000","last_change":"2024-09-15T22:09:21.447940+0000","last_active":"2024-09-15T22:09:22.433463+0000","last_peered":"2024-09-15T22:09:22.433463+0000","last_clean":"2024-09-15T22:09:22.433463+0000","last_became_active":"2024-09-15T22:09:21.447348+0000","last_became_peered":"2024-09-15T22:09:21.447348+0000","last_unstale":"2024-09-15T22:09:22.433463+0000","last_undegraded":"2024-09-15T22:09:22.433463+0000","last_fullsized":"2024-09-15T22:09:22.433463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:19.466950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.858001+0000","last_change":"2024-09-15T22:09:17.402826+0000","last_active":"2024-09-15T22:09:22.858001+0000","last_peered":"2024-09-15T22:09:22.858001+0000","last_clean":"2024-09-15T22:09:22.858001+0000","last_became_active":"2024-09-15T22:09:17.402585+0000","last_became_peered":"2024-09-15T22:09:17.402585+0000","last_unstale":"2024-09-15T22:09:22.858001+0000","last_undegraded":"2024-09-15T22:09:22.858001+0000","last_fullsized":"2024-09-15T22:09:22.858001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857204+0000","last_change":"2024-09-15T22:09:16.408097+0000","last_active":"2024-09-15T22:09:22.857204+0000","last_peered":"2024-09-15T22:09:22.857204+0000","last_clean":"2024-09-15T22:09:22.857204+0000","last_became_active":"2024-09-15T22:09:16.407657+0000","last_became_peered":"2024-09-15T22:09:16.407657+0000","last_unstale":"2024-09-15T22:09:22.857204+0000","last_undegraded":"2024-09-15T22:09:22.857204+0000","last_fullsized":"2024-09-15T22:09:22.857204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433301+0000","last_change":"2024-09-15T22:09:21.451205+0000","last_active":"2024-09-15T22:09:22.433301+0000","last_peered":"2024-09-15T22:09:22.433301+0000","last_clean":"2024-09-15T22:09:22.433301+0000","last_became_active":"2024-09-15T22:09:21.450731+0000","last_became_peered":"2024-09-15T22:09:21.450731+0000","last_unstale":"2024-09-15T22:09:22.433301+0000","last_undegraded":"2024-09-15T22:09:22.433301+0000","last_fullsized":"2024-09-15T22:09:22.433301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:38.650786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432489+0000","last_change":"2024-09-15T22:09:17.421690+0000","last_active":"2024-09-15T22:09:22.432489+0000","last_peered":"2024-09-15T22:09:22.432489+0000","last_clean":"2024-09-15T22:09:22.432489+0000","last_became_active":"2024-09-15T22:09:17.421379+0000","last_became_peered":"2024-09-15T22:09:17.421379+0000","last_unstale":"2024-09-15T22:09:22.432489+0000","last_undegraded":"2024-09-15T22:09:22.432489+0000","last_fullsized":"2024-09-15T22:09:22.432489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857039+0000","last_change":"2024-09-15T22:09:16.408662+0000","last_active":"2024-09-15T22:09:22.857039+0000","last_peered":"2024-09-15T22:09:22.857039+0000","last_clean":"2024-09-15T22:09:22.857039+0000","last_became_active":"2024-09-15T22:09:16.408068+0000","last_became_peered":"2024-09-15T22:09:16.408068+0000","last_unstale":"2024-09-15T22:09:22.857039+0000","last_undegraded":"2024-09-15T22:09:22.857039+0000","last_fullsized":"2024-09-15T22:09:22.857039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:29.217773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.431852+0000","last_change":"2024-09-15T22:09:21.457447+0000","last_active":"2024-09-15T22:09:22.431852+0000","last_peered":"2024-09-15T22:09:22.431852+0000","last_clean":"2024-09-15T22:09:22.431852+0000","last_became_active":"2024-09-15T22:09:21.457031+0000","last_became_peered":"2024-09-15T22:09:21.457031+0000","last_unstale":"2024-09-15T22:09:22.431852+0000","last_undegraded":"2024-09-15T22:09:22.431852+0000","last_fullsized":"2024-09-15T22:09:22.431852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:45.457068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856945+0000","last_change":"2024-09-15T22:09:17.400043+0000","last_active":"2024-09-15T22:09:22.856945+0000","last_peered":"2024-09-15T22:09:22.856945+0000","last_clean":"2024-09-15T22:09:22.856945+0000","last_became_active":"2024-09-15T22:09:17.399815+0000","last_became_peered":"2024-09-15T22:09:17.399815+0000","last_unstale":"2024-09-15T22:09:22.856945+0000","last_undegraded":"2024-09-15T22:09:22.856945+0000","last_fullsized":"2024-09-15T22:09:22.856945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:38.779044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434071+0000","last_change":"2024-09-15T22:09:16.407483+0000","last_active":"2024-09-15T22:09:22.434071+0000","last_peered":"2024-09-15T22:09:22.434071+0000","last_clean":"2024-09-15T22:09:22.434071+0000","last_became_active":"2024-09-15T22:09:16.407199+0000","last_became_peered":"2024-09-15T22:09:16.407199+0000","last_unstale":"2024-09-15T22:09:22.434071+0000","last_undegraded":"2024-09-15T22:09:22.434071+0000","last_fullsized":"2024-09-15T22:09:22.434071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:24.102281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857257+0000","last_change":"2024-09-15T22:09:21.449620+0000","last_active":"2024-09-15T22:09:22.857257+0000","last_peered":"2024-09-15T22:09:22.857257+0000","last_clean":"2024-09-15T22:09:22.857257+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:09:22.857257+0000","last_undegraded":"2024-09-15T22:09:22.857257+0000","last_fullsized":"2024-09-15T22:09:22.857257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:40.690811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447282+0000","last_change":"2024-09-15T22:09:17.414930+0000","last_active":"2024-09-15T22:09:22.447282+0000","last_peered":"2024-09-15T22:09:22.447282+0000","last_clean":"2024-09-15T22:09:22.447282+0000","last_became_active":"2024-09-15T22:09:17.414645+0000","last_became_peered":"2024-09-15T22:09:17.414645+0000","last_unstale":"2024-09-15T22:09:22.447282+0000","last_undegraded":"2024-09-15T22:09:22.447282+0000","last_fullsized":"2024-09-15T22:09:22.447282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:22.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857058+0000","last_change":"2024-09-15T22:09:16.408794+0000","last_active":"2024-09-15T22:09:22.857058+0000","last_peered":"2024-09-15T22:09:22.857058+0000","last_clean":"2024-09-15T22:09:22.857058+0000","last_became_active":"2024-09-15T22:09:16.408530+0000","last_became_peered":"2024-09-15T22:09:16.408530+0000","last_unstale":"2024-09-15T22:09:22.857058+0000","last_undegraded":"2024-09-15T22:09:22.857058+0000","last_fullsized":"2024-09-15T22:09:22.857058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:45.460989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857342+0000","last_change":"2024-09-15T22:09:21.451875+0000","last_active":"2024-09-15T22:09:22.857342+0000","last_peered":"2024-09-15T22:09:22.857342+0000","last_clean":"2024-09-15T22:09:22.857342+0000","last_became_active":"2024-09-15T22:09:21.451491+0000","last_became_peered":"2024-09-15T22:09:21.451491+0000","last_unstale":"2024-09-15T22:09:22.857342+0000","last_undegraded":"2024-09-15T22:09:22.857342+0000","last_fullsized":"2024-09-15T22:09:22.857342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:11.279572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434545+0000","last_change":"2024-09-15T22:09:17.409336+0000","last_active":"2024-09-15T22:09:22.434545+0000","last_peered":"2024-09-15T22:09:22.434545+0000","last_clean":"2024-09-15T22:09:22.434545+0000","last_became_active":"2024-09-15T22:09:17.409038+0000","last_became_peered":"2024-09-15T22:09:17.409038+0000","last_unstale":"2024-09-15T22:09:22.434545+0000","last_undegraded":"2024-09-15T22:09:22.434545+0000","last_fullsized":"2024-09-15T22:09:22.434545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:06.946537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447132+0000","last_change":"2024-09-15T22:09:16.409869+0000","last_active":"2024-09-15T22:09:22.447132+0000","last_peered":"2024-09-15T22:09:22.447132+0000","last_clean":"2024-09-15T22:09:22.447132+0000","last_became_active":"2024-09-15T22:09:16.409532+0000","last_became_peered":"2024-09-15T22:09:16.409532+0000","last_unstale":"2024-09-15T22:09:22.447132+0000","last_undegraded":"2024-09-15T22:09:22.447132+0000","last_fullsized":"2024-09-15T22:09:22.447132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:05.940474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857020+0000","last_change":"2024-09-15T22:09:21.458201+0000","last_active":"2024-09-15T22:09:22.857020+0000","last_peered":"2024-09-15T22:09:22.857020+0000","last_clean":"2024-09-15T22:09:22.857020+0000","last_became_active":"2024-09-15T22:09:21.457818+0000","last_became_peered":"2024-09-15T22:09:21.457818+0000","last_unstale":"2024-09-15T22:09:22.857020+0000","last_undegraded":"2024-09-15T22:09:22.857020+0000","last_fullsized":"2024-09-15T22:09:22.857020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:16.163530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857554+0000","last_change":"2024-09-15T22:09:17.399405+0000","last_active":"2024-09-15T22:09:22.857554+0000","last_peered":"2024-09-15T22:09:22.857554+0000","last_clean":"2024-09-15T22:09:22.857554+0000","last_became_active":"2024-09-15T22:09:17.399148+0000","last_became_peered":"2024-09-15T22:09:17.399148+0000","last_unstale":"2024-09-15T22:09:22.857554+0000","last_undegraded":"2024-09-15T22:09:22.857554+0000","last_fullsized":"2024-09-15T22:09:22.857554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:29.126156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856466+0000","last_change":"2024-09-15T22:09:16.402885+0000","last_active":"2024-09-15T22:09:22.856466+0000","last_peered":"2024-09-15T22:09:22.856466+0000","last_clean":"2024-09-15T22:09:22.856466+0000","last_became_active":"2024-09-15T22:09:16.402575+0000","last_became_peered":"2024-09-15T22:09:16.402575+0000","last_unstale":"2024-09-15T22:09:22.856466+0000","last_undegraded":"2024-09-15T22:09:22.856466+0000","last_fullsized":"2024-09-15T22:09:22.856466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857231+0000","last_change":"2024-09-15T22:09:21.457254+0000","last_active":"2024-09-15T22:09:22.857231+0000","last_peered":"2024-09-15T22:09:22.857231+0000","last_clean":"2024-09-15T22:09:22.857231+0000","last_became_active":"2024-09-15T22:09:21.456858+0000","last_became_peered":"2024-09-15T22:09:21.456858+0000","last_unstale":"2024-09-15T22:09:22.857231+0000","last_undegraded":"2024-09-15T22:09:22.857231+0000","last_fullsized":"2024-09-15T22:09:22.857231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:52.339264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856356+0000","last_change":"2024-09-15T22:09:17.411196+0000","last_active":"2024-09-15T22:09:22.856356+0000","last_peered":"2024-09-15T22:09:22.856356+0000","last_clean":"2024-09-15T22:09:22.856356+0000","last_became_active":"2024-09-15T22:09:17.409905+0000","last_became_peered":"2024-09-15T22:09:17.409905+0000","last_unstale":"2024-09-15T22:09:22.856356+0000","last_undegraded":"2024-09-15T22:09:22.856356+0000","last_fullsized":"2024-09-15T22:09:22.856356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:10.299704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432708+0000","last_change":"2024-09-15T22:09:16.409152+0000","last_active":"2024-09-15T22:09:22.432708+0000","last_peered":"2024-09-15T22:09:22.432708+0000","last_clean":"2024-09-15T22:09:22.432708+0000","last_became_active":"2024-09-15T22:09:16.408793+0000","last_became_peered":"2024-09-15T22:09:16.408793+0000","last_unstale":"2024-09-15T22:09:22.432708+0000","last_undegraded":"2024-09-15T22:09:22.432708+0000","last_fullsized":"2024-09-15T22:09:22.432708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:09.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857950+0000","last_change":"2024-09-15T22:09:21.456804+0000","last_active":"2024-09-15T22:09:22.857950+0000","last_peered":"2024-09-15T22:09:22.857950+0000","last_clean":"2024-09-15T22:09:22.857950+0000","last_became_active":"2024-09-15T22:09:21.456416+0000","last_became_peered":"2024-09-15T22:09:21.456416+0000","last_unstale":"2024-09-15T22:09:22.857950+0000","last_undegraded":"2024-09-15T22:09:22.857950+0000","last_fullsized":"2024-09-15T22:09:22.857950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:28.462550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432088+0000","last_change":"2024-09-15T22:09:17.415024+0000","last_active":"2024-09-15T22:09:22.432088+0000","last_peered":"2024-09-15T22:09:22.432088+0000","last_clean":"2024-09-15T22:09:22.432088+0000","last_became_active":"2024-09-15T22:09:17.414773+0000","last_became_peered":"2024-09-15T22:09:17.414773+0000","last_unstale":"2024-09-15T22:09:22.432088+0000","last_undegraded":"2024-09-15T22:09:22.432088+0000","last_fullsized":"2024-09-15T22:09:22.432088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446804+0000","last_change":"2024-09-15T22:09:16.401625+0000","last_active":"2024-09-15T22:09:22.446804+0000","last_peered":"2024-09-15T22:09:22.446804+0000","last_clean":"2024-09-15T22:09:22.446804+0000","last_became_active":"2024-09-15T22:09:16.401328+0000","last_became_peered":"2024-09-15T22:09:16.401328+0000","last_unstale":"2024-09-15T22:09:22.446804+0000","last_undegraded":"2024-09-15T22:09:22.446804+0000","last_fullsized":"2024-09-15T22:09:22.446804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432814+0000","last_change":"2024-09-15T22:09:07.243631+0000","last_active":"2024-09-15T22:09:22.432814+0000","last_peered":"2024-09-15T22:09:22.432814+0000","last_clean":"2024-09-15T22:09:22.432814+0000","last_became_active":"2024-09-15T22:09:07.243223+0000","last_became_peered":"2024-09-15T22:09:07.243223+0000","last_unstale":"2024-09-15T22:09:22.432814+0000","last_undegraded":"2024-09-15T22:09:22.432814+0000","last_fullsized":"2024-09-15T22:09:22.432814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_clean_scrub_stamp":"2024-09-15T22:09:06.009777+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:17:18.429315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856944+0000","last_change":"2024-09-15T22:09:21.453536+0000","last_active":"2024-09-15T22:09:22.856944+0000","last_peered":"2024-09-15T22:09:22.856944+0000","last_clean":"2024-09-15T22:09:22.856944+0000","last_became_active":"2024-09-15T22:09:21.453022+0000","last_became_peered":"2024-09-15T22:09:21.453022+0000","last_unstale":"2024-09-15T22:09:22.856944+0000","last_undegraded":"2024-09-15T22:09:22.856944+0000","last_fullsized":"2024-09-15T22:09:22.856944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:26.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433676+0000","last_change":"2024-09-15T22:09:17.421914+0000","last_active":"2024-09-15T22:09:22.433676+0000","last_peered":"2024-09-15T22:09:22.433676+0000","last_clean":"2024-09-15T22:09:22.433676+0000","last_became_active":"2024-09-15T22:09:17.420783+0000","last_became_peered":"2024-09-15T22:09:17.420783+0000","last_unstale":"2024-09-15T22:09:22.433676+0000","last_undegraded":"2024-09-15T22:09:22.433676+0000","last_fullsized":"2024-09-15T22:09:22.433676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:24.426671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856694+0000","last_change":"2024-09-15T22:09:16.404982+0000","last_active":"2024-09-15T22:09:22.856694+0000","last_peered":"2024-09-15T22:09:22.856694+0000","last_clean":"2024-09-15T22:09:22.856694+0000","last_became_active":"2024-09-15T22:09:16.404639+0000","last_became_peered":"2024-09-15T22:09:16.404639+0000","last_unstale":"2024-09-15T22:09:22.856694+0000","last_undegraded":"2024-09-15T22:09:22.856694+0000","last_fullsized":"2024-09-15T22:09:22.856694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856609+0000","last_change":"2024-09-15T22:09:21.457352+0000","last_active":"2024-09-15T22:09:22.856609+0000","last_peered":"2024-09-15T22:09:22.856609+0000","last_clean":"2024-09-15T22:09:22.856609+0000","last_became_active":"2024-09-15T22:09:21.456906+0000","last_became_peered":"2024-09-15T22:09:21.456906+0000","last_unstale":"2024-09-15T22:09:22.856609+0000","last_undegraded":"2024-09-15T22:09:22.856609+0000","last_fullsized":"2024-09-15T22:09:22.856609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:28.271273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447025+0000","last_change":"2024-09-15T22:09:17.416652+0000","last_active":"2024-09-15T22:09:22.447025+0000","last_peered":"2024-09-15T22:09:22.447025+0000","last_clean":"2024-09-15T22:09:22.447025+0000","last_became_active":"2024-09-15T22:09:17.415597+0000","last_became_peered":"2024-09-15T22:09:17.415597+0000","last_unstale":"2024-09-15T22:09:22.447025+0000","last_undegraded":"2024-09-15T22:09:22.447025+0000","last_fullsized":"2024-09-15T22:09:22.447025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:36.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856534+0000","last_change":"2024-09-15T22:09:16.405689+0000","last_active":"2024-09-15T22:09:22.856534+0000","last_peered":"2024-09-15T22:09:22.856534+0000","last_clean":"2024-09-15T22:09:22.856534+0000","last_became_active":"2024-09-15T22:09:16.405433+0000","last_became_peered":"2024-09-15T22:09:16.405433+0000","last_unstale":"2024-09-15T22:09:22.856534+0000","last_undegraded":"2024-09-15T22:09:22.856534+0000","last_fullsized":"2024-09-15T22:09:22.856534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.332999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857836+0000","last_change":"2024-09-15T22:09:21.448031+0000","last_active":"2024-09-15T22:09:22.857836+0000","last_peered":"2024-09-15T22:09:22.857836+0000","last_clean":"2024-09-15T22:09:22.857836+0000","last_became_active":"2024-09-15T22:09:21.447464+0000","last_became_peered":"2024-09-15T22:09:21.447464+0000","last_unstale":"2024-09-15T22:09:22.857836+0000","last_undegraded":"2024-09-15T22:09:22.857836+0000","last_fullsized":"2024-09-15T22:09:22.857836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:26.039358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434380+0000","last_change":"2024-09-15T22:09:17.412910+0000","last_active":"2024-09-15T22:09:22.434380+0000","last_peered":"2024-09-15T22:09:22.434380+0000","last_clean":"2024-09-15T22:09:22.434380+0000","last_became_active":"2024-09-15T22:09:17.412079+0000","last_became_peered":"2024-09-15T22:09:17.412079+0000","last_unstale":"2024-09-15T22:09:22.434380+0000","last_undegraded":"2024-09-15T22:09:22.434380+0000","last_fullsized":"2024-09-15T22:09:22.434380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:04.536343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856351+0000","last_change":"2024-09-15T22:09:16.405941+0000","last_active":"2024-09-15T22:09:22.856351+0000","last_peered":"2024-09-15T22:09:22.856351+0000","last_clean":"2024-09-15T22:09:22.856351+0000","last_became_active":"2024-09-15T22:09:16.405621+0000","last_became_peered":"2024-09-15T22:09:16.405621+0000","last_unstale":"2024-09-15T22:09:22.856351+0000","last_undegraded":"2024-09-15T22:09:22.856351+0000","last_fullsized":"2024-09-15T22:09:22.856351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446643+0000","last_change":"2024-09-15T22:09:21.449669+0000","last_active":"2024-09-15T22:09:22.446643+0000","last_peered":"2024-09-15T22:09:22.446643+0000","last_clean":"2024-09-15T22:09:22.446643+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:09:22.446643+0000","last_undegraded":"2024-09-15T22:09:22.446643+0000","last_fullsized":"2024-09-15T22:09:22.446643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:45.457068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433550+0000","last_change":"2024-09-15T22:09:17.410475+0000","last_active":"2024-09-15T22:09:22.433550+0000","last_peered":"2024-09-15T22:09:22.433550+0000","last_clean":"2024-09-15T22:09:22.433550+0000","last_became_active":"2024-09-15T22:09:17.410176+0000","last_became_peered":"2024-09-15T22:09:17.410176+0000","last_unstale":"2024-09-15T22:09:22.433550+0000","last_undegraded":"2024-09-15T22:09:22.433550+0000","last_fullsized":"2024-09-15T22:09:22.433550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434085+0000","last_change":"2024-09-15T22:09:16.399090+0000","last_active":"2024-09-15T22:09:22.434085+0000","last_peered":"2024-09-15T22:09:22.434085+0000","last_clean":"2024-09-15T22:09:22.434085+0000","last_became_active":"2024-09-15T22:09:16.398789+0000","last_became_peered":"2024-09-15T22:09:16.398789+0000","last_unstale":"2024-09-15T22:09:22.434085+0000","last_undegraded":"2024-09-15T22:09:22.434085+0000","last_fullsized":"2024-09-15T22:09:22.434085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:14.477432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433128+0000","last_change":"2024-09-15T22:09:21.448270+0000","last_active":"2024-09-15T22:09:22.433128+0000","last_peered":"2024-09-15T22:09:22.433128+0000","last_clean":"2024-09-15T22:09:22.433128+0000","last_became_active":"2024-09-15T22:09:21.447541+0000","last_became_peered":"2024-09-15T22:09:21.447541+0000","last_unstale":"2024-09-15T22:09:22.433128+0000","last_undegraded":"2024-09-15T22:09:22.433128+0000","last_fullsized":"2024-09-15T22:09:22.433128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:51.175728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433007+0000","last_change":"2024-09-15T22:09:17.410762+0000","last_active":"2024-09-15T22:09:22.433007+0000","last_peered":"2024-09-15T22:09:22.433007+0000","last_clean":"2024-09-15T22:09:22.433007+0000","last_became_active":"2024-09-15T22:09:17.410431+0000","last_became_peered":"2024-09-15T22:09:17.410431+0000","last_unstale":"2024-09-15T22:09:22.433007+0000","last_undegraded":"2024-09-15T22:09:22.433007+0000","last_fullsized":"2024-09-15T22:09:22.433007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:15.123863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.855905+0000","last_change":"2024-09-15T22:09:16.409298+0000","last_active":"2024-09-15T22:09:22.855905+0000","last_peered":"2024-09-15T22:09:22.855905+0000","last_clean":"2024-09-15T22:09:22.855905+0000","last_became_active":"2024-09-15T22:09:16.408991+0000","last_became_peered":"2024-09-15T22:09:16.408991+0000","last_unstale":"2024-09-15T22:09:22.855905+0000","last_undegraded":"2024-09-15T22:09:22.855905+0000","last_fullsized":"2024-09-15T22:09:22.855905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.799831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857935+0000","last_change":"2024-09-15T22:09:21.453936+0000","last_active":"2024-09-15T22:09:22.857935+0000","last_peered":"2024-09-15T22:09:22.857935+0000","last_clean":"2024-09-15T22:09:22.857935+0000","last_became_active":"2024-09-15T22:09:21.453526+0000","last_became_peered":"2024-09-15T22:09:21.453526+0000","last_unstale":"2024-09-15T22:09:22.857935+0000","last_undegraded":"2024-09-15T22:09:22.857935+0000","last_fullsized":"2024-09-15T22:09:22.857935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:19.159742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856612+0000","last_change":"2024-09-15T22:09:17.404617+0000","last_active":"2024-09-15T22:09:22.856612+0000","last_peered":"2024-09-15T22:09:22.856612+0000","last_clean":"2024-09-15T22:09:22.856612+0000","last_became_active":"2024-09-15T22:09:17.404310+0000","last_became_peered":"2024-09-15T22:09:17.404310+0000","last_unstale":"2024-09-15T22:09:22.856612+0000","last_undegraded":"2024-09-15T22:09:22.856612+0000","last_fullsized":"2024-09-15T22:09:22.856612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:17.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856611+0000","last_change":"2024-09-15T22:09:16.403439+0000","last_active":"2024-09-15T22:09:22.856611+0000","last_peered":"2024-09-15T22:09:22.856611+0000","last_clean":"2024-09-15T22:09:22.856611+0000","last_became_active":"2024-09-15T22:09:16.403137+0000","last_became_peered":"2024-09-15T22:09:16.403137+0000","last_unstale":"2024-09-15T22:09:22.856611+0000","last_undegraded":"2024-09-15T22:09:22.856611+0000","last_fullsized":"2024-09-15T22:09:22.856611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:05.940474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432504+0000","last_change":"2024-09-15T22:09:21.451370+0000","last_active":"2024-09-15T22:09:22.432504+0000","last_peered":"2024-09-15T22:09:22.432504+0000","last_clean":"2024-09-15T22:09:22.432504+0000","last_became_active":"2024-09-15T22:09:21.451016+0000","last_became_peered":"2024-09-15T22:09:21.451016+0000","last_unstale":"2024-09-15T22:09:22.432504+0000","last_undegraded":"2024-09-15T22:09:22.432504+0000","last_fullsized":"2024-09-15T22:09:22.432504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:54.480340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433466+0000","last_change":"2024-09-15T22:09:17.412953+0000","last_active":"2024-09-15T22:09:22.433466+0000","last_peered":"2024-09-15T22:09:22.433466+0000","last_clean":"2024-09-15T22:09:22.433466+0000","last_became_active":"2024-09-15T22:09:17.412680+0000","last_became_peered":"2024-09-15T22:09:17.412680+0000","last_unstale":"2024-09-15T22:09:22.433466+0000","last_undegraded":"2024-09-15T22:09:22.433466+0000","last_fullsized":"2024-09-15T22:09:22.433466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:36.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446965+0000","last_change":"2024-09-15T22:09:16.406833+0000","last_active":"2024-09-15T22:09:22.446965+0000","last_peered":"2024-09-15T22:09:22.446965+0000","last_clean":"2024-09-15T22:09:22.446965+0000","last_became_active":"2024-09-15T22:09:16.406550+0000","last_became_peered":"2024-09-15T22:09:16.406550+0000","last_unstale":"2024-09-15T22:09:22.446965+0000","last_undegraded":"2024-09-15T22:09:22.446965+0000","last_fullsized":"2024-09-15T22:09:22.446965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432709+0000","last_change":"2024-09-15T22:09:21.450825+0000","last_active":"2024-09-15T22:09:22.432709+0000","last_peered":"2024-09-15T22:09:22.432709+0000","last_clean":"2024-09-15T22:09:22.432709+0000","last_became_active":"2024-09-15T22:09:21.450200+0000","last_became_peered":"2024-09-15T22:09:21.450200+0000","last_unstale":"2024-09-15T22:09:22.432709+0000","last_undegraded":"2024-09-15T22:09:22.432709+0000","last_fullsized":"2024-09-15T22:09:22.432709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:10.812526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857874+0000","last_change":"2024-09-15T22:09:17.421088+0000","last_active":"2024-09-15T22:09:22.857874+0000","last_peered":"2024-09-15T22:09:22.857874+0000","last_clean":"2024-09-15T22:09:22.857874+0000","last_became_active":"2024-09-15T22:09:17.420802+0000","last_became_peered":"2024-09-15T22:09:17.420802+0000","last_unstale":"2024-09-15T22:09:22.857874+0000","last_undegraded":"2024-09-15T22:09:22.857874+0000","last_fullsized":"2024-09-15T22:09:22.857874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:57.079300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857630+0000","last_change":"2024-09-15T22:09:16.395676+0000","last_active":"2024-09-15T22:09:22.857630+0000","last_peered":"2024-09-15T22:09:22.857630+0000","last_clean":"2024-09-15T22:09:22.857630+0000","last_became_active":"2024-09-15T22:09:16.394355+0000","last_became_peered":"2024-09-15T22:09:16.394355+0000","last_unstale":"2024-09-15T22:09:22.857630+0000","last_undegraded":"2024-09-15T22:09:22.857630+0000","last_fullsized":"2024-09-15T22:09:22.857630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:53.845610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447248+0000","last_change":"2024-09-15T22:09:21.454458+0000","last_active":"2024-09-15T22:09:22.447248+0000","last_peered":"2024-09-15T22:09:22.447248+0000","last_clean":"2024-09-15T22:09:22.447248+0000","last_became_active":"2024-09-15T22:09:21.453992+0000","last_became_peered":"2024-09-15T22:09:21.453992+0000","last_unstale":"2024-09-15T22:09:22.447248+0000","last_undegraded":"2024-09-15T22:09:22.447248+0000","last_fullsized":"2024-09-15T22:09:22.447248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:08.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433584+0000","last_change":"2024-09-15T22:09:17.404161+0000","last_active":"2024-09-15T22:09:22.433584+0000","last_peered":"2024-09-15T22:09:22.433584+0000","last_clean":"2024-09-15T22:09:22.433584+0000","last_became_active":"2024-09-15T22:09:17.403899+0000","last_became_peered":"2024-09-15T22:09:17.403899+0000","last_unstale":"2024-09-15T22:09:22.433584+0000","last_undegraded":"2024-09-15T22:09:22.433584+0000","last_fullsized":"2024-09-15T22:09:22.433584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:22.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:26.561882+0000","last_change":"2024-09-15T22:09:16.403905+0000","last_active":"2024-09-15T22:09:26.561882+0000","last_peered":"2024-09-15T22:09:26.561882+0000","last_clean":"2024-09-15T22:09:26.561882+0000","last_became_active":"2024-09-15T22:09:16.403624+0000","last_became_peered":"2024-09-15T22:09:16.403624+0000","last_unstale":"2024-09-15T22:09:26.561882+0000","last_undegraded":"2024-09-15T22:09:26.561882+0000","last_fullsized":"2024-09-15T22:09:26.561882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857547+0000","last_change":"2024-09-15T22:09:21.452045+0000","last_active":"2024-09-15T22:09:22.857547+0000","last_peered":"2024-09-15T22:09:22.857547+0000","last_clean":"2024-09-15T22:09:22.857547+0000","last_became_active":"2024-09-15T22:09:21.451617+0000","last_became_peered":"2024-09-15T22:09:21.451617+0000","last_unstale":"2024-09-15T22:09:22.857547+0000","last_undegraded":"2024-09-15T22:09:22.857547+0000","last_fullsized":"2024-09-15T22:09:22.857547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:32.189930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434073+0000","last_change":"2024-09-15T22:09:17.399198+0000","last_active":"2024-09-15T22:09:22.434073+0000","last_peered":"2024-09-15T22:09:22.434073+0000","last_clean":"2024-09-15T22:09:22.434073+0000","last_became_active":"2024-09-15T22:09:17.398881+0000","last_became_peered":"2024-09-15T22:09:17.398881+0000","last_unstale":"2024-09-15T22:09:22.434073+0000","last_undegraded":"2024-09-15T22:09:22.434073+0000","last_fullsized":"2024-09-15T22:09:22.434073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:44.868956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856437+0000","last_change":"2024-09-15T22:09:16.408365+0000","last_active":"2024-09-15T22:09:22.856437+0000","last_peered":"2024-09-15T22:09:22.856437+0000","last_clean":"2024-09-15T22:09:22.856437+0000","last_became_active":"2024-09-15T22:09:16.408064+0000","last_became_peered":"2024-09-15T22:09:16.408064+0000","last_unstale":"2024-09-15T22:09:22.856437+0000","last_undegraded":"2024-09-15T22:09:22.856437+0000","last_fullsized":"2024-09-15T22:09:22.856437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:01.032313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434291+0000","last_change":"2024-09-15T22:09:21.455334+0000","last_active":"2024-09-15T22:09:22.434291+0000","last_peered":"2024-09-15T22:09:22.434291+0000","last_clean":"2024-09-15T22:09:22.434291+0000","last_became_active":"2024-09-15T22:09:21.454907+0000","last_became_peered":"2024-09-15T22:09:21.454907+0000","last_unstale":"2024-09-15T22:09:22.434291+0000","last_undegraded":"2024-09-15T22:09:22.434291+0000","last_fullsized":"2024-09-15T22:09:22.434291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:26.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856952+0000","last_change":"2024-09-15T22:09:17.415215+0000","last_active":"2024-09-15T22:09:22.856952+0000","last_peered":"2024-09-15T22:09:22.856952+0000","last_clean":"2024-09-15T22:09:22.856952+0000","last_became_active":"2024-09-15T22:09:17.414951+0000","last_became_peered":"2024-09-15T22:09:17.414951+0000","last_unstale":"2024-09-15T22:09:22.856952+0000","last_undegraded":"2024-09-15T22:09:22.856952+0000","last_fullsized":"2024-09-15T22:09:22.856952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447106+0000","last_change":"2024-09-15T22:09:16.405521+0000","last_active":"2024-09-15T22:09:22.447106+0000","last_peered":"2024-09-15T22:09:22.447106+0000","last_clean":"2024-09-15T22:09:22.447106+0000","last_became_active":"2024-09-15T22:09:16.405230+0000","last_became_peered":"2024-09-15T22:09:16.405230+0000","last_unstale":"2024-09-15T22:09:22.447106+0000","last_undegraded":"2024-09-15T22:09:22.447106+0000","last_fullsized":"2024-09-15T22:09:22.447106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:03.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432020+0000","last_change":"2024-09-15T22:09:21.450431+0000","last_active":"2024-09-15T22:09:22.432020+0000","last_peered":"2024-09-15T22:09:22.432020+0000","last_clean":"2024-09-15T22:09:22.432020+0000","last_became_active":"2024-09-15T22:09:21.449896+0000","last_became_peered":"2024-09-15T22:09:21.449896+0000","last_unstale":"2024-09-15T22:09:22.432020+0000","last_undegraded":"2024-09-15T22:09:22.432020+0000","last_fullsized":"2024-09-15T22:09:22.432020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:18.430595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447073+0000","last_change":"2024-09-15T22:09:17.422669+0000","last_active":"2024-09-15T22:09:22.447073+0000","last_peered":"2024-09-15T22:09:22.447073+0000","last_clean":"2024-09-15T22:09:22.447073+0000","last_became_active":"2024-09-15T22:09:17.422401+0000","last_became_peered":"2024-09-15T22:09:17.422401+0000","last_unstale":"2024-09-15T22:09:22.447073+0000","last_undegraded":"2024-09-15T22:09:22.447073+0000","last_fullsized":"2024-09-15T22:09:22.447073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857139+0000","last_change":"2024-09-15T22:09:16.405552+0000","last_active":"2024-09-15T22:09:22.857139+0000","last_peered":"2024-09-15T22:09:22.857139+0000","last_clean":"2024-09-15T22:09:22.857139+0000","last_became_active":"2024-09-15T22:09:16.405208+0000","last_became_peered":"2024-09-15T22:09:16.405208+0000","last_unstale":"2024-09-15T22:09:22.857139+0000","last_undegraded":"2024-09-15T22:09:22.857139+0000","last_fullsized":"2024-09-15T22:09:22.857139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432030+0000","last_change":"2024-09-15T22:09:21.448849+0000","last_active":"2024-09-15T22:09:22.432030+0000","last_peered":"2024-09-15T22:09:22.432030+0000","last_clean":"2024-09-15T22:09:22.432030+0000","last_became_active":"2024-09-15T22:09:21.448356+0000","last_became_peered":"2024-09-15T22:09:21.448356+0000","last_unstale":"2024-09-15T22:09:22.432030+0000","last_undegraded":"2024-09-15T22:09:22.432030+0000","last_fullsized":"2024-09-15T22:09:22.432030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:08.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857853+0000","last_change":"2024-09-15T22:09:21.458815+0000","last_active":"2024-09-15T22:09:22.857853+0000","last_peered":"2024-09-15T22:09:22.857853+0000","last_clean":"2024-09-15T22:09:22.857853+0000","last_became_active":"2024-09-15T22:09:21.458418+0000","last_became_peered":"2024-09-15T22:09:21.458418+0000","last_unstale":"2024-09-15T22:09:22.857853+0000","last_undegraded":"2024-09-15T22:09:22.857853+0000","last_fullsized":"2024-09-15T22:09:22.857853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:26.187414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857180+0000","last_change":"2024-09-15T22:09:17.401001+0000","last_active":"2024-09-15T22:09:22.857180+0000","last_peered":"2024-09-15T22:09:22.857180+0000","last_clean":"2024-09-15T22:09:22.857180+0000","last_became_active":"2024-09-15T22:09:17.400754+0000","last_became_peered":"2024-09-15T22:09:17.400754+0000","last_unstale":"2024-09-15T22:09:22.857180+0000","last_undegraded":"2024-09-15T22:09:22.857180+0000","last_fullsized":"2024-09-15T22:09:22.857180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:33.878828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446850+0000","last_change":"2024-09-15T22:09:16.404987+0000","last_active":"2024-09-15T22:09:22.446850+0000","last_peered":"2024-09-15T22:09:22.446850+0000","last_clean":"2024-09-15T22:09:22.446850+0000","last_became_active":"2024-09-15T22:09:16.404694+0000","last_became_peered":"2024-09-15T22:09:16.404694+0000","last_unstale":"2024-09-15T22:09:22.446850+0000","last_undegraded":"2024-09-15T22:09:22.446850+0000","last_fullsized":"2024-09-15T22:09:22.446850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857090+0000","last_change":"2024-09-15T22:09:21.457334+0000","last_active":"2024-09-15T22:09:22.857090+0000","last_peered":"2024-09-15T22:09:22.857090+0000","last_clean":"2024-09-15T22:09:22.857090+0000","last_became_active":"2024-09-15T22:09:21.456871+0000","last_became_peered":"2024-09-15T22:09:21.456871+0000","last_unstale":"2024-09-15T22:09:22.857090+0000","last_undegraded":"2024-09-15T22:09:22.857090+0000","last_fullsized":"2024-09-15T22:09:22.857090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:08.904123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432074+0000","last_change":"2024-09-15T22:09:17.402872+0000","last_active":"2024-09-15T22:09:22.432074+0000","last_peered":"2024-09-15T22:09:22.432074+0000","last_clean":"2024-09-15T22:09:22.432074+0000","last_became_active":"2024-09-15T22:09:17.402625+0000","last_became_peered":"2024-09-15T22:09:17.402625+0000","last_unstale":"2024-09-15T22:09:22.432074+0000","last_undegraded":"2024-09-15T22:09:22.432074+0000","last_fullsized":"2024-09-15T22:09:22.432074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432270+0000","last_change":"2024-09-15T22:09:16.405821+0000","last_active":"2024-09-15T22:09:22.432270+0000","last_peered":"2024-09-15T22:09:22.432270+0000","last_clean":"2024-09-15T22:09:22.432270+0000","last_became_active":"2024-09-15T22:09:16.405561+0000","last_became_peered":"2024-09-15T22:09:16.405561+0000","last_unstale":"2024-09-15T22:09:22.432270+0000","last_undegraded":"2024-09-15T22:09:22.432270+0000","last_fullsized":"2024-09-15T22:09:22.432270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856909+0000","last_change":"2024-09-15T22:09:16.403455+0000","last_active":"2024-09-15T22:09:22.856909+0000","last_peered":"2024-09-15T22:09:22.856909+0000","last_clean":"2024-09-15T22:09:22.856909+0000","last_became_active":"2024-09-15T22:09:16.403172+0000","last_became_peered":"2024-09-15T22:09:16.403172+0000","last_unstale":"2024-09-15T22:09:22.856909+0000","last_undegraded":"2024-09-15T22:09:22.856909+0000","last_fullsized":"2024-09-15T22:09:22.856909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:03.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857480+0000","last_change":"2024-09-15T22:09:17.416335+0000","last_active":"2024-09-15T22:09:22.857480+0000","last_peered":"2024-09-15T22:09:22.857480+0000","last_clean":"2024-09-15T22:09:22.857480+0000","last_became_active":"2024-09-15T22:09:17.416102+0000","last_became_peered":"2024-09-15T22:09:17.416102+0000","last_unstale":"2024-09-15T22:09:22.857480+0000","last_undegraded":"2024-09-15T22:09:22.857480+0000","last_fullsized":"2024-09-15T22:09:22.857480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856673+0000","last_change":"2024-09-15T22:09:21.448449+0000","last_active":"2024-09-15T22:09:22.856673+0000","last_peered":"2024-09-15T22:09:22.856673+0000","last_clean":"2024-09-15T22:09:22.856673+0000","last_became_active":"2024-09-15T22:09:21.448020+0000","last_became_peered":"2024-09-15T22:09:21.448020+0000","last_unstale":"2024-09-15T22:09:22.856673+0000","last_undegraded":"2024-09-15T22:09:22.856673+0000","last_fullsized":"2024-09-15T22:09:22.856673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:05.244676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432514+0000","last_change":"2024-09-15T22:09:16.401331+0000","last_active":"2024-09-15T22:09:22.432514+0000","last_peered":"2024-09-15T22:09:22.432514+0000","last_clean":"2024-09-15T22:09:22.432514+0000","last_became_active":"2024-09-15T22:09:16.401040+0000","last_became_peered":"2024-09-15T22:09:16.401040+0000","last_unstale":"2024-09-15T22:09:22.432514+0000","last_undegraded":"2024-09-15T22:09:22.432514+0000","last_fullsized":"2024-09-15T22:09:22.432514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.799831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433188+0000","last_change":"2024-09-15T22:09:17.405328+0000","last_active":"2024-09-15T22:09:22.433188+0000","last_peered":"2024-09-15T22:09:22.433188+0000","last_clean":"2024-09-15T22:09:22.433188+0000","last_became_active":"2024-09-15T22:09:17.404772+0000","last_became_peered":"2024-09-15T22:09:17.404772+0000","last_unstale":"2024-09-15T22:09:22.433188+0000","last_undegraded":"2024-09-15T22:09:22.433188+0000","last_fullsized":"2024-09-15T22:09:22.433188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:33.377260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432644+0000","last_change":"2024-09-15T22:09:21.458359+0000","last_active":"2024-09-15T22:09:22.432644+0000","last_peered":"2024-09-15T22:09:22.432644+0000","last_clean":"2024-09-15T22:09:22.432644+0000","last_became_active":"2024-09-15T22:09:21.457977+0000","last_became_peered":"2024-09-15T22:09:21.457977+0000","last_unstale":"2024-09-15T22:09:22.432644+0000","last_undegraded":"2024-09-15T22:09:22.432644+0000","last_fullsized":"2024-09-15T22:09:22.432644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.055754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856459+0000","last_change":"2024-09-15T22:09:17.405556+0000","last_active":"2024-09-15T22:09:22.856459+0000","last_peered":"2024-09-15T22:09:22.856459+0000","last_clean":"2024-09-15T22:09:22.856459+0000","last_became_active":"2024-09-15T22:09:17.405129+0000","last_became_peered":"2024-09-15T22:09:17.405129+0000","last_unstale":"2024-09-15T22:09:22.856459+0000","last_undegraded":"2024-09-15T22:09:22.856459+0000","last_fullsized":"2024-09-15T22:09:22.856459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856332+0000","last_change":"2024-09-15T22:09:17.408189+0000","last_active":"2024-09-15T22:09:22.856332+0000","last_peered":"2024-09-15T22:09:22.856332+0000","last_clean":"2024-09-15T22:09:22.856332+0000","last_became_active":"2024-09-15T22:09:17.407877+0000","last_became_peered":"2024-09-15T22:09:17.407877+0000","last_unstale":"2024-09-15T22:09:22.856332+0000","last_undegraded":"2024-09-15T22:09:22.856332+0000","last_fullsized":"2024-09-15T22:09:22.856332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:02.290840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446878+0000","last_change":"2024-09-15T22:09:17.415666+0000","last_active":"2024-09-15T22:09:22.446878+0000","last_peered":"2024-09-15T22:09:22.446878+0000","last_clean":"2024-09-15T22:09:22.446878+0000","last_became_active":"2024-09-15T22:09:17.415399+0000","last_became_peered":"2024-09-15T22:09:17.415399+0000","last_unstale":"2024-09-15T22:09:22.446878+0000","last_undegraded":"2024-09-15T22:09:22.446878+0000","last_fullsized":"2024-09-15T22:09:22.446878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857393+0000","last_change":"2024-09-15T22:09:17.406140+0000","last_active":"2024-09-15T22:09:22.857393+0000","last_peered":"2024-09-15T22:09:22.857393+0000","last_clean":"2024-09-15T22:09:22.857393+0000","last_became_active":"2024-09-15T22:09:17.405142+0000","last_became_peered":"2024-09-15T22:09:17.405142+0000","last_unstale":"2024-09-15T22:09:22.857393+0000","last_undegraded":"2024-09-15T22:09:22.857393+0000","last_fullsized":"2024-09-15T22:09:22.857393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:17.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432765+0000","last_change":"2024-09-15T22:09:17.411027+0000","last_active":"2024-09-15T22:09:22.432765+0000","last_peered":"2024-09-15T22:09:22.432765+0000","last_clean":"2024-09-15T22:09:22.432765+0000","last_became_active":"2024-09-15T22:09:17.408913+0000","last_became_peered":"2024-09-15T22:09:17.408913+0000","last_unstale":"2024-09-15T22:09:22.432765+0000","last_undegraded":"2024-09-15T22:09:22.432765+0000","last_fullsized":"2024-09-15T22:09:22.432765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:34.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856265+0000","last_change":"2024-09-15T22:09:17.401385+0000","last_active":"2024-09-15T22:09:22.856265+0000","last_peered":"2024-09-15T22:09:22.856265+0000","last_clean":"2024-09-15T22:09:22.856265+0000","last_became_active":"2024-09-15T22:09:17.400916+0000","last_became_peered":"2024-09-15T22:09:17.400916+0000","last_unstale":"2024-09-15T22:09:22.856265+0000","last_undegraded":"2024-09-15T22:09:22.856265+0000","last_fullsized":"2024-09-15T22:09:22.856265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:31.994148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857149+0000","last_change":"2024-09-15T22:09:17.405622+0000","last_active":"2024-09-15T22:09:22.857149+0000","last_peered":"2024-09-15T22:09:22.857149+0000","last_clean":"2024-09-15T22:09:22.857149+0000","last_became_active":"2024-09-15T22:09:17.405319+0000","last_became_peered":"2024-09-15T22:09:17.405319+0000","last_unstale":"2024-09-15T22:09:22.857149+0000","last_undegraded":"2024-09-15T22:09:22.857149+0000","last_fullsized":"2024-09-15T22:09:22.857149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432397+0000","last_change":"2024-09-15T22:09:17.409317+0000","last_active":"2024-09-15T22:09:22.432397+0000","last_peered":"2024-09-15T22:09:22.432397+0000","last_clean":"2024-09-15T22:09:22.432397+0000","last_became_active":"2024-09-15T22:09:17.408949+0000","last_became_peered":"2024-09-15T22:09:17.408949+0000","last_unstale":"2024-09-15T22:09:22.432397+0000","last_undegraded":"2024-09-15T22:09:22.432397+0000","last_fullsized":"2024-09-15T22:09:22.432397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446723+0000","last_change":"2024-09-15T22:09:17.416439+0000","last_active":"2024-09-15T22:09:22.446723+0000","last_peered":"2024-09-15T22:09:22.446723+0000","last_clean":"2024-09-15T22:09:22.446723+0000","last_became_active":"2024-09-15T22:09:17.416170+0000","last_became_peered":"2024-09-15T22:09:17.416170+0000","last_unstale":"2024-09-15T22:09:22.446723+0000","last_undegraded":"2024-09-15T22:09:22.446723+0000","last_fullsized":"2024-09-15T22:09:22.446723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432211+0000","last_change":"2024-09-15T22:09:17.409471+0000","last_active":"2024-09-15T22:09:22.432211+0000","last_peered":"2024-09-15T22:09:22.432211+0000","last_clean":"2024-09-15T22:09:22.432211+0000","last_became_active":"2024-09-15T22:09:17.408969+0000","last_became_peered":"2024-09-15T22:09:17.408969+0000","last_unstale":"2024-09-15T22:09:22.432211+0000","last_undegraded":"2024-09-15T22:09:22.432211+0000","last_fullsized":"2024-09-15T22:09:22.432211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446844+0000","last_change":"2024-09-15T22:09:17.422118+0000","last_active":"2024-09-15T22:09:22.446844+0000","last_peered":"2024-09-15T22:09:22.446844+0000","last_clean":"2024-09-15T22:09:22.446844+0000","last_became_active":"2024-09-15T22:09:17.421846+0000","last_became_peered":"2024-09-15T22:09:17.421846+0000","last_unstale":"2024-09-15T22:09:22.446844+0000","last_undegraded":"2024-09-15T22:09:22.446844+0000","last_fullsized":"2024-09-15T22:09:22.446844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:34.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857299+0000","last_change":"2024-09-15T22:09:17.421168+0000","last_active":"2024-09-15T22:09:22.857299+0000","last_peered":"2024-09-15T22:09:22.857299+0000","last_clean":"2024-09-15T22:09:22.857299+0000","last_became_active":"2024-09-15T22:09:17.420849+0000","last_became_peered":"2024-09-15T22:09:17.420849+0000","last_unstale":"2024-09-15T22:09:22.857299+0000","last_undegraded":"2024-09-15T22:09:22.857299+0000","last_fullsized":"2024-09-15T22:09:22.857299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:25.108343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856803+0000","last_change":"2024-09-15T22:09:17.410112+0000","last_active":"2024-09-15T22:09:22.856803+0000","last_peered":"2024-09-15T22:09:22.856803+0000","last_clean":"2024-09-15T22:09:22.856803+0000","last_became_active":"2024-09-15T22:09:17.409837+0000","last_became_peered":"2024-09-15T22:09:17.409837+0000","last_unstale":"2024-09-15T22:09:22.856803+0000","last_undegraded":"2024-09-15T22:09:22.856803+0000","last_fullsized":"2024-09-15T22:09:22.856803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433979+0000","last_change":"2024-09-15T22:09:17.400115+0000","last_active":"2024-09-15T22:09:22.433979+0000","last_peered":"2024-09-15T22:09:22.433979+0000","last_clean":"2024-09-15T22:09:22.433979+0000","last_became_active":"2024-09-15T22:09:17.399835+0000","last_became_peered":"2024-09-15T22:09:17.399835+0000","last_unstale":"2024-09-15T22:09:22.433979+0000","last_undegraded":"2024-09-15T22:09:22.433979+0000","last_fullsized":"2024-09-15T22:09:22.433979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:13.972528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856270+0000","last_change":"2024-09-15T22:09:17.401680+0000","last_active":"2024-09-15T22:09:22.856270+0000","last_peered":"2024-09-15T22:09:22.856270+0000","last_clean":"2024-09-15T22:09:22.856270+0000","last_became_active":"2024-09-15T22:09:17.401413+0000","last_became_peered":"2024-09-15T22:09:17.401413+0000","last_unstale":"2024-09-15T22:09:22.856270+0000","last_undegraded":"2024-09-15T22:09:22.856270+0000","last_fullsized":"2024-09-15T22:09:22.856270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:04.007901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447310+0000","last_change":"2024-09-15T22:09:17.421910+0000","last_active":"2024-09-15T22:09:22.447310+0000","last_peered":"2024-09-15T22:09:22.447310+0000","last_clean":"2024-09-15T22:09:22.447310+0000","last_became_active":"2024-09-15T22:09:17.421469+0000","last_became_peered":"2024-09-15T22:09:17.421469+0000","last_unstale":"2024-09-15T22:09:22.447310+0000","last_undegraded":"2024-09-15T22:09:22.447310+0000","last_fullsized":"2024-09-15T22:09:22.447310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:15.123863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446601+0000","last_change":"2024-09-15T22:09:17.411524+0000","last_active":"2024-09-15T22:09:22.446601+0000","last_peered":"2024-09-15T22:09:22.446601+0000","last_clean":"2024-09-15T22:09:22.446601+0000","last_became_active":"2024-09-15T22:09:17.411244+0000","last_became_peered":"2024-09-15T22:09:17.411244+0000","last_unstale":"2024-09-15T22:09:22.446601+0000","last_undegraded":"2024-09-15T22:09:22.446601+0000","last_fullsized":"2024-09-15T22:09:22.446601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857274+0000","last_change":"2024-09-15T22:09:17.409933+0000","last_active":"2024-09-15T22:09:22.857274+0000","last_peered":"2024-09-15T22:09:22.857274+0000","last_clean":"2024-09-15T22:09:22.857274+0000","last_became_active":"2024-09-15T22:09:17.409681+0000","last_became_peered":"2024-09-15T22:09:17.409681+0000","last_unstale":"2024-09-15T22:09:22.857274+0000","last_undegraded":"2024-09-15T22:09:22.857274+0000","last_fullsized":"2024-09-15T22:09:22.857274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:37.130999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857870+0000","last_change":"2024-09-15T22:09:17.403522+0000","last_active":"2024-09-15T22:09:22.857870+0000","last_peered":"2024-09-15T22:09:22.857870+0000","last_clean":"2024-09-15T22:09:22.857870+0000","last_became_active":"2024-09-15T22:09:17.403220+0000","last_became_peered":"2024-09-15T22:09:17.403220+0000","last_unstale":"2024-09-15T22:09:22.857870+0000","last_undegraded":"2024-09-15T22:09:22.857870+0000","last_fullsized":"2024-09-15T22:09:22.857870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:01.208798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432332+0000","last_change":"2024-09-15T22:09:17.400537+0000","last_active":"2024-09-15T22:09:22.432332+0000","last_peered":"2024-09-15T22:09:22.432332+0000","last_clean":"2024-09-15T22:09:22.432332+0000","last_became_active":"2024-09-15T22:09:17.400288+0000","last_became_peered":"2024-09-15T22:09:17.400288+0000","last_unstale":"2024-09-15T22:09:22.432332+0000","last_undegraded":"2024-09-15T22:09:22.432332+0000","last_fullsized":"2024-09-15T22:09:22.432332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433969+0000","last_change":"2024-09-15T22:09:17.404318+0000","last_active":"2024-09-15T22:09:22.433969+0000","last_peered":"2024-09-15T22:09:22.433969+0000","last_clean":"2024-09-15T22:09:22.433969+0000","last_became_active":"2024-09-15T22:09:17.404038+0000","last_became_peered":"2024-09-15T22:09:17.404038+0000","last_unstale":"2024-09-15T22:09:22.433969+0000","last_undegraded":"2024-09-15T22:09:22.433969+0000","last_fullsized":"2024-09-15T22:09:22.433969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:04.314746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856907+0000","last_change":"2024-09-15T22:09:17.415645+0000","last_active":"2024-09-15T22:09:22.856907+0000","last_peered":"2024-09-15T22:09:22.856907+0000","last_clean":"2024-09-15T22:09:22.856907+0000","last_became_active":"2024-09-15T22:09:17.415354+0000","last_became_peered":"2024-09-15T22:09:17.415354+0000","last_unstale":"2024-09-15T22:09:22.856907+0000","last_undegraded":"2024-09-15T22:09:22.856907+0000","last_fullsized":"2024-09-15T22:09:22.856907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857144+0000","last_change":"2024-09-15T22:09:17.415171+0000","last_active":"2024-09-15T22:09:22.857144+0000","last_peered":"2024-09-15T22:09:22.857144+0000","last_clean":"2024-09-15T22:09:22.857144+0000","last_became_active":"2024-09-15T22:09:17.414875+0000","last_became_peered":"2024-09-15T22:09:17.414875+0000","last_unstale":"2024-09-15T22:09:22.857144+0000","last_undegraded":"2024-09-15T22:09:22.857144+0000","last_fullsized":"2024-09-15T22:09:22.857144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434378+0000","last_change":"2024-09-15T22:09:17.420121+0000","last_active":"2024-09-15T22:09:22.434378+0000","last_peered":"2024-09-15T22:09:22.434378+0000","last_clean":"2024-09-15T22:09:22.434378+0000","last_became_active":"2024-09-15T22:09:17.419854+0000","last_became_peered":"2024-09-15T22:09:17.419854+0000","last_unstale":"2024-09-15T22:09:22.434378+0000","last_undegraded":"2024-09-15T22:09:22.434378+0000","last_fullsized":"2024-09-15T22:09:22.434378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:41.421190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.431873+0000","last_change":"2024-09-15T22:09:17.414316+0000","last_active":"2024-09-15T22:09:22.431873+0000","last_peered":"2024-09-15T22:09:22.431873+0000","last_clean":"2024-09-15T22:09:22.431873+0000","last_became_active":"2024-09-15T22:09:17.414020+0000","last_became_peered":"2024-09-15T22:09:17.414020+0000","last_unstale":"2024-09-15T22:09:22.431873+0000","last_undegraded":"2024-09-15T22:09:22.431873+0000","last_fullsized":"2024-09-15T22:09:22.431873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432910+0000","last_change":"2024-09-15T22:09:17.404509+0000","last_active":"2024-09-15T22:09:22.432910+0000","last_peered":"2024-09-15T22:09:22.432910+0000","last_clean":"2024-09-15T22:09:22.432910+0000","last_became_active":"2024-09-15T22:09:17.404181+0000","last_became_peered":"2024-09-15T22:09:17.404181+0000","last_unstale":"2024-09-15T22:09:22.432910+0000","last_undegraded":"2024-09-15T22:09:22.432910+0000","last_fullsized":"2024-09-15T22:09:22.432910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:22.003479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446713+0000","last_change":"2024-09-15T22:09:17.414252+0000","last_active":"2024-09-15T22:09:22.446713+0000","last_peered":"2024-09-15T22:09:22.446713+0000","last_clean":"2024-09-15T22:09:22.446713+0000","last_became_active":"2024-09-15T22:09:17.413987+0000","last_became_peered":"2024-09-15T22:09:17.413987+0000","last_unstale":"2024-09-15T22:09:22.446713+0000","last_undegraded":"2024-09-15T22:09:22.446713+0000","last_fullsized":"2024-09-15T22:09:22.446713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433226+0000","last_change":"2024-09-15T22:09:17.399744+0000","last_active":"2024-09-15T22:09:22.433226+0000","last_peered":"2024-09-15T22:09:22.433226+0000","last_clean":"2024-09-15T22:09:22.433226+0000","last_became_active":"2024-09-15T22:09:17.399470+0000","last_became_peered":"2024-09-15T22:09:17.399470+0000","last_unstale":"2024-09-15T22:09:22.433226+0000","last_undegraded":"2024-09-15T22:09:22.433226+0000","last_fullsized":"2024-09-15T22:09:22.433226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:04.868244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446913+0000","last_change":"2024-09-15T22:09:17.416763+0000","last_active":"2024-09-15T22:09:22.446913+0000","last_peered":"2024-09-15T22:09:22.446913+0000","last_clean":"2024-09-15T22:09:22.446913+0000","last_became_active":"2024-09-15T22:09:17.415987+0000","last_became_peered":"2024-09-15T22:09:17.415987+0000","last_unstale":"2024-09-15T22:09:22.446913+0000","last_undegraded":"2024-09-15T22:09:22.446913+0000","last_fullsized":"2024-09-15T22:09:22.446913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:04.868244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856619+0000","last_change":"2024-09-15T22:09:17.404558+0000","last_active":"2024-09-15T22:09:22.856619+0000","last_peered":"2024-09-15T22:09:22.856619+0000","last_clean":"2024-09-15T22:09:22.856619+0000","last_became_active":"2024-09-15T22:09:17.404301+0000","last_became_peered":"2024-09-15T22:09:17.404301+0000","last_unstale":"2024-09-15T22:09:22.856619+0000","last_undegraded":"2024-09-15T22:09:22.856619+0000","last_fullsized":"2024-09-15T22:09:22.856619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856943+0000","last_change":"2024-09-15T22:09:17.402881+0000","last_active":"2024-09-15T22:09:22.856943+0000","last_peered":"2024-09-15T22:09:22.856943+0000","last_clean":"2024-09-15T22:09:22.856943+0000","last_became_active":"2024-09-15T22:09:17.402632+0000","last_became_peered":"2024-09-15T22:09:17.402632+0000","last_unstale":"2024-09-15T22:09:22.856943+0000","last_undegraded":"2024-09-15T22:09:22.856943+0000","last_fullsized":"2024-09-15T22:09:22.856943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:30.142651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434291+0000","last_change":"2024-09-15T22:09:17.403017+0000","last_active":"2024-09-15T22:09:22.434291+0000","last_peered":"2024-09-15T22:09:22.434291+0000","last_clean":"2024-09-15T22:09:22.434291+0000","last_became_active":"2024-09-15T22:09:17.402751+0000","last_became_peered":"2024-09-15T22:09:17.402751+0000","last_unstale":"2024-09-15T22:09:22.434291+0000","last_undegraded":"2024-09-15T22:09:22.434291+0000","last_fullsized":"2024-09-15T22:09:22.434291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:26.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":331776,"data_stored":694125,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":103265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":103301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":339968,"data_stored":694181,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":103335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:09:36.734 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:09:36.734 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T22:09:36.735 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-15T22:09:36.735 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-15T22:09:36.735 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-15T22:09:36.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.863+0000 7f952a9be640 1 Processor -- start 2024-09-15T22:09:36.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.863+0000 7f952a9be640 1 -- start start 2024-09-15T22:09:36.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.864+0000 7f952a9be640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95241417f0 0x7f9524141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.864+0000 7f952a9be640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95241502e0 0x7f95241526d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.864+0000 7f952a9be640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95240b6c90 con 0x7f95240ba270 2024-09-15T22:09:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.864+0000 7f952a9be640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f95240b6f00 con 0x7f95241417f0 2024-09-15T22:09:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.864+0000 7f952a9be640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f95240b7a80 con 0x7f95241502e0 2024-09-15T22:09:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.864+0000 7f95237fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95241417f0 0x7f9524141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.864+0000 7f95237fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95241417f0 0x7f9524141c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49656/0 (socket says 172.21.15.78:49656) 2024-09-15T22:09:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.864+0000 7f95237fe640 1 -- 172.21.15.78:0/952199048 learned_addr learned my addr 172.21.15.78:0/952199048 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.864+0000 7f9528f5b640 1 --2- 172.21.15.78:0/952199048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95241502e0 0x7f95241526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.865+0000 7f95237fe640 1 -- 172.21.15.78:0/952199048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95241502e0 msgr2=0x7f95241526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.865+0000 7f95237fe640 1 --2- 172.21.15.78:0/952199048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95241502e0 0x7f95241526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.865+0000 7f95237fe640 1 -- 172.21.15.78:0/952199048 >> v1:172.21.15.175:6789/0 conn(0x7f95240ba270 legacy=0x7f95240b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.865+0000 7f95237fe640 1 -- 172.21.15.78:0/952199048 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95240ba650 con 0x7f95241417f0 2024-09-15T22:09:36.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.865+0000 7f95237fe640 1 --2- 172.21.15.78:0/952199048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95241417f0 0x7f9524141c30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9518009870 tx=0x7f951802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0477a11682aa0a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:36.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.865+0000 7f9522ffd640 1 -- 172.21.15.78:0/952199048 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518037070 con 0x7f95241417f0 2024-09-15T22:09:36.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.865+0000 7f9522ffd640 1 -- 172.21.15.78:0/952199048 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9518032440 con 0x7f95241417f0 2024-09-15T22:09:36.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.865+0000 7f9522ffd640 1 -- 172.21.15.78:0/952199048 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518032810 con 0x7f95241417f0 2024-09-15T22:09:36.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.866+0000 7f952a9be640 1 -- 172.21.15.78:0/952199048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95241417f0 msgr2=0x7f9524141c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.866+0000 7f952a9be640 1 --2- 172.21.15.78:0/952199048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95241417f0 0x7f9524141c30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9518009870 tx=0x7f951802a130 comp rx=0 tx=0).stop 2024-09-15T22:09:36.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.866+0000 7f952a9be640 1 -- 172.21.15.78:0/952199048 shutdown_connections 2024-09-15T22:09:36.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.866+0000 7f952a9be640 1 --2- 172.21.15.78:0/952199048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95241502e0 0x7f95241526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.866+0000 7f952a9be640 1 --2- 172.21.15.78:0/952199048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95241417f0 0x7f9524141c30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.866+0000 7f952a9be640 1 -- 172.21.15.78:0/952199048 >> 172.21.15.78:0/952199048 conn(0x7f9524074ba0 msgr2=0x7f9524074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.866+0000 7f952a9be640 1 -- 172.21.15.78:0/952199048 shutdown_connections 2024-09-15T22:09:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.866+0000 7f952a9be640 1 -- 172.21.15.78:0/952199048 wait complete. 2024-09-15T22:09:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.867+0000 7f952a9be640 1 Processor -- start 2024-09-15T22:09:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.867+0000 7f952a9be640 1 -- start start 2024-09-15T22:09:36.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f952a9be640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95240ba270 0x7f95241e0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f952a9be640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95241417f0 0x7f95240bd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f952a9be640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95241502e0 0x7f952414f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f952a9be640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f95240b77a0 con 0x7f95241417f0 2024-09-15T22:09:36.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f952a9be640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f95240b74c0 con 0x7f95240ba270 2024-09-15T22:09:36.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f952a9be640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f95240b4a70 con 0x7f95241502e0 2024-09-15T22:09:36.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f95237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95241417f0 0x7f95240bd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f95237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95241417f0 0x7f95240bd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49668/0 (socket says 172.21.15.78:49668) 2024-09-15T22:09:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f95237fe640 1 -- 172.21.15.78:0/1508045892 learned_addr learned my addr 172.21.15.78:0/1508045892 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f9523fff640 1 --2- 172.21.15.78:0/1508045892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95240ba270 0x7f95241e0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f9528f5b640 1 --2- 172.21.15.78:0/1508045892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95241502e0 0x7f952414f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f95237fe640 1 -- 172.21.15.78:0/1508045892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95241502e0 msgr2=0x7f952414f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f95237fe640 1 --2- 172.21.15.78:0/1508045892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95241502e0 0x7f952414f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f95237fe640 1 -- 172.21.15.78:0/1508045892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95240ba270 msgr2=0x7f95241e0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f95237fe640 1 --2- 172.21.15.78:0/1508045892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95240ba270 0x7f95241e0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f95237fe640 1 -- 172.21.15.78:0/1508045892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95240aa4e0 con 0x7f95241417f0 2024-09-15T22:09:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f95237fe640 1 --2- 172.21.15.78:0/1508045892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95241417f0 0x7f95240bd8d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9518000c00 tx=0x7f95180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f9520ff9640 1 -- 172.21.15.78:0/1508045892 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518041020 con 0x7f95241417f0 2024-09-15T22:09:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f9520ff9640 1 -- 172.21.15.78:0/1508045892 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9518030640 con 0x7f95241417f0 2024-09-15T22:09:36.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f952a9be640 1 -- 172.21.15.78:0/1508045892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95240aaa30 con 0x7f95241417f0 2024-09-15T22:09:36.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.868+0000 7f9520ff9640 1 -- 172.21.15.78:0/1508045892 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518037040 con 0x7f95241417f0 2024-09-15T22:09:36.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.869+0000 7f952a9be640 1 -- 172.21.15.78:0/1508045892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952414eea0 con 0x7f95241417f0 2024-09-15T22:09:36.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.869+0000 7f952a9be640 1 -- 172.21.15.78:0/1508045892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952414e1d0 con 0x7f95241417f0 2024-09-15T22:09:36.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.870+0000 7f9520ff9640 1 -- 172.21.15.78:0/1508045892 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9518044020 con 0x7f95241417f0 2024-09-15T22:09:36.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.870+0000 7f9520ff9640 1 --2- 172.21.15.78:0/1508045892 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f951006c2b0 0x7f951006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:36.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.870+0000 7f9520ff9640 1 -- 172.21.15.78:0/1508045892 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f95180abe00 con 0x7f95241417f0 2024-09-15T22:09:36.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.870+0000 7f9523fff640 1 --2- 172.21.15.78:0/1508045892 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f951006c2b0 0x7f951006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:36.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.871+0000 7f9523fff640 1 --2- 172.21.15.78:0/1508045892 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f951006c2b0 0x7f951006e770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f952414e8a0 tx=0x7f9514009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:36.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:36.875+0000 7f9520ff9640 1 -- 172.21.15.78:0/1508045892 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f951804b030 con 0x7f95241417f0 2024-09-15T22:09:37.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.087+0000 7f952a9be640 1 -- 172.21.15.78:0/1508045892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f952414ecc0 con 0x7f95241417f0 2024-09-15T22:09:37.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.090+0000 7f9520ff9640 1 -- 172.21.15.78:0/1508045892 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+173504 (secure 0 0 0) 0x7f952414ecc0 con 0x7f95241417f0 2024-09-15T22:09:37.094 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:37.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.092+0000 7f952a9be640 1 -- 172.21.15.78:0/1508045892 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f951006c2b0 msgr2=0x7f951006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.092+0000 7f952a9be640 1 --2- 172.21.15.78:0/1508045892 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f951006c2b0 0x7f951006e770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f952414e8a0 tx=0x7f9514009040 comp rx=0 tx=0).stop 2024-09-15T22:09:37.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.092+0000 7f952a9be640 1 -- 172.21.15.78:0/1508045892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95241417f0 msgr2=0x7f95240bd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.092+0000 7f952a9be640 1 --2- 172.21.15.78:0/1508045892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95241417f0 0x7f95240bd8d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9518000c00 tx=0x7f95180046c0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.092+0000 7f952a9be640 1 -- 172.21.15.78:0/1508045892 shutdown_connections 2024-09-15T22:09:37.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.092+0000 7f952a9be640 1 --2- 172.21.15.78:0/1508045892 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f951006c2b0 0x7f951006e770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.092+0000 7f952a9be640 1 --2- 172.21.15.78:0/1508045892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95241502e0 0x7f952414f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.092+0000 7f952a9be640 1 --2- 172.21.15.78:0/1508045892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95241417f0 0x7f95240bd8d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.092+0000 7f952a9be640 1 --2- 172.21.15.78:0/1508045892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95240ba270 0x7f95241e0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.093+0000 7f952a9be640 1 -- 172.21.15.78:0/1508045892 >> 172.21.15.78:0/1508045892 conn(0x7f9524074ba0 msgr2=0x7f9524148980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.093+0000 7f952a9be640 1 -- 172.21.15.78:0/1508045892 shutdown_connections 2024-09-15T22:09:37.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.093+0000 7f952a9be640 1 -- 172.21.15.78:0/1508045892 wait complete. 2024-09-15T22:09:37.105 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3668002812},{"type":"v1","addr":"172.21.15.78:6833","nonce":3668002812}]},"active_addr":"172.21.15.78:6833/3668002812","active_change":"2024-09-15T22:08:57.961090+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1901185674}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1994169472}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3331862065}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":702934140}]}]} 2024-09-15T22:09:37.109 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-15T22:09:37.110 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-15T22:09:37.110 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:09:37.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.207+0000 7f073598d640 1 Processor -- start 2024-09-15T22:09:37.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.207+0000 7f073598d640 1 -- start start 2024-09-15T22:09:37.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.208+0000 7f073598d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07300b5050 0x7f07300717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.208+0000 7f073598d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0730072660 0x7f0730146220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.208+0000 7f073598d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0730072df0 con 0x7f07300b5430 2024-09-15T22:09:37.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.208+0000 7f073598d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f07300b2820 con 0x7f0730072660 2024-09-15T22:09:37.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.208+0000 7f073598d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f07300b2b00 con 0x7f07300b5050 2024-09-15T22:09:37.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.208+0000 7f072e7fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f07300b5430 0x7f0730071f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56992/0 (socket says 172.21.15.78:56992) 2024-09-15T22:09:37.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.208+0000 7f072e7fc640 1 -- 172.21.15.78:0/1290687879 learned_addr learned my addr 172.21.15.78:0/1290687879 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:37.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.208+0000 7f072f7fe640 1 --2- 172.21.15.78:0/1290687879 >> v2:172.21.15.78:3300/0 conn(0x7f0730072660 0x7f0730146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.208+0000 7f072dffb640 1 -- 172.21.15.78:0/1290687879 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2634549176 0 0) 0x7f0718001110 con 0x7f07300b5430 2024-09-15T22:09:37.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.208+0000 7f072dffb640 1 -- 172.21.15.78:0/1290687879 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f071c003520 con 0x7f07300b5430 2024-09-15T22:09:37.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.208+0000 7f072effd640 1 --2- 172.21.15.78:0/1290687879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07300b5050 0x7f07300717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.209+0000 7f072f7fe640 1 -- 172.21.15.78:0/1290687879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07300b5050 msgr2=0x7f07300717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.209+0000 7f072f7fe640 1 --2- 172.21.15.78:0/1290687879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07300b5050 0x7f07300717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.209+0000 7f072f7fe640 1 -- 172.21.15.78:0/1290687879 >> v1:172.21.15.78:6789/0 conn(0x7f07300b5430 legacy=0x7f0730071f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.209+0000 7f072f7fe640 1 -- 172.21.15.78:0/1290687879 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0730073580 con 0x7f0730072660 2024-09-15T22:09:37.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.209+0000 7f072f7fe640 1 --2- 172.21.15.78:0/1290687879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0730072660 0x7f0730146220 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0728009d90 tx=0x7f072802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be661bde49c9ba4f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.210+0000 7f072dffb640 1 -- 172.21.15.78:0/1290687879 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728031600 con 0x7f0730072660 2024-09-15T22:09:37.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.210+0000 7f072dffb640 1 -- 172.21.15.78:0/1290687879 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07280317a0 con 0x7f0730072660 2024-09-15T22:09:37.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.210+0000 7f072dffb640 1 -- 172.21.15.78:0/1290687879 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728031b50 con 0x7f0730072660 2024-09-15T22:09:37.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.210+0000 7f073598d640 1 -- 172.21.15.78:0/1290687879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0730072660 msgr2=0x7f0730146220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.210+0000 7f073598d640 1 --2- 172.21.15.78:0/1290687879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0730072660 0x7f0730146220 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0728009d90 tx=0x7f072802a5d0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.210+0000 7f073598d640 1 -- 172.21.15.78:0/1290687879 shutdown_connections 2024-09-15T22:09:37.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.210+0000 7f073598d640 1 --2- 172.21.15.78:0/1290687879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0730072660 0x7f0730146220 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.210+0000 7f073598d640 1 --2- 172.21.15.78:0/1290687879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07300b5050 0x7f07300717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.210+0000 7f073598d640 1 -- 172.21.15.78:0/1290687879 >> 172.21.15.78:0/1290687879 conn(0x7f07300bb320 msgr2=0x7f07300bb730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.210+0000 7f073598d640 1 -- 172.21.15.78:0/1290687879 shutdown_connections 2024-09-15T22:09:37.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.210+0000 7f073598d640 1 -- 172.21.15.78:0/1290687879 wait complete. 2024-09-15T22:09:37.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.211+0000 7f073598d640 1 Processor -- start 2024-09-15T22:09:37.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.211+0000 7f073598d640 1 -- start start 2024-09-15T22:09:37.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f073598d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0730072660 0x7f0730147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f073598d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07300b5050 0x7f073006bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f073598d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07300b5430 0x7f073006c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f073598d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f07301456d0 con 0x7f07300b5430 2024-09-15T22:09:37.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f073598d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0730145d00 con 0x7f0730072660 2024-09-15T22:09:37.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f073598d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f073013f0c0 con 0x7f07300b5050 2024-09-15T22:09:37.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f072f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07300b5430 0x7f073006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f072f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07300b5430 0x7f073006c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49684/0 (socket says 172.21.15.78:49684) 2024-09-15T22:09:37.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f072f7fe640 1 -- 172.21.15.78:0/2477784711 learned_addr learned my addr 172.21.15.78:0/2477784711 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:37.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f072e7fc640 1 --2- 172.21.15.78:0/2477784711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07300b5050 0x7f073006bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f072effd640 1 --2- 172.21.15.78:0/2477784711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0730072660 0x7f0730147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f072f7fe640 1 -- 172.21.15.78:0/2477784711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07300b5050 msgr2=0x7f073006bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f072f7fe640 1 --2- 172.21.15.78:0/2477784711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07300b5050 0x7f073006bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f072f7fe640 1 -- 172.21.15.78:0/2477784711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0730072660 msgr2=0x7f0730147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f072f7fe640 1 --2- 172.21.15.78:0/2477784711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0730072660 0x7f0730147300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.212+0000 7f072f7fe640 1 -- 172.21.15.78:0/2477784711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07301423c0 con 0x7f07300b5430 2024-09-15T22:09:37.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.213+0000 7f072f7fe640 1 --2- 172.21.15.78:0/2477784711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07300b5430 0x7f073006c280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0728009eb0 tx=0x7f0728004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.213+0000 7f0727fff640 1 -- 172.21.15.78:0/2477784711 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728040070 con 0x7f07300b5430 2024-09-15T22:09:37.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.213+0000 7f0727fff640 1 -- 172.21.15.78:0/2477784711 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f072803c850 con 0x7f07300b5430 2024-09-15T22:09:37.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.213+0000 7f073598d640 1 -- 172.21.15.78:0/2477784711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0730147a10 con 0x7f07300b5430 2024-09-15T22:09:37.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.213+0000 7f0727fff640 1 -- 172.21.15.78:0/2477784711 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072803cc40 con 0x7f07300b5430 2024-09-15T22:09:37.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.213+0000 7f073598d640 1 -- 172.21.15.78:0/2477784711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f073006dba0 con 0x7f07300b5430 2024-09-15T22:09:37.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.214+0000 7f073598d640 1 -- 172.21.15.78:0/2477784711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07301445c0 con 0x7f07300b5430 2024-09-15T22:09:37.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.214+0000 7f0727fff640 1 -- 172.21.15.78:0/2477784711 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0728039040 con 0x7f07300b5430 2024-09-15T22:09:37.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.215+0000 7f0727fff640 1 --2- 172.21.15.78:0/2477784711 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f071006c2b0 0x7f071006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.215+0000 7f0727fff640 1 -- 172.21.15.78:0/2477784711 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f07280ac760 con 0x7f07300b5430 2024-09-15T22:09:37.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.215+0000 7f072effd640 1 --2- 172.21.15.78:0/2477784711 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f071006c2b0 0x7f071006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.215+0000 7f072effd640 1 --2- 172.21.15.78:0/2477784711 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f071006c2b0 0x7f071006e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0720009b40 tx=0x7f0720009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.219+0000 7f0727fff640 1 -- 172.21.15.78:0/2477784711 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f072807a5d0 con 0x7f07300b5430 2024-09-15T22:09:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.394+0000 7f073598d640 1 -- 172.21.15.78:0/2477784711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07301442e0 con 0x7f07300b5430 2024-09-15T22:09:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.395+0000 7f0727fff640 1 -- 172.21.15.78:0/2477784711 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7f072807e8d0 con 0x7f07300b5430 2024-09-15T22:09:37.397 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:37.397 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"34e44e87-1d1a-416f-b208-c16e07980ff5","created":"2024-09-15T22:08:53.842443+0000","modified":"2024-09-15T22:09:21.780555+0000","last_up_change":"2024-09-15T22:09:04.830042+0000","last_in_change":"2024-09-15T22:08:55.864039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:05.999373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:14.532061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:15.710676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:09:19.437681+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"71eb9af6-bf66-4450-a5d1-d4a81f71f95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6817","nonce":3548923409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6819","nonce":3548923409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6823","nonce":3548923409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6821","nonce":3548923409}]},"public_addr":"172.21.15.78:6817/3548923409","cluster_addr":"172.21.15.78:6819/3548923409","heartbeat_back_addr":"172.21.15.78:6823/3548923409","heartbeat_front_addr":"172.21.15.78:6821/3548923409","state":["exists","up"]},{"osd":1,"uuid":"f0070f6d-7998-4ad3-b597-e5777e61d503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6809","nonce":1233827941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6811","nonce":1233827941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6815","nonce":1233827941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6813","nonce":1233827941}]},"public_addr":"172.21.15.78:6809/1233827941","cluster_addr":"172.21.15.78:6811/1233827941","heartbeat_back_addr":"172.21.15.78:6815/1233827941","heartbeat_front_addr":"172.21.15.78:6813/1233827941","state":["exists","up"]},{"osd":2,"uuid":"6d9c91c7-2c8a-48f9-9bef-67ea7320980e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6825","nonce":636523247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6827","nonce":636523247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6831","nonce":636523247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6829","nonce":636523247}]},"public_addr":"172.21.15.78:6825/636523247","cluster_addr":"172.21.15.78:6827/636523247","heartbeat_back_addr":"172.21.15.78:6831/636523247","heartbeat_front_addr":"172.21.15.78:6829/636523247","state":["exists","up"]},{"osd":3,"uuid":"943e38fb-b450-48c0-8f01-d381b0b8e313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6801","nonce":1841812488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6803","nonce":1841812488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6807","nonce":1841812488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6805","nonce":1841812488}]},"public_addr":"172.21.15.78:6801/1841812488","cluster_addr":"172.21.15.78:6803/1841812488","heartbeat_back_addr":"172.21.15.78:6807/1841812488","heartbeat_front_addr":"172.21.15.78:6805/1841812488","state":["exists","up"]},{"osd":4,"uuid":"259f50f8-3223-450d-8cd1-d0d333c278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6817","nonce":1803357070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6819","nonce":1803357070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6823","nonce":1803357070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6821","nonce":1803357070}]},"public_addr":"172.21.15.175:6817/1803357070","cluster_addr":"172.21.15.175:6819/1803357070","heartbeat_back_addr":"172.21.15.175:6823/1803357070","heartbeat_front_addr":"172.21.15.175:6821/1803357070","state":["exists","up"]},{"osd":5,"uuid":"d70426cd-a39b-4a20-8c7b-bedc8352e303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6825","nonce":2221415707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6827","nonce":2221415707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6831","nonce":2221415707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6829","nonce":2221415707}]},"public_addr":"172.21.15.175:6825/2221415707","cluster_addr":"172.21.15.175:6827/2221415707","heartbeat_back_addr":"172.21.15.175:6831/2221415707","heartbeat_front_addr":"172.21.15.175:6829/2221415707","state":["exists","up"]},{"osd":6,"uuid":"95b9ed3a-cbfc-45a5-8967-88db9da099ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6801","nonce":1974018373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6803","nonce":1974018373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6807","nonce":1974018373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6805","nonce":1974018373}]},"public_addr":"172.21.15.175:6801/1974018373","cluster_addr":"172.21.15.175:6803/1974018373","heartbeat_back_addr":"172.21.15.175:6807/1974018373","heartbeat_front_addr":"172.21.15.175:6805/1974018373","state":["exists","up"]},{"osd":7,"uuid":"5fc56286-91e9-4a13-b161-ad7d30fc0119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6809","nonce":2386415083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6811","nonce":2386415083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6815","nonce":2386415083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6813","nonce":2386415083}]},"public_addr":"172.21.15.175:6809/2386415083","cluster_addr":"172.21.15.175:6811/2386415083","heartbeat_back_addr":"172.21.15.175:6815/2386415083","heartbeat_front_addr":"172.21.15.175:6813/2386415083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.191845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.871482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.594323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.463568+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.398880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.490112+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.119097+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.677350+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:09:37.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.397+0000 7f073598d640 1 -- 172.21.15.78:0/2477784711 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f071006c2b0 msgr2=0x7f071006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.397+0000 7f073598d640 1 --2- 172.21.15.78:0/2477784711 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f071006c2b0 0x7f071006e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0720009b40 tx=0x7f0720009190 comp rx=0 tx=0).stop 2024-09-15T22:09:37.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.397+0000 7f073598d640 1 -- 172.21.15.78:0/2477784711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07300b5430 msgr2=0x7f073006c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.397+0000 7f073598d640 1 --2- 172.21.15.78:0/2477784711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07300b5430 0x7f073006c280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0728009eb0 tx=0x7f0728004a40 comp rx=0 tx=0).stop 2024-09-15T22:09:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.397+0000 7f073598d640 1 -- 172.21.15.78:0/2477784711 shutdown_connections 2024-09-15T22:09:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.397+0000 7f073598d640 1 --2- 172.21.15.78:0/2477784711 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f071006c2b0 0x7f071006e770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.397+0000 7f073598d640 1 --2- 172.21.15.78:0/2477784711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07300b5430 0x7f073006c280 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.397+0000 7f073598d640 1 --2- 172.21.15.78:0/2477784711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07300b5050 0x7f073006bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.397+0000 7f073598d640 1 --2- 172.21.15.78:0/2477784711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0730072660 0x7f0730147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.397+0000 7f073598d640 1 -- 172.21.15.78:0/2477784711 >> 172.21.15.78:0/2477784711 conn(0x7f07300bb320 msgr2=0x7f07300b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.397+0000 7f073598d640 1 -- 172.21.15.78:0/2477784711 shutdown_connections 2024-09-15T22:09:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.397+0000 7f073598d640 1 -- 172.21.15.78:0/2477784711 wait complete. 2024-09-15T22:09:37.410 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-15T22:09:37.411 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:09:37.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.513+0000 7f3259d9f640 1 Processor -- start 2024-09-15T22:09:37.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.513+0000 7f3259d9f640 1 -- start start 2024-09-15T22:09:37.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.513+0000 7f3259d9f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f32540b2e90 0x7f3254148550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.513+0000 7f3259d9f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f325414d160 0x7f325414f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.513+0000 7f3259d9f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32540b5ae0 con 0x7f32540630c0 2024-09-15T22:09:37.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.513+0000 7f3259d9f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f325406fde0 con 0x7f32540b2e90 2024-09-15T22:09:37.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.513+0000 7f3259d9f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f32540634a0 con 0x7f325414d160 2024-09-15T22:09:37.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.514+0000 7f3252ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f32540b2e90 0x7f3254148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.514+0000 7f3252ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f32540b2e90 0x7f3254148550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49700/0 (socket says 172.21.15.78:49700) 2024-09-15T22:09:37.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.514+0000 7f3252ffd640 1 -- 172.21.15.78:0/3177742510 learned_addr learned my addr 172.21.15.78:0/3177742510 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:37.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.514+0000 7f3253fff640 1 --2- 172.21.15.78:0/3177742510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f325414d160 0x7f325414f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.514+0000 7f3252ffd640 1 -- 172.21.15.78:0/3177742510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f325414d160 msgr2=0x7f325414f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.514+0000 7f3252ffd640 1 --2- 172.21.15.78:0/3177742510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f325414d160 0x7f325414f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.514+0000 7f3252ffd640 1 -- 172.21.15.78:0/3177742510 >> v1:172.21.15.175:6789/0 conn(0x7f32540630c0 legacy=0x7f3254147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.514+0000 7f3252ffd640 1 -- 172.21.15.78:0/3177742510 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32540b2300 con 0x7f32540b2e90 2024-09-15T22:09:37.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.515+0000 7f3252ffd640 1 --2- 172.21.15.78:0/3177742510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32540b2e90 0x7f3254148550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3254063680 tx=0x7f324802a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e6a00af8908e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.515+0000 7f32527fc640 1 -- 172.21.15.78:0/3177742510 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248037070 con 0x7f32540b2e90 2024-09-15T22:09:37.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.515+0000 7f32527fc640 1 -- 172.21.15.78:0/3177742510 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324802ade0 con 0x7f32540b2e90 2024-09-15T22:09:37.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.515+0000 7f32527fc640 1 -- 172.21.15.78:0/3177742510 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248032660 con 0x7f32540b2e90 2024-09-15T22:09:37.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.515+0000 7f3259d9f640 1 -- 172.21.15.78:0/3177742510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32540b2e90 msgr2=0x7f3254148550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.515+0000 7f3259d9f640 1 --2- 172.21.15.78:0/3177742510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32540b2e90 0x7f3254148550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3254063680 tx=0x7f324802a0d0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.515+0000 7f3259d9f640 1 -- 172.21.15.78:0/3177742510 shutdown_connections 2024-09-15T22:09:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.515+0000 7f3259d9f640 1 --2- 172.21.15.78:0/3177742510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f325414d160 0x7f325414f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.515+0000 7f3259d9f640 1 --2- 172.21.15.78:0/3177742510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32540b2e90 0x7f3254148550 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.515+0000 7f3259d9f640 1 -- 172.21.15.78:0/3177742510 >> 172.21.15.78:0/3177742510 conn(0x7f325406bc10 msgr2=0x7f325406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.515+0000 7f3259d9f640 1 -- 172.21.15.78:0/3177742510 shutdown_connections 2024-09-15T22:09:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.515+0000 7f3259d9f640 1 -- 172.21.15.78:0/3177742510 wait complete. 2024-09-15T22:09:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.516+0000 7f3259d9f640 1 Processor -- start 2024-09-15T22:09:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.517+0000 7f3259d9f640 1 -- start start 2024-09-15T22:09:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.517+0000 7f3259d9f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32540630c0 0x7f32540afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.517+0000 7f3259d9f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32540b2e90 0x7f32541e1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.517+0000 7f3259d9f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f325414d160 0x7f325413fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.517+0000 7f3259d9f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32540b2750 con 0x7f32540b2e90 2024-09-15T22:09:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.517+0000 7f3259d9f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f32540b3f20 con 0x7f325414d160 2024-09-15T22:09:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.517+0000 7f3259d9f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f32540b0bc0 con 0x7f32540630c0 2024-09-15T22:09:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.517+0000 7f3252ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32540b2e90 0x7f32541e1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.517+0000 7f3252ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32540b2e90 0x7f32541e1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49714/0 (socket says 172.21.15.78:49714) 2024-09-15T22:09:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.517+0000 7f3252ffd640 1 -- 172.21.15.78:0/1139329981 learned_addr learned my addr 172.21.15.78:0/1139329981 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.517+0000 7f3253fff640 1 --2- 172.21.15.78:0/1139329981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f325414d160 0x7f325413fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.518+0000 7f32537fe640 1 --2- 172.21.15.78:0/1139329981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32540630c0 0x7f32540afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.518+0000 7f3252ffd640 1 -- 172.21.15.78:0/1139329981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32540630c0 msgr2=0x7f32540afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.518+0000 7f3252ffd640 1 --2- 172.21.15.78:0/1139329981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32540630c0 0x7f32540afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.518+0000 7f3252ffd640 1 -- 172.21.15.78:0/1139329981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f325414d160 msgr2=0x7f325413fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.518+0000 7f3252ffd640 1 --2- 172.21.15.78:0/1139329981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f325414d160 0x7f325413fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.518+0000 7f3252ffd640 1 -- 172.21.15.78:0/1139329981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3254148fd0 con 0x7f32540b2e90 2024-09-15T22:09:37.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.518+0000 7f3252ffd640 1 --2- 172.21.15.78:0/1139329981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32540b2e90 0x7f32541e1100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3248000c00 tx=0x7f3248004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.518+0000 7f323bfff640 1 -- 172.21.15.78:0/1139329981 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248037040 con 0x7f32540b2e90 2024-09-15T22:09:37.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.518+0000 7f323bfff640 1 -- 172.21.15.78:0/1139329981 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3248042070 con 0x7f32540b2e90 2024-09-15T22:09:37.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.518+0000 7f3259d9f640 1 -- 172.21.15.78:0/1139329981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3254072960 con 0x7f32540b2e90 2024-09-15T22:09:37.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.518+0000 7f323bfff640 1 -- 172.21.15.78:0/1139329981 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324803b890 con 0x7f32540b2e90 2024-09-15T22:09:37.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.518+0000 7f3259d9f640 1 -- 172.21.15.78:0/1139329981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32540b0570 con 0x7f32540b2e90 2024-09-15T22:09:37.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.519+0000 7f3259d9f640 1 -- 172.21.15.78:0/1139329981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3254147e40 con 0x7f32540b2e90 2024-09-15T22:09:37.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.520+0000 7f323bfff640 1 -- 172.21.15.78:0/1139329981 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f324803ba30 con 0x7f32540b2e90 2024-09-15T22:09:37.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.520+0000 7f323bfff640 1 --2- 172.21.15.78:0/1139329981 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f324006c2b0 0x7f324006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.520+0000 7f323bfff640 1 -- 172.21.15.78:0/1139329981 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f32480abe70 con 0x7f32540b2e90 2024-09-15T22:09:37.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.520+0000 7f32537fe640 1 --2- 172.21.15.78:0/1139329981 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f324006c2b0 0x7f324006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.520+0000 7f32537fe640 1 --2- 172.21.15.78:0/1139329981 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f324006c2b0 0x7f324006e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3254151910 tx=0x7f3244009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.528+0000 7f323bfff640 1 -- 172.21.15.78:0/1139329981 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f324807a330 con 0x7f32540b2e90 2024-09-15T22:09:37.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.698+0000 7f3259d9f640 1 -- 172.21.15.78:0/1139329981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32540b1f40 con 0x7f32540b2e90 2024-09-15T22:09:37.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.700+0000 7f323bfff640 1 -- 172.21.15.78:0/1139329981 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7f3248045e40 con 0x7f32540b2e90 2024-09-15T22:09:37.702 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:37.702 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"34e44e87-1d1a-416f-b208-c16e07980ff5","created":"2024-09-15T22:08:53.842443+0000","modified":"2024-09-15T22:09:21.780555+0000","last_up_change":"2024-09-15T22:09:04.830042+0000","last_in_change":"2024-09-15T22:08:55.864039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:05.999373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:14.532061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:15.710676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:09:19.437681+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"71eb9af6-bf66-4450-a5d1-d4a81f71f95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6817","nonce":3548923409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6819","nonce":3548923409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6823","nonce":3548923409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6821","nonce":3548923409}]},"public_addr":"172.21.15.78:6817/3548923409","cluster_addr":"172.21.15.78:6819/3548923409","heartbeat_back_addr":"172.21.15.78:6823/3548923409","heartbeat_front_addr":"172.21.15.78:6821/3548923409","state":["exists","up"]},{"osd":1,"uuid":"f0070f6d-7998-4ad3-b597-e5777e61d503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6809","nonce":1233827941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6811","nonce":1233827941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6815","nonce":1233827941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6813","nonce":1233827941}]},"public_addr":"172.21.15.78:6809/1233827941","cluster_addr":"172.21.15.78:6811/1233827941","heartbeat_back_addr":"172.21.15.78:6815/1233827941","heartbeat_front_addr":"172.21.15.78:6813/1233827941","state":["exists","up"]},{"osd":2,"uuid":"6d9c91c7-2c8a-48f9-9bef-67ea7320980e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6825","nonce":636523247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6827","nonce":636523247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6831","nonce":636523247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6829","nonce":636523247}]},"public_addr":"172.21.15.78:6825/636523247","cluster_addr":"172.21.15.78:6827/636523247","heartbeat_back_addr":"172.21.15.78:6831/636523247","heartbeat_front_addr":"172.21.15.78:6829/636523247","state":["exists","up"]},{"osd":3,"uuid":"943e38fb-b450-48c0-8f01-d381b0b8e313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6801","nonce":1841812488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6803","nonce":1841812488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6807","nonce":1841812488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6805","nonce":1841812488}]},"public_addr":"172.21.15.78:6801/1841812488","cluster_addr":"172.21.15.78:6803/1841812488","heartbeat_back_addr":"172.21.15.78:6807/1841812488","heartbeat_front_addr":"172.21.15.78:6805/1841812488","state":["exists","up"]},{"osd":4,"uuid":"259f50f8-3223-450d-8cd1-d0d333c278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6817","nonce":1803357070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6819","nonce":1803357070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6823","nonce":1803357070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6821","nonce":1803357070}]},"public_addr":"172.21.15.175:6817/1803357070","cluster_addr":"172.21.15.175:6819/1803357070","heartbeat_back_addr":"172.21.15.175:6823/1803357070","heartbeat_front_addr":"172.21.15.175:6821/1803357070","state":["exists","up"]},{"osd":5,"uuid":"d70426cd-a39b-4a20-8c7b-bedc8352e303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6825","nonce":2221415707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6827","nonce":2221415707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6831","nonce":2221415707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6829","nonce":2221415707}]},"public_addr":"172.21.15.175:6825/2221415707","cluster_addr":"172.21.15.175:6827/2221415707","heartbeat_back_addr":"172.21.15.175:6831/2221415707","heartbeat_front_addr":"172.21.15.175:6829/2221415707","state":["exists","up"]},{"osd":6,"uuid":"95b9ed3a-cbfc-45a5-8967-88db9da099ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6801","nonce":1974018373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6803","nonce":1974018373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6807","nonce":1974018373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6805","nonce":1974018373}]},"public_addr":"172.21.15.175:6801/1974018373","cluster_addr":"172.21.15.175:6803/1974018373","heartbeat_back_addr":"172.21.15.175:6807/1974018373","heartbeat_front_addr":"172.21.15.175:6805/1974018373","state":["exists","up"]},{"osd":7,"uuid":"5fc56286-91e9-4a13-b161-ad7d30fc0119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6809","nonce":2386415083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6811","nonce":2386415083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6815","nonce":2386415083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6813","nonce":2386415083}]},"public_addr":"172.21.15.175:6809/2386415083","cluster_addr":"172.21.15.175:6811/2386415083","heartbeat_back_addr":"172.21.15.175:6815/2386415083","heartbeat_front_addr":"172.21.15.175:6813/2386415083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.191845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.871482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.594323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.463568+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.398880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.490112+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.119097+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.677350+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:09:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.701+0000 7f3259d9f640 1 -- 172.21.15.78:0/1139329981 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f324006c2b0 msgr2=0x7f324006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.701+0000 7f3259d9f640 1 --2- 172.21.15.78:0/1139329981 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f324006c2b0 0x7f324006e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3254151910 tx=0x7f3244009040 comp rx=0 tx=0).stop 2024-09-15T22:09:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.701+0000 7f3259d9f640 1 -- 172.21.15.78:0/1139329981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32540b2e90 msgr2=0x7f32541e1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.701+0000 7f3259d9f640 1 --2- 172.21.15.78:0/1139329981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32540b2e90 0x7f32541e1100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3248000c00 tx=0x7f3248004730 comp rx=0 tx=0).stop 2024-09-15T22:09:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.702+0000 7f3259d9f640 1 -- 172.21.15.78:0/1139329981 shutdown_connections 2024-09-15T22:09:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.702+0000 7f3259d9f640 1 --2- 172.21.15.78:0/1139329981 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f324006c2b0 0x7f324006e770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.702+0000 7f3259d9f640 1 --2- 172.21.15.78:0/1139329981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f325414d160 0x7f325413fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.702+0000 7f3259d9f640 1 --2- 172.21.15.78:0/1139329981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32540b2e90 0x7f32541e1100 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.702+0000 7f3259d9f640 1 --2- 172.21.15.78:0/1139329981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32540630c0 0x7f32540afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.702+0000 7f3259d9f640 1 -- 172.21.15.78:0/1139329981 >> 172.21.15.78:0/1139329981 conn(0x7f325406bc10 msgr2=0x7f32540b1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.702+0000 7f3259d9f640 1 -- 172.21.15.78:0/1139329981 shutdown_connections 2024-09-15T22:09:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.702+0000 7f3259d9f640 1 -- 172.21.15.78:0/1139329981 wait complete. 2024-09-15T22:09:37.715 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-15T22:09:37.715 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-15T22:09:37.716 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-15T22:09:37.716 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-15T22:09:37.717 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-15T22:09:37.717 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-15T22:09:37.717 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-15T22:09:37.718 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-15T22:09:37.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.888+0000 7f3228850640 1 Processor -- start 2024-09-15T22:09:37.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.888+0000 7f3228850640 1 -- start start 2024-09-15T22:09:37.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.889+0000 7f3228850640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32240b9ba0 0x7f3224157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.889+0000 7f3228850640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3224154570 0x7f3224154a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.889+0000 7f3228850640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32240b25f0 con 0x7f32240b21d0 2024-09-15T22:09:37.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.889+0000 7f3228850640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f32240b9f80 con 0x7f3224154570 2024-09-15T22:09:37.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.889+0000 7f3228850640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3224154f60 con 0x7f32240b9ba0 2024-09-15T22:09:37.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.890+0000 7f3221d9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f32240b21d0 0x7f322408c340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56996/0 (socket says 172.21.15.78:56996) 2024-09-15T22:09:37.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.890+0000 7f3221d9b640 1 -- 172.21.15.78:0/3911825365 learned_addr learned my addr 172.21.15.78:0/3911825365 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:37.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.890+0000 7f322259c640 1 --2- 172.21.15.78:0/3911825365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32240b9ba0 0x7f3224157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.890+0000 7f322159a640 1 -- 172.21.15.78:0/3911825365 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2712283332 0 0) 0x7f32240b25f0 con 0x7f32240b21d0 2024-09-15T22:09:37.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.890+0000 7f322159a640 1 -- 172.21.15.78:0/3911825365 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f320c003520 con 0x7f32240b21d0 2024-09-15T22:09:37.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.891+0000 7f3222d9d640 1 --2- 172.21.15.78:0/3911825365 >> v2:172.21.15.175:3300/0 conn(0x7f3224154570 0x7f3224154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.891+0000 7f322259c640 1 -- 172.21.15.78:0/3911825365 >> v2:172.21.15.175:3300/0 conn(0x7f3224154570 msgr2=0x7f3224154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.891+0000 7f322259c640 1 --2- 172.21.15.78:0/3911825365 >> v2:172.21.15.175:3300/0 conn(0x7f3224154570 0x7f3224154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.891+0000 7f322259c640 1 -- 172.21.15.78:0/3911825365 >> v1:172.21.15.78:6789/0 conn(0x7f32240b21d0 legacy=0x7f322408c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.891+0000 7f322259c640 1 -- 172.21.15.78:0/3911825365 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3224158100 con 0x7f32240b9ba0 2024-09-15T22:09:37.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.891+0000 7fda14ad0640 1 Processor -- start 2024-09-15T22:09:37.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.891+0000 7fda14ad0640 1 -- start start 2024-09-15T22:09:37.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.892+0000 7f322259c640 1 --2- 172.21.15.78:0/3911825365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32240b9ba0 0x7f3224157a90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3214009110 tx=0x7f321402b240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d495a93408dbef94 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.893+0000 7f322159a640 1 -- 172.21.15.78:0/3911825365 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3214038070 con 0x7f32240b9ba0 2024-09-15T22:09:37.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.893+0000 7f322159a640 1 -- 172.21.15.78:0/3911825365 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f321402bcd0 con 0x7f32240b9ba0 2024-09-15T22:09:37.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.893+0000 7f322159a640 1 -- 172.21.15.78:0/3911825365 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c001600 con 0x7f32240b9ba0 2024-09-15T22:09:37.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.893+0000 7fda14ad0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fda1006c4e0 0x7fda1009c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.893+0000 7fda14ad0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda100b5010 0x7fda101586c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.894+0000 7f3228850640 1 -- 172.21.15.78:0/3911825365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32240b9ba0 msgr2=0x7f3224157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.894+0000 7f3228850640 1 --2- 172.21.15.78:0/3911825365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32240b9ba0 0x7f3224157a90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3214009110 tx=0x7f321402b240 comp rx=0 tx=0).stop 2024-09-15T22:09:37.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.893+0000 7fda0dd9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda100b5010 0x7fda101586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.893+0000 7fda0dd9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda100b5010 0x7fda101586c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49724/0 (socket says 172.21.15.78:49724) 2024-09-15T22:09:37.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.893+0000 7fda0dd9b640 1 -- 172.21.15.78:0/221643164 learned_addr learned my addr 172.21.15.78:0/221643164 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.893+0000 7fda14ad0640 1 -- 172.21.15.78:0/221643164 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda100b0230 con 0x7fda1009c390 2024-09-15T22:09:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.893+0000 7fda14ad0640 1 -- 172.21.15.78:0/221643164 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fda100af740 con 0x7fda100b5010 2024-09-15T22:09:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.893+0000 7fda14ad0640 1 -- 172.21.15.78:0/221643164 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fda100af990 con 0x7fda1006c4e0 2024-09-15T22:09:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.894+0000 7fda0dd9b640 1 -- 172.21.15.78:0/221643164 >> v2:172.21.15.175:3300/0 conn(0x7fda1006c4e0 msgr2=0x7fda1009c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.894+0000 7fda0e59c640 1 --2- 172.21.15.78:0/221643164 >> v2:172.21.15.175:3300/0 conn(0x7fda1006c4e0 0x7fda1009c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.894+0000 7fda0dd9b640 1 --2- 172.21.15.78:0/221643164 >> v2:172.21.15.175:3300/0 conn(0x7fda1006c4e0 0x7fda1009c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.894+0000 7fda0dd9b640 1 -- 172.21.15.78:0/221643164 >> v1:172.21.15.175:6789/0 conn(0x7fda1009c390 legacy=0x7fda100b3b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:09:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.894+0000 7fda0dd9b640 1 -- 172.21.15.78:0/221643164 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1006c8c0 con 0x7fda100b5010 2024-09-15T22:09:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.894+0000 7f1533e5c640 1 Processor -- start 2024-09-15T22:09:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.895+0000 7f3228850640 1 -- 172.21.15.78:0/3911825365 shutdown_connections 2024-09-15T22:09:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.895+0000 7f3228850640 1 --2- 172.21.15.78:0/3911825365 >> v2:172.21.15.175:3300/0 conn(0x7f3224154570 0x7f3224154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.895+0000 7f3228850640 1 --2- 172.21.15.78:0/3911825365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32240b9ba0 0x7f3224157a90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.895+0000 7f3228850640 1 -- 172.21.15.78:0/3911825365 >> 172.21.15.78:0/3911825365 conn(0x7f3224075310 msgr2=0x7f32240b9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.895+0000 7fda0dd9b640 1 --2- 172.21.15.78:0/221643164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda100b5010 0x7fda101586c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fda1006f7a0 tx=0x7fda080330d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2165f0b2d1a390a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.894+0000 7f1533e5c640 1 -- start start 2024-09-15T22:09:37.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7f1533e5c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f152c0b06f0 0x7f152c0b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7f1533e5c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0737b0 0x7f152c073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7f1533e5c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f152c14bfa0 0x7f152c14c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7f1533e5c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f152c074110 con 0x7f152c14bfa0 2024-09-15T22:09:37.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7f1533e5c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f152c0b32c0 con 0x7f152c0b06f0 2024-09-15T22:09:37.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7f1533e5c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f152c14c950 con 0x7f152c0737b0 2024-09-15T22:09:37.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7f1531bf8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f152c0b06f0 0x7f152c0b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7f15313f7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0737b0 0x7f152c073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7f15313f7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0737b0 0x7f152c073bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.78:51046/0 (socket says 172.21.15.78:51046) 2024-09-15T22:09:37.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7f15313f7640 1 -- 172.21.15.78:0/2847414172 learned_addr learned my addr 172.21.15.78:0/2847414172 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:37.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.895+0000 7fda0d59a640 1 -- 172.21.15.78:0/221643164 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda08007d30 con 0x7fda100b5010 2024-09-15T22:09:37.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.895+0000 7fda0d59a640 1 -- 172.21.15.78:0/221643164 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda080339d0 con 0x7fda100b5010 2024-09-15T22:09:37.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.895+0000 7fda0d59a640 1 -- 172.21.15.78:0/221643164 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda08033da0 con 0x7fda100b5010 2024-09-15T22:09:37.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7fda14ad0640 1 -- 172.21.15.78:0/221643164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda100b5010 msgr2=0x7fda101586c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7fda14ad0640 1 --2- 172.21.15.78:0/221643164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda100b5010 0x7fda101586c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fda1006f7a0 tx=0x7fda080330d0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.895+0000 7f3228850640 1 -- 172.21.15.78:0/3911825365 shutdown_connections 2024-09-15T22:09:37.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.895+0000 7f3228850640 1 -- 172.21.15.78:0/3911825365 wait complete. 2024-09-15T22:09:37.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7f3228850640 1 Processor -- start 2024-09-15T22:09:37.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7f3228850640 1 -- start start 2024-09-15T22:09:37.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.895+0000 7fb97f90c640 1 Processor -- start 2024-09-15T22:09:37.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.895+0000 7fb97f90c640 1 -- start start 2024-09-15T22:09:37.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7fb97f90c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb97806c4e0 0x7fb97814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7fb97f90c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9780aea00 0x7fb9780b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7fb97f90c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb97814c0e0 con 0x7fb9780b0100 2024-09-15T22:09:37.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7fb97f90c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fb97814c6c0 con 0x7fb97806c4e0 2024-09-15T22:09:37.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.896+0000 7fb97f90c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb97806c8c0 con 0x7fb9780aea00 2024-09-15T22:09:37.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7f15323f9640 1 --2- 172.21.15.78:0/2847414172 >> v2:172.21.15.78:3300/0 conn(0x7f152c14bfa0 0x7f152c14c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7f15313f7640 1 -- 172.21.15.78:0/2847414172 >> v2:172.21.15.175:3300/0 conn(0x7f152c0b06f0 msgr2=0x7f152c0b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7f15313f7640 1 --2- 172.21.15.78:0/2847414172 >> v2:172.21.15.175:3300/0 conn(0x7f152c0b06f0 0x7f152c0b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7f15313f7640 1 -- 172.21.15.78:0/2847414172 >> v2:172.21.15.78:3300/0 conn(0x7f152c14bfa0 msgr2=0x7f152c14c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7fb97dea9640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb9780b0100 0x7fb978145ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.78:44486/0 (socket says 172.21.15.78:44486) 2024-09-15T22:09:37.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7fb97dea9640 1 -- 172.21.15.78:0/3694244710 learned_addr learned my addr 172.21.15.78:0/3694244710 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:37.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7fb97d6a8640 1 --2- 172.21.15.78:0/3694244710 >> v2:172.21.15.78:3300/0 conn(0x7fb97806c4e0 0x7fb97814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7fb97cea7640 1 --2- 172.21.15.78:0/3694244710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9780aea00 0x7fb9780b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7f15313f7640 1 --2- 172.21.15.78:0/2847414172 >> v2:172.21.15.78:3300/0 conn(0x7f152c14bfa0 0x7f152c14c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7f3228850640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32240b21d0 0x7f3224072c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7f3228850640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32240b9ba0 0x7f32241ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7f3228850640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3224154570 0x7f322408b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7f3228850640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f322408cbd0 con 0x7f32240b9ba0 2024-09-15T22:09:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7f3228850640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f322408ca50 con 0x7f32240b21d0 2024-09-15T22:09:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7f3228850640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f322415ee10 con 0x7f3224154570 2024-09-15T22:09:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7f3221d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32240b9ba0 0x7f32241ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7f3221d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32240b9ba0 0x7f32241ed4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49766/0 (socket says 172.21.15.78:49766) 2024-09-15T22:09:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7f3221d9b640 1 -- 172.21.15.78:0/2629088200 learned_addr learned my addr 172.21.15.78:0/2629088200 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7f322259c640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32240b21d0 0x7f3224072c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7f3222d9d640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3224154570 0x7f322408b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7f3221d9b640 1 -- 172.21.15.78:0/2629088200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3224154570 msgr2=0x7f322408b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7f3221d9b640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3224154570 0x7f322408b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7f3221d9b640 1 -- 172.21.15.78:0/2629088200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32240b21d0 msgr2=0x7f3224072c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7f3221d9b640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32240b21d0 0x7f3224072c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7f3221d9b640 1 -- 172.21.15.78:0/2629088200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32240ad210 con 0x7f32240b9ba0 2024-09-15T22:09:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7f322259c640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32240b21d0 0x7f3224072c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7f3222d9d640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3224154570 0x7f322408b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.899+0000 7f3221d9b640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32240b9ba0 0x7f32241ed4f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f321c00dbb0 tx=0x7f321c00b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7fb97d6a8640 1 -- 172.21.15.78:0/3694244710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9780aea00 msgr2=0x7fb9780b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7fb97d6a8640 1 --2- 172.21.15.78:0/3694244710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9780aea00 0x7fb9780b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7fb97d6a8640 1 -- 172.21.15.78:0/3694244710 >> v1:172.21.15.175:6789/0 conn(0x7fb9780b0100 legacy=0x7fb978145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.898+0000 7fb97d6a8640 1 -- 172.21.15.78:0/3694244710 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97814c350 con 0x7fb97806c4e0 2024-09-15T22:09:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.899+0000 7fb97d6a8640 1 --2- 172.21.15.78:0/3694244710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97806c4e0 0x7fb97814cb50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb9740097a0 tx=0x7fb97402a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e456930c509460 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.899+0000 7fda14ad0640 1 -- 172.21.15.78:0/221643164 shutdown_connections 2024-09-15T22:09:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.899+0000 7fda14ad0640 1 --2- 172.21.15.78:0/221643164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda100b5010 0x7fda101586c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.899+0000 7fda14ad0640 1 --2- 172.21.15.78:0/221643164 >> v2:172.21.15.175:3300/0 conn(0x7fda1006c4e0 0x7fda1009c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.899+0000 7fda14ad0640 1 -- 172.21.15.78:0/221643164 >> 172.21.15.78:0/221643164 conn(0x7fda100b9170 msgr2=0x7fda100b9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7f15313f7640 1 -- 172.21.15.78:0/2847414172 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152c0b5820 con 0x7f152c0737b0 2024-09-15T22:09:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.897+0000 7f15323f9640 1 --2- 172.21.15.78:0/2847414172 >> v2:172.21.15.78:3300/0 conn(0x7f152c14bfa0 0x7f152c14c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:37.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.899+0000 7fb96ffff640 1 -- 172.21.15.78:0/3694244710 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb974037070 con 0x7fb97806c4e0 2024-09-15T22:09:37.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.899+0000 7f3212ffd640 1 -- 172.21.15.78:0/2629088200 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c00bbd0 con 0x7f32240b9ba0 2024-09-15T22:09:37.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.899+0000 7f3228850640 1 -- 172.21.15.78:0/2629088200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32240aea30 con 0x7f32240b9ba0 2024-09-15T22:09:37.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.900+0000 7f3212ffd640 1 -- 172.21.15.78:0/2629088200 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f321c01a070 con 0x7f32240b9ba0 2024-09-15T22:09:37.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.900+0000 7f3212ffd640 1 -- 172.21.15.78:0/2629088200 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c016c90 con 0x7f32240b9ba0 2024-09-15T22:09:37.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.900+0000 7f3228850640 1 -- 172.21.15.78:0/2629088200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32241eda30 con 0x7f32240b9ba0 2024-09-15T22:09:37.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.900+0000 7fb96ffff640 1 -- 172.21.15.78:0/3694244710 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb97402aca0 con 0x7fb97806c4e0 2024-09-15T22:09:37.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.901+0000 7fb97f90c640 1 -- 172.21.15.78:0/3694244710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97806c4e0 msgr2=0x7fb97814cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.901+0000 7fb97f90c640 1 --2- 172.21.15.78:0/3694244710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97806c4e0 0x7fb97814cb50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb9740097a0 tx=0x7fb97402a010 comp rx=0 tx=0).stop 2024-09-15T22:09:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.901+0000 7fb97f90c640 1 -- 172.21.15.78:0/3694244710 shutdown_connections 2024-09-15T22:09:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.901+0000 7fb97f90c640 1 --2- 172.21.15.78:0/3694244710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9780aea00 0x7fb9780b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fb97f90c640 1 --2- 172.21.15.78:0/3694244710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97806c4e0 0x7fb97814cb50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fb97f90c640 1 -- 172.21.15.78:0/3694244710 >> 172.21.15.78:0/3694244710 conn(0x7fb9780b9170 msgr2=0x7fb9780b9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.900+0000 7f15313f7640 1 --2- 172.21.15.78:0/2847414172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0737b0 0x7f152c073bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f152c06bed0 tx=0x7f152402a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24bfbb78bc5ed8d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.899+0000 7fda14ad0640 1 -- 172.21.15.78:0/221643164 shutdown_connections 2024-09-15T22:09:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.899+0000 7fda14ad0640 1 -- 172.21.15.78:0/221643164 wait complete. 2024-09-15T22:09:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.901+0000 7fda14ad0640 1 Processor -- start 2024-09-15T22:09:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.901+0000 7fda14ad0640 1 -- start start 2024-09-15T22:09:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fda14ad0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda1006c4e0 0x7fda100b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fda14ad0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda1009c390 0x7fda10070210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fda14ad0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda100b5010 0x7fda100b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fda14ad0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fda1006cc00 con 0x7fda1009c390 2024-09-15T22:09:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fda14ad0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda100b5460 con 0x7fda1006c4e0 2024-09-15T22:09:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fda14ad0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fda100ae190 con 0x7fda100b5010 2024-09-15T22:09:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fda0dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda1009c390 0x7fda10070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fda0dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda1009c390 0x7fda10070210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49780/0 (socket says 172.21.15.78:49780) 2024-09-15T22:09:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fda0dd9b640 1 -- 172.21.15.78:0/1380413491 learned_addr learned my addr 172.21.15.78:0/1380413491 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fda0dd9b640 1 -- 172.21.15.78:0/1380413491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda100b5010 msgr2=0x7fda100b0570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:09:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fda0dd9b640 1 --2- 172.21.15.78:0/1380413491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda100b5010 0x7fda100b0570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fda0dd9b640 1 -- 172.21.15.78:0/1380413491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda1006c4e0 msgr2=0x7fda100b25c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:09:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fda0dd9b640 1 --2- 172.21.15.78:0/1380413491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda1006c4e0 0x7fda100b25c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.902+0000 7fda0dd9b640 1 -- 172.21.15.78:0/1380413491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda10071760 con 0x7fda1009c390 2024-09-15T22:09:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.903+0000 7f1530bf6640 1 -- 172.21.15.78:0/2847414172 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1524036070 con 0x7f152c0737b0 2024-09-15T22:09:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.903+0000 7f1530bf6640 1 -- 172.21.15.78:0/2847414172 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1524031600 con 0x7f152c0737b0 2024-09-15T22:09:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.903+0000 7f1530bf6640 1 -- 172.21.15.78:0/2847414172 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15240319d0 con 0x7f152c0737b0 2024-09-15T22:09:37.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.903+0000 7fda0dd9b640 1 --2- 172.21.15.78:0/1380413491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda1009c390 0x7fda10070210 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fda0803d040 tx=0x7fda08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.903+0000 7fd9feffd640 1 -- 172.21.15.78:0/1380413491 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda08010070 con 0x7fda1009c390 2024-09-15T22:09:37.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.904+0000 7f1533e5c640 1 -- 172.21.15.78:0/2847414172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0737b0 msgr2=0x7f152c073bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.904+0000 7f1533e5c640 1 --2- 172.21.15.78:0/2847414172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0737b0 0x7f152c073bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f152c06bed0 tx=0x7f152402a610 comp rx=0 tx=0).stop 2024-09-15T22:09:37.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.904+0000 7f1533e5c640 1 -- 172.21.15.78:0/2847414172 shutdown_connections 2024-09-15T22:09:37.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.904+0000 7f1533e5c640 1 --2- 172.21.15.78:0/2847414172 >> v2:172.21.15.78:3300/0 conn(0x7f152c14bfa0 0x7f152c14c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.904+0000 7f1533e5c640 1 --2- 172.21.15.78:0/2847414172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0737b0 0x7f152c073bd0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f152c06bed0 tx=0x7f152402a610 comp rx=0 tx=0).stop 2024-09-15T22:09:37.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.904+0000 7f1533e5c640 1 --2- 172.21.15.78:0/2847414172 >> v2:172.21.15.175:3300/0 conn(0x7f152c0b06f0 0x7f152c0b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.904+0000 7f1533e5c640 1 -- 172.21.15.78:0/2847414172 >> 172.21.15.78:0/2847414172 conn(0x7f152c0b8f80 msgr2=0x7f152c0b9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.903+0000 7f3212ffd640 1 -- 172.21.15.78:0/2629088200 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f321c0283f0 con 0x7f32240b9ba0 2024-09-15T22:09:37.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.905+0000 7f1533e5c640 1 -- 172.21.15.78:0/2847414172 shutdown_connections 2024-09-15T22:09:37.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.904+0000 7f3212ffd640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f320406c380 0x7f320406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.904+0000 7f322259c640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f320406c380 0x7f320406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.905+0000 7f322259c640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f320406c380 0x7f320406e840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3214035000 tx=0x7f321402f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.905+0000 7f3228850640 1 -- 172.21.15.78:0/2629088200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3208001030 con 0x7f32240b9ba0 2024-09-15T22:09:37.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.905+0000 7f3212ffd640 1 -- 172.21.15.78:0/2629088200 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f321c094200 con 0x7f32240b9ba0 2024-09-15T22:09:37.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.905+0000 7f3212ffd640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.78:6808/1233827941,v1:172.21.15.78:6809/1233827941] conn(0x7f32040759f0 0x7f3204077e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.905+0000 7f3212ffd640 1 -- 172.21.15.78:0/2629088200 --> [v2:172.21.15.78:6808/1233827941,v1:172.21.15.78:6809/1233827941] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f321c018e50 con 0x7f32040759f0 2024-09-15T22:09:37.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.903+0000 7fda14ad0640 1 -- 172.21.15.78:0/1380413491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda10071a40 con 0x7fda1009c390 2024-09-15T22:09:37.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.906+0000 7fb97f90c640 1 -- 172.21.15.78:0/3694244710 shutdown_connections 2024-09-15T22:09:37.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.903+0000 7fda14ad0640 1 -- 172.21.15.78:0/1380413491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda1009e3f0 con 0x7fda1009c390 2024-09-15T22:09:37.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.906+0000 7fd9feffd640 1 -- 172.21.15.78:0/1380413491 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda08007e50 con 0x7fda1009c390 2024-09-15T22:09:37.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.906+0000 7fd9feffd640 1 -- 172.21.15.78:0/1380413491 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda08009990 con 0x7fda1009c390 2024-09-15T22:09:37.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.905+0000 7f1533e5c640 1 -- 172.21.15.78:0/2847414172 wait complete. 2024-09-15T22:09:37.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.906+0000 7f1533e5c640 1 Processor -- start 2024-09-15T22:09:37.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.907+0000 7fda14ad0640 1 -- 172.21.15.78:0/1380413491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd9f4001030 con 0x7fda1009c390 2024-09-15T22:09:37.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.905+0000 7f3222d9d640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.78:6808/1233827941,v1:172.21.15.78:6809/1233827941] conn(0x7f32040759f0 0x7f3204077e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.906+0000 7f3222d9d640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.78:6808/1233827941,v1:172.21.15.78:6809/1233827941] conn(0x7f32040759f0 0x7f3204077e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.907+0000 7f3212ffd640 1 -- 172.21.15.78:0/2629088200 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f321c05e240 con 0x7f32240b9ba0 2024-09-15T22:09:37.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.907+0000 7f3212ffd640 1 -- 172.21.15.78:0/2629088200 <== osd.1 v2:172.21.15.78:6808/1233827941 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f321c018e50 con 0x7f32040759f0 2024-09-15T22:09:37.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.906+0000 7f1533e5c640 1 -- start start 2024-09-15T22:09:37.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.907+0000 7f1533e5c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0b06f0 0x7f152c1d6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.907+0000 7f1533e5c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f152c14bfa0 0x7f152c1ea330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.907+0000 7f1533e5c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c1d4d50 0x7f152c1ea870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.907+0000 7f1533e5c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f152c0b1ef0 con 0x7f152c1d4d50 2024-09-15T22:09:37.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.907+0000 7f1533e5c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f152c0b1c10 con 0x7f152c14bfa0 2024-09-15T22:09:37.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.907+0000 7f1533e5c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f152c0b21d0 con 0x7f152c0b06f0 2024-09-15T22:09:37.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.908+0000 7f15323f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c1d4d50 0x7f152c1ea870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.908+0000 7f15323f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c1d4d50 0x7f152c1ea870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49782/0 (socket says 172.21.15.78:49782) 2024-09-15T22:09:37.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.908+0000 7f15323f9640 1 -- 172.21.15.78:0/1122455198 learned_addr learned my addr 172.21.15.78:0/1122455198 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:37.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.909+0000 7f15323f9640 1 -- 172.21.15.78:0/1122455198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0b06f0 msgr2=0x7f152c1d6db0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:09:37.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.909+0000 7f15323f9640 1 --2- 172.21.15.78:0/1122455198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0b06f0 0x7f152c1d6db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.909+0000 7f15323f9640 1 -- 172.21.15.78:0/1122455198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f152c14bfa0 msgr2=0x7f152c1ea330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:09:37.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.909+0000 7f15323f9640 1 --2- 172.21.15.78:0/1122455198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f152c14bfa0 0x7f152c1ea330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.909+0000 7f15323f9640 1 -- 172.21.15.78:0/1122455198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152c1d7440 con 0x7f152c1d4d50 2024-09-15T22:09:37.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.907+0000 7fb97f90c640 1 -- 172.21.15.78:0/3694244710 wait complete. 2024-09-15T22:09:37.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.907+0000 7fd9feffd640 1 -- 172.21.15.78:0/1380413491 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fda0803b3f0 con 0x7fda1009c390 2024-09-15T22:09:37.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.908+0000 7fd9feffd640 1 --2- 172.21.15.78:0/1380413491 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd9f806c4c0 0x7fd9f806e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.908+0000 7fd9feffd640 1 -- 172.21.15.78:0/1380413491 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fda080abe50 con 0x7fda1009c390 2024-09-15T22:09:37.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.908+0000 7fd9feffd640 1 --2- 172.21.15.78:0/1380413491 >> [v2:172.21.15.78:6800/1841812488,v1:172.21.15.78:6801/1841812488] conn(0x7fd9f8075c40 0x7fd9f8078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.909+0000 7fd9feffd640 1 -- 172.21.15.78:0/1380413491 --> [v2:172.21.15.78:6800/1841812488,v1:172.21.15.78:6801/1841812488] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda080339d0 con 0x7fd9f8075c40 2024-09-15T22:09:37.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.909+0000 7fd9feffd640 1 -- 172.21.15.78:0/1380413491 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fda080ae4b0 con 0x7fda1009c390 2024-09-15T22:09:37.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.909+0000 7fda0ed9d640 1 --2- 172.21.15.78:0/1380413491 >> [v2:172.21.15.78:6800/1841812488,v1:172.21.15.78:6801/1841812488] conn(0x7fd9f8075c40 0x7fd9f8078080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.909+0000 7fda0ed9d640 1 --2- 172.21.15.78:0/1380413491 >> [v2:172.21.15.78:6800/1841812488,v1:172.21.15.78:6801/1841812488] conn(0x7fd9f8075c40 0x7fd9f8078080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.910+0000 7fd9feffd640 1 -- 172.21.15.78:0/1380413491 <== osd.3 v2:172.21.15.78:6800/1841812488 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fda080339d0 con 0x7fd9f8075c40 2024-09-15T22:09:37.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.911+0000 7f15323f9640 1 --2- 172.21.15.78:0/1122455198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c1d4d50 0x7f152c1ea870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f151c00d850 tx=0x7f151c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.911+0000 7f15227fc640 1 -- 172.21.15.78:0/1122455198 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c004030 con 0x7f152c1d4d50 2024-09-15T22:09:37.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.911+0000 7f15227fc640 1 -- 172.21.15.78:0/1122455198 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f151c0041d0 con 0x7f152c1d4d50 2024-09-15T22:09:37.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.911+0000 7f15227fc640 1 -- 172.21.15.78:0/1122455198 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c004030 con 0x7f152c1d4d50 2024-09-15T22:09:37.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.912+0000 7f1533e5c640 1 -- 172.21.15.78:0/1122455198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152c06fa70 con 0x7f152c1d4d50 2024-09-15T22:09:37.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.912+0000 7fda0e59c640 1 --2- 172.21.15.78:0/1380413491 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd9f806c4c0 0x7fd9f806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.912+0000 7fda0e59c640 1 --2- 172.21.15.78:0/1380413491 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd9f806c4c0 0x7fd9f806e980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda0000a830 tx=0x7fda00008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.908+0000 7fb97f90c640 1 Processor -- start 2024-09-15T22:09:37.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.909+0000 7fb97f90c640 1 -- start start 2024-09-15T22:09:37.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.909+0000 7fb97f90c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9780aea00 0x7fb9781facb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.909+0000 7fb97f90c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9780b0100 0x7fb978142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.909+0000 7fb97f90c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb978146940 0x7fb9781fec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.910+0000 7fb97f90c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb9781465d0 con 0x7fb978146940 2024-09-15T22:09:37.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.910+0000 7fb97f90c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb97806cb60 con 0x7fb9780b0100 2024-09-15T22:09:37.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.910+0000 7fb97f90c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb978146750 con 0x7fb9780aea00 2024-09-15T22:09:37.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.910+0000 7fb97dea9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb978146940 0x7fb9781fec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.910+0000 7fb97dea9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb978146940 0x7fb9781fec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49798/0 (socket says 172.21.15.78:49798) 2024-09-15T22:09:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.910+0000 7fb97dea9640 1 -- 172.21.15.78:0/2887132428 learned_addr learned my addr 172.21.15.78:0/2887132428 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.910+0000 7fb97dea9640 1 -- 172.21.15.78:0/2887132428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9780aea00 msgr2=0x7fb9781facb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:09:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.910+0000 7fb97dea9640 1 --2- 172.21.15.78:0/2887132428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9780aea00 0x7fb9781facb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.910+0000 7fb97dea9640 1 -- 172.21.15.78:0/2887132428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9780b0100 msgr2=0x7fb978142fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:09:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.910+0000 7fb97dea9640 1 --2- 172.21.15.78:0/2887132428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9780b0100 0x7fb978142fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.910+0000 7fb97dea9640 1 -- 172.21.15.78:0/2887132428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb978149250 con 0x7fb978146940 2024-09-15T22:09:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.910+0000 7fb97dea9640 1 --2- 172.21.15.78:0/2887132428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb978146940 0x7fb9781fec70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb97000c8c0 tx=0x7fb97000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.912+0000 7fb96dffb640 1 -- 172.21.15.78:0/2887132428 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970018070 con 0x7fb978146940 2024-09-15T22:09:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.912+0000 7fb97f90c640 1 -- 172.21.15.78:0/2887132428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9780b2980 con 0x7fb978146940 2024-09-15T22:09:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.912+0000 7fb97f90c640 1 -- 172.21.15.78:0/2887132428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb978149530 con 0x7fb978146940 2024-09-15T22:09:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.913+0000 7fb96dffb640 1 -- 172.21.15.78:0/2887132428 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb97000a640 con 0x7fb978146940 2024-09-15T22:09:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.913+0000 7fb96dffb640 1 -- 172.21.15.78:0/2887132428 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97000aa10 con 0x7fb978146940 2024-09-15T22:09:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.915+0000 7fb96dffb640 1 -- 172.21.15.78:0/2887132428 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb97001b070 con 0x7fb978146940 2024-09-15T22:09:37.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.916+0000 7fb96dffb640 1 --2- 172.21.15.78:0/2887132428 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb95c06c330 0x7fb95c06e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.916+0000 7fb97d6a8640 1 --2- 172.21.15.78:0/2887132428 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb95c06c330 0x7fb95c06e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.916+0000 7fb9637fe640 1 -- 172.21.15.78:0/2887132428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb958001030 con 0x7fb978146940 2024-09-15T22:09:37.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.915+0000 7f1533e5c640 1 -- 172.21.15.78:0/1122455198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f152c1d76e0 con 0x7f152c1d4d50 2024-09-15T22:09:37.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.916+0000 7fb96dffb640 1 -- 172.21.15.78:0/2887132428 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb97008aed0 con 0x7fb978146940 2024-09-15T22:09:37.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.916+0000 7fb96dffb640 1 --2- 172.21.15.78:0/2887132428 >> [v2:172.21.15.78:6824/636523247,v1:172.21.15.78:6825/636523247] conn(0x7fb95c075a20 0x7fb95c077e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.917+0000 7fb96dffb640 1 -- 172.21.15.78:0/2887132428 --> [v2:172.21.15.78:6824/636523247,v1:172.21.15.78:6825/636523247] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb95c078530 con 0x7fb95c075a20 2024-09-15T22:09:37.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.917+0000 7fb96dffb640 1 -- 172.21.15.78:0/2887132428 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb970054f10 con 0x7fb978146940 2024-09-15T22:09:37.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.917+0000 7f150ffff640 1 -- 172.21.15.78:0/1122455198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f152c1e9ee0 con 0x7f152c1d4d50 2024-09-15T22:09:37.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.917+0000 7fb97cea7640 1 --2- 172.21.15.78:0/2887132428 >> [v2:172.21.15.78:6824/636523247,v1:172.21.15.78:6825/636523247] conn(0x7fb95c075a20 0x7fb95c077e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.917+0000 7fb97d6a8640 1 --2- 172.21.15.78:0/2887132428 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb95c06c330 0x7fb95c06e7f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb974034000 tx=0x7fb97402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.917+0000 7f2f2ac1e640 1 Processor -- start 2024-09-15T22:09:37.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.917+0000 7fdbcbeac640 1 Processor -- start 2024-09-15T22:09:37.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.918+0000 7fdbcbeac640 1 -- start start 2024-09-15T22:09:37.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.917+0000 7f2f2ac1e640 1 -- start start 2024-09-15T22:09:37.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.918+0000 7f2f2ac1e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f240aea00 0x7f2f2414cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.918+0000 7f2f2ac1e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f2414c0e0 con 0x7f2f240b0100 2024-09-15T22:09:37.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.918+0000 7f2f2ac1e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f2406c8c0 con 0x7f2f2406c4e0 2024-09-15T22:09:37.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.918+0000 7f2f2ac1e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f2f2414c6c0 con 0x7f2f240aea00 2024-09-15T22:09:37.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.918+0000 7f2f23fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f240aea00 0x7f2f2414cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.919+0000 7fdbcbeac640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdbc40b54d0 0x7fdbc40b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.919+0000 7fdbcbeac640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbc41476c0 0x7fdbc4147b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.919+0000 7fdbcbeac640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc41444d0 con 0x7fdbc40b1230 2024-09-15T22:09:37.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.919+0000 7fdbcbeac640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fdbc4063560 con 0x7fdbc40b54d0 2024-09-15T22:09:37.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.919+0000 7fdbcbeac640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc40b1610 con 0x7fdbc41476c0 2024-09-15T22:09:37.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.919+0000 7fdbc9c48640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdbc40b1230 0x7fdbc4062e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57020/0 (socket says 172.21.15.78:57020) 2024-09-15T22:09:37.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.919+0000 7fdbc9c48640 1 -- 172.21.15.78:0/3505215892 learned_addr learned my addr 172.21.15.78:0/3505215892 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:37.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.918+0000 7f2f289ba640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2f2406c4e0 0x7f2f24145ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.78:44496/0 (socket says 172.21.15.78:44496) 2024-09-15T22:09:37.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.919+0000 7fb97cea7640 1 --2- 172.21.15.78:0/2887132428 >> [v2:172.21.15.78:6824/636523247,v1:172.21.15.78:6825/636523247] conn(0x7fb95c075a20 0x7fb95c077e60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.918+0000 7f2f23fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f240aea00 0x7f2f2414cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49814/0 (socket says 172.21.15.78:49814) 2024-09-15T22:09:37.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.918+0000 7f2f289ba640 1 -- 172.21.15.78:0/409366670 learned_addr learned my addr 172.21.15.78:0/409366670 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:37.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.920+0000 7fdbca449640 1 --2- 172.21.15.78:0/3505215892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbc41476c0 0x7fdbc4147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.919+0000 7f2f23fff640 1 -- 172.21.15.78:0/409366670 >> v1:172.21.15.175:6789/0 conn(0x7f2f2406c4e0 legacy=0x7f2f24145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.919+0000 7f2f23fff640 1 -- 172.21.15.78:0/409366670 >> v1:172.21.15.78:6789/0 conn(0x7f2f240b0100 legacy=0x7f2f24156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.919+0000 7f2f23fff640 1 -- 172.21.15.78:0/409366670 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2414c350 con 0x7f2f240aea00 2024-09-15T22:09:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.920+0000 7fdbc9447640 1 --2- 172.21.15.78:0/3505215892 >> v2:172.21.15.175:3300/0 conn(0x7fdbc40b54d0 0x7fdbc40b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.918+0000 7f15227fc640 1 -- 172.21.15.78:0/1122455198 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f151c004380 con 0x7f152c1d4d50 2024-09-15T22:09:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.918+0000 7f15227fc640 1 --2- 172.21.15.78:0/1122455198 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f151806c7f0 0x7f151806ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.920+0000 7f1531bf8640 1 --2- 172.21.15.78:0/1122455198 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f151806c7f0 0x7f151806ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.920+0000 7f15227fc640 1 -- 172.21.15.78:0/1122455198 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f151c00f040 con 0x7f152c1d4d50 2024-09-15T22:09:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.920+0000 7f15227fc640 1 --2- 172.21.15.78:0/1122455198 >> [v2:172.21.15.175:6808/2386415083,v1:172.21.15.175:6809/2386415083] conn(0x7f1518076ab0 0x7f1518078f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.920+0000 7f15227fc640 1 -- 172.21.15.78:0/1122455198 --> [v2:172.21.15.175:6808/2386415083,v1:172.21.15.175:6809/2386415083] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1518079620 con 0x7f1518076ab0 2024-09-15T22:09:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.920+0000 7f15313f7640 1 --2- 172.21.15.78:0/1122455198 >> [v2:172.21.15.175:6808/2386415083,v1:172.21.15.175:6809/2386415083] conn(0x7f1518076ab0 0x7f1518078f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.920+0000 7f1531bf8640 1 --2- 172.21.15.78:0/1122455198 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f151806c7f0 0x7f151806ecb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f15280098c0 tx=0x7f1528008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.921+0000 7f2f23fff640 1 --2- 172.21.15.78:0/409366670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f240aea00 0x7f2f2414cb50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009740 tx=0x7f2f18029fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4906c6fe13cad0ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.921+0000 7fb96dffb640 1 -- 172.21.15.78:0/2887132428 <== osd.2 v2:172.21.15.78:6824/636523247 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb95c078530 con 0x7fb95c075a20 2024-09-15T22:09:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.921+0000 7f15313f7640 1 --2- 172.21.15.78:0/1122455198 >> [v2:172.21.15.175:6808/2386415083,v1:172.21.15.175:6809/2386415083] conn(0x7f1518076ab0 0x7f1518078f50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.921+0000 7fdbc8c46640 1 -- 172.21.15.78:0/3505215892 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 750278527 0 0) 0x7fdbc41444d0 con 0x7fdbc40b1230 2024-09-15T22:09:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.921+0000 7fdbc8c46640 1 -- 172.21.15.78:0/3505215892 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbb0003520 con 0x7fdbc40b1230 2024-09-15T22:09:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.921+0000 7f15227fc640 1 -- 172.21.15.78:0/1122455198 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f151c055a60 con 0x7f152c1d4d50 2024-09-15T22:09:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.921+0000 7fdbc8c46640 1 -- 172.21.15.78:0/3505215892 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1013581293 0 0) 0x7fdbb0003520 con 0x7fdbc40b1230 2024-09-15T22:09:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.921+0000 7fdbc8c46640 1 -- 172.21.15.78:0/3505215892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbc41476c0 msgr2=0x7fdbc4147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.921+0000 7fdbc8c46640 1 --2- 172.21.15.78:0/3505215892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbc41476c0 0x7fdbc4147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.921+0000 7fdbc8c46640 1 -- 172.21.15.78:0/3505215892 >> v2:172.21.15.175:3300/0 conn(0x7fdbc40b54d0 msgr2=0x7fdbc40b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.921+0000 7fdbc8c46640 1 --2- 172.21.15.78:0/3505215892 >> v2:172.21.15.175:3300/0 conn(0x7fdbc40b54d0 0x7fdbc40b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.921+0000 7fdbc8c46640 1 -- 172.21.15.78:0/3505215892 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc4148050 con 0x7fdbc40b1230 2024-09-15T22:09:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.921+0000 7fdbc8c46640 1 -- 172.21.15.78:0/3505215892 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3961011974 0 0) 0x7fdbbc0019d0 con 0x7fdbc40b1230 2024-09-15T22:09:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.922+0000 7fdbc8c46640 1 -- 172.21.15.78:0/3505215892 >> v1:172.21.15.78:6789/0 conn(0x7fdbc40b1230 legacy=0x7fdbc4062e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.921+0000 7f2f237fe640 1 -- 172.21.15.78:0/409366670 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18037070 con 0x7f2f240aea00 2024-09-15T22:09:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.921+0000 7f2f237fe640 1 -- 172.21.15.78:0/409366670 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1802acf0 con 0x7f2f240aea00 2024-09-15T22:09:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.922+0000 7f2f237fe640 1 -- 172.21.15.78:0/409366670 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18032660 con 0x7f2f240aea00 2024-09-15T22:09:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.922+0000 7fdbc8c46640 1 --2- 172.21.15.78:0/3505215892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbb0003a10 0x7fdbb0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.922+0000 7fdbc8c46640 1 --2- 172.21.15.78:0/3505215892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbb0004800 0x7fdbb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.922+0000 7fdbc8c46640 1 --2- 172.21.15.78:0/3505215892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbb00051c0 0x7fdbb000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.922+0000 7fdbc8c46640 1 -- 172.21.15.78:0/3505215892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc4063560 con 0x7fdbb00051c0 2024-09-15T22:09:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.922+0000 7fdbc8c46640 1 -- 172.21.15.78:0/3505215892 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc40b1610 con 0x7fdbb0003a10 2024-09-15T22:09:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.922+0000 7fdbc8c46640 1 -- 172.21.15.78:0/3505215892 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdbb000c000 con 0x7fdbb0004800 2024-09-15T22:09:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.922+0000 7f15227fc640 1 -- 172.21.15.78:0/1122455198 <== osd.7 v2:172.21.15.175:6808/2386415083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1518079620 con 0x7f1518076ab0 2024-09-15T22:09:37.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.922+0000 7fdbc9c48640 1 --2- 172.21.15.78:0/3505215892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbb0003a10 0x7fdbb0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.923+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/409366670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f240aea00 msgr2=0x7f2f2414cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.923+0000 7f2f2ac1e640 1 --2- 172.21.15.78:0/409366670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f240aea00 0x7f2f2414cb50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009740 tx=0x7f2f18029fe0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.923+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/409366670 shutdown_connections 2024-09-15T22:09:37.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.923+0000 7f2f2ac1e640 1 --2- 172.21.15.78:0/409366670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f240aea00 0x7f2f2414cb50 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009740 tx=0x7f2f18029fe0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.923+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/409366670 >> 172.21.15.78:0/409366670 conn(0x7f2f240b9170 msgr2=0x7f2f240b9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.925+0000 7fdbca449640 1 --2- 172.21.15.78:0/3505215892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbb00051c0 0x7fdbb000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.924+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/409366670 shutdown_connections 2024-09-15T22:09:37.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.924+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/409366670 wait complete. 2024-09-15T22:09:37.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.925+0000 7f2f2ac1e640 1 Processor -- start 2024-09-15T22:09:37.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.925+0000 7f2f2ac1e640 1 -- start start 2024-09-15T22:09:37.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.925+0000 7fdbc9447640 1 --2- 172.21.15.78:0/3505215892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbb0004800 0x7fdbb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.925+0000 7fdbc9c48640 1 -- 172.21.15.78:0/3505215892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbb0004800 msgr2=0x7fdbb0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.925+0000 7fdbc9c48640 1 --2- 172.21.15.78:0/3505215892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbb0004800 0x7fdbb0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.925+0000 7fdbc9c48640 1 -- 172.21.15.78:0/3505215892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbb00051c0 msgr2=0x7fdbb000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.925+0000 7fdbc9c48640 1 --2- 172.21.15.78:0/3505215892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbb00051c0 0x7fdbb000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.925+0000 7fdbc9c48640 1 -- 172.21.15.78:0/3505215892 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc4148050 con 0x7fdbb0003a10 2024-09-15T22:09:37.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.925+0000 7fdbc9447640 1 --2- 172.21.15.78:0/3505215892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbb0004800 0x7fdbb0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:37.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.926+0000 7fdbc9c48640 1 --2- 172.21.15.78:0/3505215892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbb0003a10 0x7fdbb0003e50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00a990 tx=0x7fdbb0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a90ad6dce917ed78 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.926+0000 7fdbc8c46640 1 -- 172.21.15.78:0/3505215892 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00a590 con 0x7fdbb0003a10 2024-09-15T22:09:37.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7fdbc8c46640 1 -- 172.21.15.78:0/3505215892 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbbc02f070 con 0x7fdbb0003a10 2024-09-15T22:09:37.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7fdbc8c46640 1 -- 172.21.15.78:0/3505215892 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00a590 con 0x7fdbb0003a10 2024-09-15T22:09:37.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7f2f2ac1e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f2406c4e0 0x7f2f241479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7f2f2ac1e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f240b0100 0x7f2f24148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7f2f2ac1e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f24149000 0x7f2f2412e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7f2f2ac1e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2f241465d0 con 0x7f2f240b0100 2024-09-15T22:09:37.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7f2f2ac1e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2406cb60 con 0x7f2f2406c4e0 2024-09-15T22:09:37.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7f2f2ac1e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2f24146750 con 0x7f2f24149000 2024-09-15T22:09:37.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.928+0000 7fdbcbeac640 1 -- 172.21.15.78:0/3505215892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbb0003a10 msgr2=0x7fdbb0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.928+0000 7fdbcbeac640 1 --2- 172.21.15.78:0/3505215892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbb0003a10 0x7fdbb0003e50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00a990 tx=0x7fdbb0005830 comp rx=0 tx=0).stop 2024-09-15T22:09:37.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.928+0000 7fdbca449640 1 -- 172.21.15.78:0/3505215892 reap_dead start 2024-09-15T22:09:37.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7f2f291bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f24149000 0x7f2f2412e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7f2f291bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f24149000 0x7f2f2412e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.78:51114/0 (socket says 172.21.15.78:51114) 2024-09-15T22:09:37.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7f2f291bb640 1 -- 172.21.15.78:0/2201610168 learned_addr learned my addr 172.21.15.78:0/2201610168 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:37.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.928+0000 7fdbcbeac640 1 -- 172.21.15.78:0/3505215892 shutdown_connections 2024-09-15T22:09:37.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.928+0000 7fdbcbeac640 1 -- 172.21.15.78:0/3505215892 >> 172.21.15.78:0/3505215892 conn(0x7fdbc406bc10 msgr2=0x7fdbc406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7f2f291bb640 1 -- 172.21.15.78:0/2201610168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f2406c4e0 msgr2=0x7f2f241479f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:09:37.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7f2f291bb640 1 --2- 172.21.15.78:0/2201610168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f2406c4e0 0x7f2f241479f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7f2f291bb640 1 -- 172.21.15.78:0/2201610168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f240b0100 msgr2=0x7f2f24148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7f2f291bb640 1 --2- 172.21.15.78:0/2201610168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f240b0100 0x7f2f24148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.927+0000 7f2f291bb640 1 -- 172.21.15.78:0/2201610168 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f24146c90 con 0x7f2f24149000 2024-09-15T22:09:37.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.928+0000 7f2f291bb640 1 --2- 172.21.15.78:0/2201610168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f24149000 0x7f2f2412e0e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00b990 tx=0x7f2f1c00be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.928+0000 7fdbcbeac640 1 -- 172.21.15.78:0/3505215892 shutdown_connections 2024-09-15T22:09:37.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.928+0000 7fdbcbeac640 1 -- 172.21.15.78:0/3505215892 wait complete. 2024-09-15T22:09:37.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.929+0000 7f2f217fa640 1 -- 172.21.15.78:0/2201610168 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c019070 con 0x7f2f24149000 2024-09-15T22:09:37.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.929+0000 7f2f217fa640 1 -- 172.21.15.78:0/2201610168 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1c00cba0 con 0x7f2f24149000 2024-09-15T22:09:37.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.929+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/2201610168 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f24149560 con 0x7f2f24149000 2024-09-15T22:09:37.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.929+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/2201610168 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f24148080 con 0x7f2f24149000 2024-09-15T22:09:37.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.929+0000 7f2f217fa640 1 -- 172.21.15.78:0/2201610168 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c014440 con 0x7f2f24149000 2024-09-15T22:09:37.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.930+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/2201610168 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f04001030 con 0x7f2f24149000 2024-09-15T22:09:37.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.930+0000 7fdbcbeac640 1 Processor -- start 2024-09-15T22:09:37.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.930+0000 7fdbcbeac640 1 -- start start 2024-09-15T22:09:37.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.931+0000 7fdbcbeac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc4072270 0x7fdbc40afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.931+0000 7f2f217fa640 1 -- 172.21.15.78:0/2201610168 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2f1c01c070 con 0x7f2f24149000 2024-09-15T22:09:37.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.932+0000 7fdbcbeac640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbc40ac1c0 0x7fdbc40aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.932+0000 7fdbc9c48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc4072270 0x7fdbc40afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.932+0000 7fdbc9c48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc4072270 0x7fdbc40afa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49836/0 (socket says 172.21.15.78:49836) 2024-09-15T22:09:37.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.932+0000 7fdbc9c48640 1 -- 172.21.15.78:0/319059249 learned_addr learned my addr 172.21.15.78:0/319059249 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:37.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.932+0000 7f2f217fa640 1 --2- 172.21.15.78:0/2201610168 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f2f1006c380 0x7f2f1006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.932+0000 7fdbcbeac640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbc40aa9b0 0x7fdbc40aae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.932+0000 7fdbc9447640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbc40ac1c0 0x7fdbc40aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.932+0000 7f2f217fa640 1 -- 172.21.15.78:0/2201610168 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2f1c08bde0 con 0x7f2f24149000 2024-09-15T22:09:37.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.932+0000 7fb449bac640 1 Processor -- start 2024-09-15T22:09:37.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.932+0000 7f2f289ba640 1 --2- 172.21.15.78:0/2201610168 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f2f1006c380 0x7f2f1006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.933+0000 7fb449bac640 1 -- start start 2024-09-15T22:09:37.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.933+0000 7f2f217fa640 1 --2- 172.21.15.78:0/2201610168 >> [v2:172.21.15.175:6800/1974018373,v1:172.21.15.175:6801/1974018373] conn(0x7f2f10075af0 0x7f2f10077f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.933+0000 7fdbcbeac640 1 -- 172.21.15.78:0/319059249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc4144a50 con 0x7fdbc4072270 2024-09-15T22:09:37.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.933+0000 7f2f217fa640 1 -- 172.21.15.78:0/2201610168 --> [v2:172.21.15.175:6800/1974018373,v1:172.21.15.175:6801/1974018373] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f10078600 con 0x7f2f10075af0 2024-09-15T22:09:37.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.933+0000 7f2f217fa640 1 -- 172.21.15.78:0/2201610168 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2f1c08c1d0 con 0x7f2f24149000 2024-09-15T22:09:37.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.933+0000 7fdbca449640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbc40aa9b0 0x7fdbc40aae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.933+0000 7fdbcbeac640 1 -- 172.21.15.78:0/319059249 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc4144770 con 0x7fdbc40aa9b0 2024-09-15T22:09:37.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.933+0000 7fdbcbeac640 1 -- 172.21.15.78:0/319059249 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc40b3640 con 0x7fdbc40ac1c0 2024-09-15T22:09:37.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.933+0000 7f2f23fff640 1 --2- 172.21.15.78:0/2201610168 >> [v2:172.21.15.175:6800/1974018373,v1:172.21.15.175:6801/1974018373] conn(0x7f2f10075af0 0x7f2f10077f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fdbc9447640 1 -- 172.21.15.78:0/319059249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbc40aa9b0 msgr2=0x7fdbc40aae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fb449bac640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4440b1320 0x7fb4440b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fb449bac640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb4440b1790 0x7fb44414e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fb448baa640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb4440b2210 0x7fb444143820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57032/0 (socket says 172.21.15.78:57032) 2024-09-15T22:09:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fb448baa640 1 -- 172.21.15.78:0/2328506814 learned_addr learned my addr 172.21.15.78:0/2328506814 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fb449bac640 1 -- 172.21.15.78:0/2328506814 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4440b25f0 con 0x7fb4440b2210 2024-09-15T22:09:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fb443fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4440b1320 0x7fb4440b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fb4493ab640 1 --2- 172.21.15.78:0/2328506814 >> v2:172.21.15.175:3300/0 conn(0x7fb4440b1790 0x7fb44414e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fdbc9447640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbc40aa9b0 0x7fdbc40aae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fdbc9447640 1 -- 172.21.15.78:0/319059249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc4072270 msgr2=0x7fdbc40afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fdbc9447640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc4072270 0x7fdbc40afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fdbc9447640 1 -- 172.21.15.78:0/319059249 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc40af050 con 0x7fdbc40ac1c0 2024-09-15T22:09:37.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fdbca449640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbc40aa9b0 0x7fdbc40aae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:37.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fdbc9c48640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc4072270 0x7fdbc40afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:09:37.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fb449bac640 1 -- 172.21.15.78:0/2328506814 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fb4440740a0 con 0x7fb4440b1320 2024-09-15T22:09:37.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.935+0000 7fdbc9447640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbc40ac1c0 0x7fdbc40aa470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009e50 tx=0x7fdbb400c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.934+0000 7fb449bac640 1 -- 172.21.15.78:0/2328506814 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb4440b0720 con 0x7fb4440b1790 2024-09-15T22:09:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.935+0000 7f2f289ba640 1 --2- 172.21.15.78:0/2201610168 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f2f1006c380 0x7f2f1006e840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2f14007fd0 tx=0x7f2f140079a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.935+0000 7fdbba7fc640 1 -- 172.21.15.78:0/319059249 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4023070 con 0x7fdbc40ac1c0 2024-09-15T22:09:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.935+0000 7f2f23fff640 1 --2- 172.21.15.78:0/2201610168 >> [v2:172.21.15.175:6800/1974018373,v1:172.21.15.175:6801/1974018373] conn(0x7f2f10075af0 0x7f2f10077f30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.935+0000 7fdbcbeac640 1 -- 172.21.15.78:0/319059249 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc40ac650 con 0x7fdbc40ac1c0 2024-09-15T22:09:37.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.935+0000 7fdbcbeac640 1 -- 172.21.15.78:0/319059249 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc40af4e0 con 0x7fdbc40ac1c0 2024-09-15T22:09:37.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.936+0000 7fdbba7fc640 1 -- 172.21.15.78:0/319059249 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbb4015b70 con 0x7fdbc40ac1c0 2024-09-15T22:09:37.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.935+0000 7fb4437fe640 1 -- 172.21.15.78:0/2328506814 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 958621006 0 0) 0x7fb4440b25f0 con 0x7fb4440b2210 2024-09-15T22:09:37.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.936+0000 7fb4437fe640 1 -- 172.21.15.78:0/2328506814 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb42c003520 con 0x7fb4440b2210 2024-09-15T22:09:37.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.936+0000 7fdbba7fc640 1 -- 172.21.15.78:0/319059249 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4016050 con 0x7fdbc40ac1c0 2024-09-15T22:09:37.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.936+0000 7fb443fff640 1 -- 172.21.15.78:0/2328506814 >> v2:172.21.15.175:3300/0 conn(0x7fb4440b1790 msgr2=0x7fb44414e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.937+0000 7f2f217fa640 1 -- 172.21.15.78:0/2201610168 <== osd.6 v2:172.21.15.175:6800/1974018373 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f10078600 con 0x7f2f10075af0 2024-09-15T22:09:37.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.936+0000 7fb443fff640 1 --2- 172.21.15.78:0/2328506814 >> v2:172.21.15.175:3300/0 conn(0x7fb4440b1790 0x7fb44414e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.936+0000 7fb443fff640 1 -- 172.21.15.78:0/2328506814 >> v1:172.21.15.78:6789/0 conn(0x7fb4440b2210 legacy=0x7fb444143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.936+0000 7fb443fff640 1 -- 172.21.15.78:0/2328506814 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4440b0a00 con 0x7fb4440b1320 2024-09-15T22:09:37.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.937+0000 7fb443fff640 1 --2- 172.21.15.78:0/2328506814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4440b1320 0x7fb4440b4ec0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb44406c7d0 tx=0x7fb43802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf77e1a8515764e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.938+0000 7fdbba7fc640 1 -- 172.21.15.78:0/319059249 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdbb4026070 con 0x7fdbc40ac1c0 2024-09-15T22:09:37.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.938+0000 7fb4437fe640 1 -- 172.21.15.78:0/2328506814 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438037070 con 0x7fb4440b1320 2024-09-15T22:09:37.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.938+0000 7fb4437fe640 1 -- 172.21.15.78:0/2328506814 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb43802ae00 con 0x7fb4440b1320 2024-09-15T22:09:37.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.939+0000 7fb4437fe640 1 -- 172.21.15.78:0/2328506814 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438032640 con 0x7fb4440b1320 2024-09-15T22:09:37.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.939+0000 7f56f1cc4640 1 Processor -- start 2024-09-15T22:09:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.939+0000 7f56f1cc4640 1 -- start start 2024-09-15T22:09:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.939+0000 7fdbba7fc640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fdba806c2b0 0x7fdba806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.939+0000 7fdbc9c48640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fdba806c2b0 0x7fdba806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7fdbc9c48640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fdba806c2b0 0x7fdba806e770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc001560 tx=0x7fdbbc007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7fdbba7fc640 1 -- 172.21.15.78:0/319059249 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdbb4093300 con 0x7fdbc40ac1c0 2024-09-15T22:09:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7fda14ad0640 1 -- 172.21.15.78:0/1380413491 --> [v2:172.21.15.78:6800/1841812488,v1:172.21.15.78:6801/1841812488] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd9f4002d50 con 0x7fd9f8075c40 2024-09-15T22:09:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.941+0000 7fd9feffd640 1 -- 172.21.15.78:0/1380413491 <== osd.3 v2:172.21.15.78:6800/1841812488 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd9f4002d50 con 0x7fd9f8075c40 2024-09-15T22:09:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7fb449bac640 1 -- 172.21.15.78:0/2328506814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4440b1320 msgr2=0x7fb4440b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7fb449bac640 1 --2- 172.21.15.78:0/2328506814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4440b1320 0x7fb4440b4ec0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb44406c7d0 tx=0x7fb43802a0b0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7fb449bac640 1 -- 172.21.15.78:0/2328506814 shutdown_connections 2024-09-15T22:09:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7fb449bac640 1 --2- 172.21.15.78:0/2328506814 >> v2:172.21.15.175:3300/0 conn(0x7fb4440b1790 0x7fb44414e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7fb449bac640 1 --2- 172.21.15.78:0/2328506814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4440b1320 0x7fb4440b4ec0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7fb449bac640 1 -- 172.21.15.78:0/2328506814 >> 172.21.15.78:0/2328506814 conn(0x7fb4440b90f0 msgr2=0x7fb4440b9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7f56f1cc4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56ec0b7390 0x7f56ec148300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7f56f1cc4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f56ec0b59b0 0x7f56ec0b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7f56f1cc4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f56ec0b4990 0x7f56ec141580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7f56e3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f56ec0b59b0 0x7f56ec0b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7f56e3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f56ec0b59b0 0x7f56ec0b7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49848/0 (socket says 172.21.15.78:49848) 2024-09-15T22:09:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7f56e3fff640 1 -- 172.21.15.78:0/1406384805 learned_addr learned my addr 172.21.15.78:0/1406384805 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.940+0000 7f56f1cc4640 1 -- 172.21.15.78:0/1406384805 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f56ec147860 con 0x7f56ec0b59b0 2024-09-15T22:09:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.941+0000 7f56f14c3640 1 --2- 172.21.15.78:0/1406384805 >> v2:172.21.15.175:3300/0 conn(0x7f56ec0b4990 0x7f56ec141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.941+0000 7f56f0cc2640 1 --2- 172.21.15.78:0/1406384805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56ec0b7390 0x7f56ec148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.941+0000 7fda14ad0640 1 -- 172.21.15.78:0/1380413491 >> [v2:172.21.15.78:6800/1841812488,v1:172.21.15.78:6801/1841812488] conn(0x7fd9f8075c40 msgr2=0x7fd9f8078080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.941+0000 7fda14ad0640 1 --2- 172.21.15.78:0/1380413491 >> [v2:172.21.15.78:6800/1841812488,v1:172.21.15.78:6801/1841812488] conn(0x7fd9f8075c40 0x7fd9f8078080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.941+0000 7fda14ad0640 1 -- 172.21.15.78:0/1380413491 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd9f806c4c0 msgr2=0x7fd9f806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.941+0000 7fda14ad0640 1 --2- 172.21.15.78:0/1380413491 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd9f806c4c0 0x7fd9f806e980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda0000a830 tx=0x7fda00008040 comp rx=0 tx=0).stop 2024-09-15T22:09:37.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.941+0000 7f56f1cc4640 1 -- 172.21.15.78:0/1406384805 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f56ec0b7770 con 0x7f56ec0b4990 2024-09-15T22:09:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.941+0000 7f56f1cc4640 1 -- 172.21.15.78:0/1406384805 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f56ec0b6920 con 0x7f56ec0b7390 2024-09-15T22:09:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.941+0000 7fda14ad0640 1 -- 172.21.15.78:0/1380413491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda1009c390 msgr2=0x7fda10070210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.941+0000 7fda14ad0640 1 --2- 172.21.15.78:0/1380413491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda1009c390 0x7fda10070210 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fda0803d040 tx=0x7fda08004a40 comp rx=0 tx=0).stop 2024-09-15T22:09:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.941+0000 7fda0ed9d640 1 -- 172.21.15.78:0/1380413491 reap_dead start 2024-09-15T22:09:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.942+0000 7fda14ad0640 1 -- 172.21.15.78:0/1380413491 shutdown_connections 2024-09-15T22:09:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.942+0000 7fda14ad0640 1 -- 172.21.15.78:0/1380413491 >> 172.21.15.78:0/1380413491 conn(0x7fda100b9170 msgr2=0x7fda100b8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.942+0000 7fb449bac640 1 -- 172.21.15.78:0/2328506814 shutdown_connections 2024-09-15T22:09:37.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.942+0000 7fb449bac640 1 -- 172.21.15.78:0/2328506814 wait complete. 2024-09-15T22:09:37.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.942+0000 7fda14ad0640 1 -- 172.21.15.78:0/1380413491 shutdown_connections 2024-09-15T22:09:37.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.942+0000 7fda14ad0640 1 -- 172.21.15.78:0/1380413491 wait complete. 2024-09-15T22:09:37.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.942+0000 7f3228850640 1 -- 172.21.15.78:0/2629088200 --> [v2:172.21.15.78:6808/1233827941,v1:172.21.15.78:6809/1233827941] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3208002d50 con 0x7f32040759f0 2024-09-15T22:09:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.942+0000 7f56f0cc2640 1 -- 172.21.15.78:0/1406384805 >> v2:172.21.15.175:3300/0 conn(0x7f56ec0b4990 msgr2=0x7f56ec141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.942+0000 7f56f0cc2640 1 --2- 172.21.15.78:0/1406384805 >> v2:172.21.15.175:3300/0 conn(0x7f56ec0b4990 0x7f56ec141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.942+0000 7f56f0cc2640 1 -- 172.21.15.78:0/1406384805 >> v2:172.21.15.78:3300/0 conn(0x7f56ec0b59b0 msgr2=0x7f56ec0b7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.942+0000 7f56f0cc2640 1 --2- 172.21.15.78:0/1406384805 >> v2:172.21.15.78:3300/0 conn(0x7f56ec0b59b0 0x7f56ec0b7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.942+0000 7f56f0cc2640 1 -- 172.21.15.78:0/1406384805 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec147b00 con 0x7f56ec0b7390 2024-09-15T22:09:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.943+0000 7fdbcbeac640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.78:6816/3548923409,v1:172.21.15.78:6817/3548923409] conn(0x7fdbac001650 0x7fdbac003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.943+0000 7fdbcbeac640 1 -- 172.21.15.78:0/319059249 --> [v2:172.21.15.78:6816/3548923409,v1:172.21.15.78:6817/3548923409] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdbac006bb0 con 0x7fdbac001650 2024-09-15T22:09:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.943+0000 7fdbca449640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.78:6816/3548923409,v1:172.21.15.78:6817/3548923409] conn(0x7fdbac001650 0x7fdbac003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.944+0000 7f3212ffd640 1 -- 172.21.15.78:0/2629088200 <== osd.1 v2:172.21.15.78:6808/1233827941 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3208002d50 con 0x7f32040759f0 2024-09-15T22:09:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.944+0000 7fb449bac640 1 Processor -- start 2024-09-15T22:09:37.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.944+0000 7f56f0cc2640 1 --2- 172.21.15.78:0/1406384805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56ec0b7390 0x7f56ec148300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009d90 tx=0x7f56e802a500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=686b5bb19ef60929 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.944+0000 7fb449bac640 1 -- start start 2024-09-15T22:09:37.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.944+0000 7fdbca449640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.78:6816/3548923409,v1:172.21.15.78:6817/3548923409] conn(0x7fdbac001650 0x7fdbac003b10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.944+0000 7f3210ff9640 1 -- 172.21.15.78:0/2629088200 >> [v2:172.21.15.78:6808/1233827941,v1:172.21.15.78:6809/1233827941] conn(0x7f32040759f0 msgr2=0x7f3204077e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.944+0000 7f3210ff9640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.78:6808/1233827941,v1:172.21.15.78:6809/1233827941] conn(0x7f32040759f0 0x7f3204077e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.944+0000 7f56e37fe640 1 -- 172.21.15.78:0/1406384805 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8007740 con 0x7f56ec0b7390 2024-09-15T22:09:37.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.945+0000 7f56e37fe640 1 -- 172.21.15.78:0/1406384805 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e80078e0 con 0x7f56ec0b7390 2024-09-15T22:09:37.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.945+0000 7f56e37fe640 1 -- 172.21.15.78:0/1406384805 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8007cb0 con 0x7f56ec0b7390 2024-09-15T22:09:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.945+0000 7f3210ff9640 1 -- 172.21.15.78:0/2629088200 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f320406c380 msgr2=0x7f320406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.945+0000 7f3210ff9640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f320406c380 0x7f320406e840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3214035000 tx=0x7f321402f000 comp rx=0 tx=0).stop 2024-09-15T22:09:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.945+0000 7f3210ff9640 1 -- 172.21.15.78:0/2629088200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32240b9ba0 msgr2=0x7f32241ed4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.945+0000 7f3210ff9640 1 --2- 172.21.15.78:0/2629088200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32240b9ba0 0x7f32241ed4f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f321c00dbb0 tx=0x7f321c00b520 comp rx=0 tx=0).stop 2024-09-15T22:09:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.945+0000 7f3222d9d640 1 -- 172.21.15.78:0/2629088200 reap_dead start 2024-09-15T22:09:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.945+0000 7f3210ff9640 1 -- 172.21.15.78:0/2629088200 shutdown_connections 2024-09-15T22:09:37.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.945+0000 7fb449bac640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4440b1790 0x7fb444140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.945+0000 7f3210ff9640 1 -- 172.21.15.78:0/2629088200 >> 172.21.15.78:0/2629088200 conn(0x7f3224075310 msgr2=0x7f32240b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.945+0000 7fb449bac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4440b2210 0x7fb4441dc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7fb449bac640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb44413fea0 0x7fb44413eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7fb448baa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4440b1790 0x7fb444140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7fb448baa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4440b1790 0x7fb444140d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.78:33210/0 (socket says 172.21.15.78:33210) 2024-09-15T22:09:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7fb448baa640 1 -- 172.21.15.78:0/2488899931 learned_addr learned my addr 172.21.15.78:0/2488899931 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7fb4493ab640 1 --2- 172.21.15.78:0/2488899931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb44413fea0 0x7fb44413eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7fb449bac640 1 -- 172.21.15.78:0/2488899931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb4440b10a0 con 0x7fb4440b2210 2024-09-15T22:09:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7fb449bac640 1 -- 172.21.15.78:0/2488899931 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb4440b0f20 con 0x7fb4440b1790 2024-09-15T22:09:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7fb449bac640 1 -- 172.21.15.78:0/2488899931 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb44406da30 con 0x7fb44413fea0 2024-09-15T22:09:37.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7f56f1cc4640 1 -- 172.21.15.78:0/1406384805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56ec0b7390 msgr2=0x7f56ec148300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7f56f1cc4640 1 --2- 172.21.15.78:0/1406384805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56ec0b7390 0x7f56ec148300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009d90 tx=0x7f56e802a500 comp rx=0 tx=0).stop 2024-09-15T22:09:37.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7fdbba7fc640 1 -- 172.21.15.78:0/319059249 <== osd.0 v2:172.21.15.78:6816/3548923409 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdbac006bb0 con 0x7fdbac001650 2024-09-15T22:09:37.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7fb448baa640 1 -- 172.21.15.78:0/2488899931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb44413fea0 msgr2=0x7fb44413eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7fb448baa640 1 --2- 172.21.15.78:0/2488899931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb44413fea0 0x7fb44413eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7fb448baa640 1 -- 172.21.15.78:0/2488899931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4440b2210 msgr2=0x7fb4441dc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7fb448baa640 1 --2- 172.21.15.78:0/2488899931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4440b2210 0x7fb4441dc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.946+0000 7fb448baa640 1 -- 172.21.15.78:0/2488899931 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4440aa7d0 con 0x7fb4440b1790 2024-09-15T22:09:37.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.947+0000 7f3210ff9640 1 -- 172.21.15.78:0/2629088200 shutdown_connections 2024-09-15T22:09:37.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.947+0000 7f3210ff9640 1 -- 172.21.15.78:0/2629088200 wait complete. 2024-09-15T22:09:37.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.947+0000 7fb448baa640 1 --2- 172.21.15.78:0/2488899931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4440b1790 0x7fb444140d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00cbf0 tx=0x7fb43c00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.947+0000 7fb4417fa640 1 -- 172.21.15.78:0/2488899931 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c017070 con 0x7fb4440b1790 2024-09-15T22:09:37.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.947+0000 7fb4417fa640 1 -- 172.21.15.78:0/2488899931 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb43c00ad40 con 0x7fb4440b1790 2024-09-15T22:09:37.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.947+0000 7fb4417fa640 1 -- 172.21.15.78:0/2488899931 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c012620 con 0x7fb4440b1790 2024-09-15T22:09:37.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.947+0000 7fb449bac640 1 -- 172.21.15.78:0/2488899931 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb444140620 con 0x7fb4440b1790 2024-09-15T22:09:37.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.947+0000 7fb449bac640 1 -- 172.21.15.78:0/2488899931 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4441dd320 con 0x7fb4440b1790 2024-09-15T22:09:37.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.948+0000 7fb449bac640 1 -- 172.21.15.78:0/2488899931 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb4440b31a0 con 0x7fb4440b1790 2024-09-15T22:09:37.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.948+0000 7f56f1cc4640 1 -- 172.21.15.78:0/1406384805 shutdown_connections 2024-09-15T22:09:37.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.948+0000 7f56f1cc4640 1 --2- 172.21.15.78:0/1406384805 >> v2:172.21.15.175:3300/0 conn(0x7f56ec0b4990 0x7f56ec141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.948+0000 7f56f1cc4640 1 --2- 172.21.15.78:0/1406384805 >> v2:172.21.15.78:3300/0 conn(0x7f56ec0b59b0 0x7f56ec0b7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.948+0000 7f56f1cc4640 1 --2- 172.21.15.78:0/1406384805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56ec0b7390 0x7f56ec148300 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.948+0000 7f56f1cc4640 1 -- 172.21.15.78:0/1406384805 >> 172.21.15.78:0/1406384805 conn(0x7f56ec073e00 msgr2=0x7f56ec074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.950+0000 7fb9637fe640 1 -- 172.21.15.78:0/2887132428 --> [v2:172.21.15.78:6824/636523247,v1:172.21.15.78:6825/636523247] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb958002d50 con 0x7fb95c075a20 2024-09-15T22:09:37.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.950+0000 7fb96dffb640 1 -- 172.21.15.78:0/2887132428 <== osd.2 v2:172.21.15.78:6824/636523247 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb958002d50 con 0x7fb95c075a20 2024-09-15T22:09:37.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.951+0000 7fb4417fa640 1 -- 172.21.15.78:0/2488899931 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb43c01a070 con 0x7fb4440b1790 2024-09-15T22:09:37.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.951+0000 7fb9637fe640 1 -- 172.21.15.78:0/2887132428 >> [v2:172.21.15.78:6824/636523247,v1:172.21.15.78:6825/636523247] conn(0x7fb95c075a20 msgr2=0x7fb95c077e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.951+0000 7fb9637fe640 1 --2- 172.21.15.78:0/2887132428 >> [v2:172.21.15.78:6824/636523247,v1:172.21.15.78:6825/636523247] conn(0x7fb95c075a20 0x7fb95c077e60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.951+0000 7f150ffff640 1 -- 172.21.15.78:0/1122455198 --> [v2:172.21.15.175:6808/2386415083,v1:172.21.15.175:6809/2386415083] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f152c0b0ad0 con 0x7f1518076ab0 2024-09-15T22:09:37.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.951+0000 7fb4417fa640 1 --2- 172.21.15.78:0/2488899931 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb43006c380 0x7fb43006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.952+0000 7fb9637fe640 1 -- 172.21.15.78:0/2887132428 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb95c06c330 msgr2=0x7fb95c06e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.952+0000 7fb9637fe640 1 --2- 172.21.15.78:0/2887132428 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb95c06c330 0x7fb95c06e7f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb974034000 tx=0x7fb97402e000 comp rx=0 tx=0).stop 2024-09-15T22:09:37.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.952+0000 7fb9637fe640 1 -- 172.21.15.78:0/2887132428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb978146940 msgr2=0x7fb9781fec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.952+0000 7fb9637fe640 1 --2- 172.21.15.78:0/2887132428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb978146940 0x7fb9781fec70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb97000c8c0 tx=0x7fb97000cd80 comp rx=0 tx=0).stop 2024-09-15T22:09:37.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.951+0000 7fb4417fa640 1 -- 172.21.15.78:0/2488899931 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb43c08bc10 con 0x7fb4440b1790 2024-09-15T22:09:37.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.952+0000 7fb4417fa640 1 --2- 172.21.15.78:0/2488899931 >> [v2:172.21.15.175:6816/1803357070,v1:172.21.15.175:6817/1803357070] conn(0x7fb430075af0 0x7fb430077f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.952+0000 7f15227fc640 1 -- 172.21.15.78:0/1122455198 <== osd.7 v2:172.21.15.175:6808/2386415083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f152c0b0ad0 con 0x7f1518076ab0 2024-09-15T22:09:37.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.952+0000 7fb4417fa640 1 -- 172.21.15.78:0/2488899931 --> [v2:172.21.15.175:6816/1803357070,v1:172.21.15.175:6817/1803357070] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb43c020ec0 con 0x7fb430075af0 2024-09-15T22:09:37.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.952+0000 7fb4417fa640 1 -- 172.21.15.78:0/2488899931 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb43c08c000 con 0x7fb4440b1790 2024-09-15T22:09:37.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.952+0000 7fb443fff640 1 --2- 172.21.15.78:0/2488899931 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb43006c380 0x7fb43006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.952+0000 7fb4493ab640 1 --2- 172.21.15.78:0/2488899931 >> [v2:172.21.15.175:6816/1803357070,v1:172.21.15.175:6817/1803357070] conn(0x7fb430075af0 0x7fb430077f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.952+0000 7f150ffff640 1 -- 172.21.15.78:0/1122455198 >> [v2:172.21.15.175:6808/2386415083,v1:172.21.15.175:6809/2386415083] conn(0x7f1518076ab0 msgr2=0x7f1518078f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.952+0000 7fb443fff640 1 --2- 172.21.15.78:0/2488899931 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb43006c380 0x7fb43006e840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb438034000 tx=0x7fb43802c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.952+0000 7f150ffff640 1 --2- 172.21.15.78:0/1122455198 >> [v2:172.21.15.175:6808/2386415083,v1:172.21.15.175:6809/2386415083] conn(0x7f1518076ab0 0x7f1518078f50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.953+0000 7fb97dea9640 1 -- 172.21.15.78:0/2887132428 reap_dead start 2024-09-15T22:09:37.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.953+0000 7f150ffff640 1 -- 172.21.15.78:0/1122455198 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f151806c7f0 msgr2=0x7f151806ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.953+0000 7f150ffff640 1 --2- 172.21.15.78:0/1122455198 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f151806c7f0 0x7f151806ecb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f15280098c0 tx=0x7f1528008040 comp rx=0 tx=0).stop 2024-09-15T22:09:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.953+0000 7f150ffff640 1 -- 172.21.15.78:0/1122455198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c1d4d50 msgr2=0x7f152c1ea870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.953+0000 7f150ffff640 1 --2- 172.21.15.78:0/1122455198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f152c1d4d50 0x7f152c1ea870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f151c00d850 tx=0x7f151c00dd10 comp rx=0 tx=0).stop 2024-09-15T22:09:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.953+0000 7f56f1cc4640 1 -- 172.21.15.78:0/1406384805 shutdown_connections 2024-09-15T22:09:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.953+0000 7f56f1cc4640 1 -- 172.21.15.78:0/1406384805 wait complete. 2024-09-15T22:09:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.953+0000 7f15323f9640 1 -- 172.21.15.78:0/1122455198 reap_dead start 2024-09-15T22:09:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.953+0000 7f150ffff640 1 -- 172.21.15.78:0/1122455198 shutdown_connections 2024-09-15T22:09:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.953+0000 7f150ffff640 1 -- 172.21.15.78:0/1122455198 >> 172.21.15.78:0/1122455198 conn(0x7f152c0b8f80 msgr2=0x7f152c0b7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.953+0000 7fb4493ab640 1 --2- 172.21.15.78:0/2488899931 >> [v2:172.21.15.175:6816/1803357070,v1:172.21.15.175:6817/1803357070] conn(0x7fb430075af0 0x7fb430077f30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.953+0000 7f150ffff640 1 -- 172.21.15.78:0/1122455198 shutdown_connections 2024-09-15T22:09:37.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.953+0000 7f150ffff640 1 -- 172.21.15.78:0/1122455198 wait complete. 2024-09-15T22:09:37.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.954+0000 7fb9637fe640 1 -- 172.21.15.78:0/2887132428 shutdown_connections 2024-09-15T22:09:37.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.954+0000 7fb9637fe640 1 -- 172.21.15.78:0/2887132428 >> 172.21.15.78:0/2887132428 conn(0x7fb9780b9170 msgr2=0x7fb97814afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:37.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.954+0000 7fb9637fe640 1 -- 172.21.15.78:0/2887132428 shutdown_connections 2024-09-15T22:09:37.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.954+0000 7fb9637fe640 1 -- 172.21.15.78:0/2887132428 wait complete. 2024-09-15T22:09:37.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.954+0000 7f56f1cc4640 1 Processor -- start 2024-09-15T22:09:37.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.954+0000 7f56f1cc4640 1 -- start start 2024-09-15T22:09:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.956+0000 7f56f1cc4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56ec0b7390 0x7f56ec0bddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.956+0000 7f56f1cc4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56ec13c890 0x7f56ec0bb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.956+0000 7f56f1cc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56ec138ba0 0x7f56ec139020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.956+0000 7f56f1cc4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec0b64f0 con 0x7f56ec138ba0 2024-09-15T22:09:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.956+0000 7f56f1cc4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec141ac0 con 0x7f56ec0b7390 2024-09-15T22:09:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.956+0000 7f56f1cc4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f56ec0bcc30 con 0x7f56ec13c890 2024-09-15T22:09:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.956+0000 7f56f14c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56ec138ba0 0x7f56ec139020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.956+0000 7f56f14c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56ec138ba0 0x7f56ec139020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49860/0 (socket says 172.21.15.78:49860) 2024-09-15T22:09:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.956+0000 7f56f14c3640 1 -- 172.21.15.78:0/4045041290 learned_addr learned my addr 172.21.15.78:0/4045041290 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.957+0000 7fb4417fa640 1 -- 172.21.15.78:0/2488899931 <== osd.4 v2:172.21.15.175:6816/1803357070 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb43c020ec0 con 0x7fb430075af0 2024-09-15T22:09:37.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.957+0000 7f56e3fff640 1 --2- 172.21.15.78:0/4045041290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56ec13c890 0x7f56ec0bb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:37.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.957+0000 7f56f14c3640 1 -- 172.21.15.78:0/4045041290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56ec13c890 msgr2=0x7f56ec0bb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:37.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.957+0000 7f56f14c3640 1 --2- 172.21.15.78:0/4045041290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56ec13c890 0x7f56ec0bb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.957+0000 7f56f14c3640 1 -- 172.21.15.78:0/4045041290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56ec0b7390 msgr2=0x7f56ec0bddd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:09:37.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.957+0000 7f56f14c3640 1 --2- 172.21.15.78:0/4045041290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56ec0b7390 0x7f56ec0bddd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:37.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.957+0000 7f56f14c3640 1 -- 172.21.15.78:0/4045041290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec139620 con 0x7f56ec138ba0 2024-09-15T22:09:37.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.961+0000 7f56f14c3640 1 --2- 172.21.15.78:0/4045041290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56ec138ba0 0x7f56ec139020 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f56e400e850 tx=0x7f56e400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:37.996 INFO:teuthology.orchestra.run.smithi078.stdout:60129542154 2024-09-15T22:09:37.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.962+0000 7f56e17fa640 1 -- 172.21.15.78:0/4045041290 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4017070 con 0x7f56ec138ba0 2024-09-15T22:09:37.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.962+0000 7f56f1cc4640 1 -- 172.21.15.78:0/4045041290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ec0bc950 con 0x7f56ec138ba0 2024-09-15T22:09:37.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.962+0000 7f56f1cc4640 1 -- 172.21.15.78:0/4045041290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ec1e0290 con 0x7f56ec138ba0 2024-09-15T22:09:37.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.963+0000 7f56e17fa640 1 -- 172.21.15.78:0/4045041290 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e400c8e0 con 0x7f56ec138ba0 2024-09-15T22:09:37.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.964+0000 7f56e17fa640 1 -- 172.21.15.78:0/4045041290 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e400ccd0 con 0x7f56ec138ba0 2024-09-15T22:09:37.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.964+0000 7f56f1cc4640 1 -- 172.21.15.78:0/4045041290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f56cc001030 con 0x7f56ec138ba0 2024-09-15T22:09:37.997 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T22:09:37.998 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2024-09-15T22:09:37.998 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T22:09:37.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.967+0000 7f56e17fa640 1 -- 172.21.15.78:0/4045041290 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f56e401a070 con 0x7f56ec138ba0 2024-09-15T22:09:37.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.967+0000 7f56e17fa640 1 --2- 172.21.15.78:0/4045041290 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f56d806c300 0x7f56d806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:37.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.968+0000 7f56e17fa640 1 -- 172.21.15.78:0/4045041290 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f56e408bcd0 con 0x7f56ec138ba0 2024-09-15T22:09:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.968+0000 7f56e17fa640 1 --2- 172.21.15.78:0/4045041290 >> [v2:172.21.15.175:6824/2221415707,v1:172.21.15.175:6825/2221415707] conn(0x7f56d8075a70 0x7f56d8077eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.968+0000 7f56e17fa640 1 -- 172.21.15.78:0/4045041290 --> [v2:172.21.15.175:6824/2221415707,v1:172.21.15.175:6825/2221415707] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56e4026e50 con 0x7f56d8075a70 2024-09-15T22:09:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.968+0000 7f56e17fa640 1 -- 172.21.15.78:0/4045041290 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f56e408c1b0 con 0x7f56ec138ba0 2024-09-15T22:09:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.968+0000 7f56e3fff640 1 --2- 172.21.15.78:0/4045041290 >> [v2:172.21.15.175:6824/2221415707,v1:172.21.15.175:6825/2221415707] conn(0x7f56d8075a70 0x7f56d8077eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.969+0000 7f56f0cc2640 1 --2- 172.21.15.78:0/4045041290 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f56d806c300 0x7f56d806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.970+0000 7f56f0cc2640 1 --2- 172.21.15.78:0/4045041290 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f56d806c300 0x7f56d806e7c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56e8034000 tx=0x7f56e802f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.971+0000 7f56e3fff640 1 --2- 172.21.15.78:0/4045041290 >> [v2:172.21.15.175:6824/2221415707,v1:172.21.15.175:6825/2221415707] conn(0x7f56d8075a70 0x7f56d8077eb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.001 INFO:teuthology.orchestra.run.smithi078.stdout:60129542152 2024-09-15T22:09:38.001 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-15T22:09:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.971+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/2201610168 --> [v2:172.21.15.175:6800/1974018373,v1:172.21.15.175:6801/1974018373] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2f04002d50 con 0x7f2f10075af0 2024-09-15T22:09:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.972+0000 7f56e17fa640 1 -- 172.21.15.78:0/4045041290 <== osd.5 v2:172.21.15.175:6824/2221415707 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f56e4026e50 con 0x7f56d8075a70 2024-09-15T22:09:38.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.972+0000 7f2f217fa640 1 -- 172.21.15.78:0/2201610168 <== osd.6 v2:172.21.15.175:6800/1974018373 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2f04002d50 con 0x7f2f10075af0 2024-09-15T22:09:38.004 INFO:teuthology.orchestra.run.smithi078.stdout:60129542153 2024-09-15T22:09:38.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T22:09:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.972+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/2201610168 >> [v2:172.21.15.175:6800/1974018373,v1:172.21.15.175:6801/1974018373] conn(0x7f2f10075af0 msgr2=0x7f2f10077f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.972+0000 7f2f2ac1e640 1 --2- 172.21.15.78:0/2201610168 >> [v2:172.21.15.175:6800/1974018373,v1:172.21.15.175:6801/1974018373] conn(0x7f2f10075af0 0x7f2f10077f30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.972+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/2201610168 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f2f1006c380 msgr2=0x7f2f1006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.972+0000 7f2f2ac1e640 1 --2- 172.21.15.78:0/2201610168 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f2f1006c380 0x7f2f1006e840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2f14007fd0 tx=0x7f2f140079a0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.972+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/2201610168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f24149000 msgr2=0x7f2f2412e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.972+0000 7f2f2ac1e640 1 --2- 172.21.15.78:0/2201610168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f24149000 0x7f2f2412e0e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00b990 tx=0x7f2f1c00be50 comp rx=0 tx=0).stop 2024-09-15T22:09:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.972+0000 7f2f291bb640 1 -- 172.21.15.78:0/2201610168 reap_dead start 2024-09-15T22:09:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.972+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/2201610168 shutdown_connections 2024-09-15T22:09:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.972+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/2201610168 >> 172.21.15.78:0/2201610168 conn(0x7f2f240b9170 msgr2=0x7f2f2414a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.972+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/2201610168 shutdown_connections 2024-09-15T22:09:38.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.972+0000 7f2f2ac1e640 1 -- 172.21.15.78:0/2201610168 wait complete. 2024-09-15T22:09:38.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.979+0000 7fdbcbeac640 1 -- 172.21.15.78:0/319059249 --> [v2:172.21.15.78:6816/3548923409,v1:172.21.15.78:6817/3548923409] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdbac005c40 con 0x7fdbac001650 2024-09-15T22:09:38.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.980+0000 7fdbba7fc640 1 -- 172.21.15.78:0/319059249 <== osd.0 v2:172.21.15.78:6816/3548923409 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdbac005c40 con 0x7fdbac001650 2024-09-15T22:09:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.980+0000 7fdbcbeac640 1 -- 172.21.15.78:0/319059249 >> [v2:172.21.15.78:6816/3548923409,v1:172.21.15.78:6817/3548923409] conn(0x7fdbac001650 msgr2=0x7fdbac003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.980+0000 7fdbcbeac640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.78:6816/3548923409,v1:172.21.15.78:6817/3548923409] conn(0x7fdbac001650 0x7fdbac003b10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.980+0000 7fdbcbeac640 1 -- 172.21.15.78:0/319059249 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fdba806c2b0 msgr2=0x7fdba806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.980+0000 7fdbcbeac640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fdba806c2b0 0x7fdba806e770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc001560 tx=0x7fdbbc007000 comp rx=0 tx=0).stop 2024-09-15T22:09:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.980+0000 7fdbcbeac640 1 -- 172.21.15.78:0/319059249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbc40ac1c0 msgr2=0x7fdbc40aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.981+0000 7fdbcbeac640 1 --2- 172.21.15.78:0/319059249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbc40ac1c0 0x7fdbc40aa470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009e50 tx=0x7fdbb400c4c0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.981+0000 7fdbca449640 1 -- 172.21.15.78:0/319059249 reap_dead start 2024-09-15T22:09:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.981+0000 7fdbcbeac640 1 -- 172.21.15.78:0/319059249 shutdown_connections 2024-09-15T22:09:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.981+0000 7fdbcbeac640 1 -- 172.21.15.78:0/319059249 >> 172.21.15.78:0/319059249 conn(0x7fdbc406bc10 msgr2=0x7fdbc40b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.981+0000 7fdbcbeac640 1 -- 172.21.15.78:0/319059249 shutdown_connections 2024-09-15T22:09:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.981+0000 7fdbcbeac640 1 -- 172.21.15.78:0/319059249 wait complete. 2024-09-15T22:09:38.011 INFO:teuthology.orchestra.run.smithi078.stdout:60129542152 2024-09-15T22:09:38.011 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-15T22:09:38.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.985+0000 7fb449bac640 1 -- 172.21.15.78:0/2488899931 --> [v2:172.21.15.175:6816/1803357070,v1:172.21.15.175:6817/1803357070] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb4440b31a0 con 0x7fb430075af0 2024-09-15T22:09:38.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.985+0000 7fb4417fa640 1 -- 172.21.15.78:0/2488899931 <== osd.4 v2:172.21.15.175:6816/1803357070 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb4440b31a0 con 0x7fb430075af0 2024-09-15T22:09:38.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.986+0000 7fb449bac640 1 -- 172.21.15.78:0/2488899931 >> [v2:172.21.15.175:6816/1803357070,v1:172.21.15.175:6817/1803357070] conn(0x7fb430075af0 msgr2=0x7fb430077f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.986+0000 7fb449bac640 1 --2- 172.21.15.78:0/2488899931 >> [v2:172.21.15.175:6816/1803357070,v1:172.21.15.175:6817/1803357070] conn(0x7fb430075af0 0x7fb430077f30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.986+0000 7fb449bac640 1 -- 172.21.15.78:0/2488899931 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb43006c380 msgr2=0x7fb43006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.986+0000 7fb449bac640 1 --2- 172.21.15.78:0/2488899931 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb43006c380 0x7fb43006e840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb438034000 tx=0x7fb43802c000 comp rx=0 tx=0).stop 2024-09-15T22:09:38.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.986+0000 7fb449bac640 1 -- 172.21.15.78:0/2488899931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4440b1790 msgr2=0x7fb444140d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.986+0000 7fb449bac640 1 --2- 172.21.15.78:0/2488899931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4440b1790 0x7fb444140d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00cbf0 tx=0x7fb43c00a430 comp rx=0 tx=0).stop 2024-09-15T22:09:38.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.986+0000 7fb4493ab640 1 -- 172.21.15.78:0/2488899931 reap_dead start 2024-09-15T22:09:38.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.986+0000 7fb449bac640 1 -- 172.21.15.78:0/2488899931 shutdown_connections 2024-09-15T22:09:38.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.986+0000 7fb449bac640 1 -- 172.21.15.78:0/2488899931 >> 172.21.15.78:0/2488899931 conn(0x7fb4440b90f0 msgr2=0x7fb4440b5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.986+0000 7fb449bac640 1 -- 172.21.15.78:0/2488899931 shutdown_connections 2024-09-15T22:09:38.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.986+0000 7fb449bac640 1 -- 172.21.15.78:0/2488899931 wait complete. 2024-09-15T22:09:38.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.986+0000 7f56f1cc4640 1 -- 172.21.15.78:0/4045041290 --> [v2:172.21.15.175:6824/2221415707,v1:172.21.15.175:6825/2221415707] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f56cc002dd0 con 0x7f56d8075a70 2024-09-15T22:09:38.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.987+0000 7f56e17fa640 1 -- 172.21.15.78:0/4045041290 <== osd.5 v2:172.21.15.175:6824/2221415707 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f56cc002dd0 con 0x7f56d8075a70 2024-09-15T22:09:38.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.987+0000 7f56f1cc4640 1 -- 172.21.15.78:0/4045041290 >> [v2:172.21.15.175:6824/2221415707,v1:172.21.15.175:6825/2221415707] conn(0x7f56d8075a70 msgr2=0x7f56d8077eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.987+0000 7f56f1cc4640 1 --2- 172.21.15.78:0/4045041290 >> [v2:172.21.15.175:6824/2221415707,v1:172.21.15.175:6825/2221415707] conn(0x7f56d8075a70 0x7f56d8077eb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.987+0000 7f56f1cc4640 1 -- 172.21.15.78:0/4045041290 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f56d806c300 msgr2=0x7f56d806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.987+0000 7f56f1cc4640 1 --2- 172.21.15.78:0/4045041290 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f56d806c300 0x7f56d806e7c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56e8034000 tx=0x7f56e802f000 comp rx=0 tx=0).stop 2024-09-15T22:09:38.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.987+0000 7f56f1cc4640 1 -- 172.21.15.78:0/4045041290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56ec138ba0 msgr2=0x7f56ec139020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.987+0000 7f56f1cc4640 1 --2- 172.21.15.78:0/4045041290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56ec138ba0 0x7f56ec139020 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f56e400e850 tx=0x7f56e400ed10 comp rx=0 tx=0).stop 2024-09-15T22:09:38.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.987+0000 7f56f14c3640 1 -- 172.21.15.78:0/4045041290 reap_dead start 2024-09-15T22:09:38.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.987+0000 7f56f1cc4640 1 -- 172.21.15.78:0/4045041290 shutdown_connections 2024-09-15T22:09:38.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.987+0000 7f56f1cc4640 1 -- 172.21.15.78:0/4045041290 >> 172.21.15.78:0/4045041290 conn(0x7f56ec073e00 msgr2=0x7f56ec0b7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.988+0000 7f56f1cc4640 1 -- 172.21.15.78:0/4045041290 shutdown_connections 2024-09-15T22:09:38.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:37.988+0000 7f56f1cc4640 1 -- 172.21.15.78:0/4045041290 wait complete. 2024-09-15T22:09:38.018 INFO:teuthology.orchestra.run.smithi078.stdout:60129542153 2024-09-15T22:09:38.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T22:09:38.020 INFO:teuthology.orchestra.run.smithi078.stdout:60129542153 2024-09-15T22:09:38.020 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T22:09:38.021 INFO:teuthology.orchestra.run.smithi078.stdout:60129542154 2024-09-15T22:09:38.021 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T22:09:38.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.211+0000 7f79e1001640 1 Processor -- start 2024-09-15T22:09:38.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.211+0000 7f79e1001640 1 -- start start 2024-09-15T22:09:38.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.212+0000 7f79e1001640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79dc0b9af0 0x7f79dc0ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.212+0000 7f79e1001640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f79dc0b9ed0 0x7f79dc14f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.212+0000 7f79e1001640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79dc14f940 con 0x7f79dc0b7b40 2024-09-15T22:09:38.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.212+0000 7f79e1001640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f79dc14f720 con 0x7f79dc0b9ed0 2024-09-15T22:09:38.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.212+0000 7f79e1001640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f79dc14ff90 con 0x7f79dc0b9af0 2024-09-15T22:09:38.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.212+0000 7f79e0800640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f79dc0b7b40 0x7f79dc14be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57038/0 (socket says 172.21.15.78:57038) 2024-09-15T22:09:38.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.212+0000 7f79e0800640 1 -- 172.21.15.78:0/3645298525 learned_addr learned my addr 172.21.15.78:0/3645298525 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:38.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.213+0000 7f3851482640 1 Processor -- start 2024-09-15T22:09:38.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.213+0000 7f3851482640 1 -- start start 2024-09-15T22:09:38.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.213+0000 7f79d259c640 1 --2- 172.21.15.78:0/3645298525 >> v2:172.21.15.175:3300/0 conn(0x7f79dc0b9ed0 0x7f79dc14f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.213+0000 7f79da59c640 1 -- 172.21.15.78:0/3645298525 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4183511040 0 0) 0x7f79dc14f940 con 0x7f79dc0b7b40 2024-09-15T22:09:38.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.213+0000 7f79da59c640 1 -- 172.21.15.78:0/3645298525 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79c8003520 con 0x7f79dc0b7b40 2024-09-15T22:09:38.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f3851482640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f384c072d30 0x7f384c149110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f3851482640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f384c149650 con 0x7f384c145d40 2024-09-15T22:09:38.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f3851482640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f384c0b2850 con 0x7f384c073110 2024-09-15T22:09:38.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f3851482640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f384c0b5cb0 con 0x7f384c072d30 2024-09-15T22:09:38.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.213+0000 7f79da59c640 1 -- 172.21.15.78:0/3645298525 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3288424265 0 0) 0x7f79c8003520 con 0x7f79dc0b7b40 2024-09-15T22:09:38.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f79da59c640 1 -- 172.21.15.78:0/3645298525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79dc0b9af0 msgr2=0x7f79dc0ba3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:38.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f79da59c640 1 --2- 172.21.15.78:0/3645298525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79dc0b9af0 0x7f79dc0ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f79da59c640 1 -- 172.21.15.78:0/3645298525 >> v2:172.21.15.175:3300/0 conn(0x7f79dc0b9ed0 msgr2=0x7f79dc14f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:38.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f79da59c640 1 --2- 172.21.15.78:0/3645298525 >> v2:172.21.15.175:3300/0 conn(0x7f79dc0b9ed0 0x7f79dc14f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f79da59c640 1 -- 172.21.15.78:0/3645298525 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79dc14fc20 con 0x7f79dc0b7b40 2024-09-15T22:09:38.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f79da59c640 1 -- 172.21.15.78:0/3645298525 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3961011974 0 0) 0x7f79d40019f0 con 0x7f79dc0b7b40 2024-09-15T22:09:38.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f79da59c640 1 -- 172.21.15.78:0/3645298525 >> v1:172.21.15.78:6789/0 conn(0x7f79dc0b7b40 legacy=0x7f79dc14be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f79da59c640 1 --2- 172.21.15.78:0/3645298525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c80039b0 0x7f79c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f79da59c640 1 --2- 172.21.15.78:0/3645298525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79c8004800 0x7f79c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f79da59c640 1 --2- 172.21.15.78:0/3645298525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79c80051c0 0x7f79c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f79da59c640 1 -- 172.21.15.78:0/3645298525 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc14f720 con 0x7f79c80051c0 2024-09-15T22:09:38.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f79da59c640 1 -- 172.21.15.78:0/3645298525 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc14ff90 con 0x7f79c80039b0 2024-09-15T22:09:38.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.214+0000 7f79da59c640 1 -- 172.21.15.78:0/3645298525 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f79c800c110 con 0x7f79c8004800 2024-09-15T22:09:38.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.215+0000 7f384b7fe640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f384c073110 0x7f384c13f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.78:44504/0 (socket says 172.21.15.78:44504) 2024-09-15T22:09:38.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.215+0000 7f384b7fe640 1 -- 172.21.15.78:0/2543748249 learned_addr learned my addr 172.21.15.78:0/2543748249 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:38.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.215+0000 7f79e0800640 1 --2- 172.21.15.78:0/3645298525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79c80051c0 0x7f79c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.216+0000 7f384bfff640 1 --2- 172.21.15.78:0/2543748249 >> v2:172.21.15.175:3300/0 conn(0x7f384c072d30 0x7f384c149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.217+0000 7f384affd640 1 -- 172.21.15.78:0/2543748249 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1294612826 0 0) 0x7f384c0b2850 con 0x7f384c073110 2024-09-15T22:09:38.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.215+0000 7f79e0800640 1 -- 172.21.15.78:0/3645298525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79c8004800 msgr2=0x7f79c8004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:09:38.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.217+0000 7f384affd640 1 -- 172.21.15.78:0/2543748249 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3834003520 con 0x7f384c073110 2024-09-15T22:09:38.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.217+0000 7f384bfff640 1 -- 172.21.15.78:0/2543748249 >> v1:172.21.15.175:6789/0 conn(0x7f384c073110 legacy=0x7f384c13f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.215+0000 7f79e0800640 1 --2- 172.21.15.78:0/3645298525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79c8004800 0x7f79c8004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.215+0000 7f79e0800640 1 -- 172.21.15.78:0/3645298525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c80039b0 msgr2=0x7f79c8003dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:09:38.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.215+0000 7f79e0800640 1 --2- 172.21.15.78:0/3645298525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c80039b0 0x7f79c8003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.215+0000 7f79e0800640 1 -- 172.21.15.78:0/3645298525 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c8003520 con 0x7f79c80051c0 2024-09-15T22:09:38.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.217+0000 7f79e0800640 1 --2- 172.21.15.78:0/3645298525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79c80051c0 0x7f79c800b9c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f79d400a7d0 tx=0x7f79c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d751f88932a412 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.217+0000 7f79da59c640 1 -- 172.21.15.78:0/3645298525 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d400a3f0 con 0x7f79c80051c0 2024-09-15T22:09:38.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.217+0000 7f384bfff640 1 -- 172.21.15.78:0/2543748249 >> v1:172.21.15.78:6789/0 conn(0x7f384c145d40 legacy=0x7f384c14ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:38.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.217+0000 7f79da59c640 1 -- 172.21.15.78:0/3645298525 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d402f070 con 0x7f79c80051c0 2024-09-15T22:09:38.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.217+0000 7f384bfff640 1 -- 172.21.15.78:0/2543748249 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384c1498e0 con 0x7f384c072d30 2024-09-15T22:09:38.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.218+0000 7f79da59c640 1 -- 172.21.15.78:0/3645298525 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d402bc90 con 0x7f79c80051c0 2024-09-15T22:09:38.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.218+0000 7f79e1001640 1 -- 172.21.15.78:0/3645298525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79c80051c0 msgr2=0x7f79c800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.218+0000 7f5f79b6f640 1 Processor -- start 2024-09-15T22:09:38.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.218+0000 7f5f79b6f640 1 -- start start 2024-09-15T22:09:38.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.218+0000 7f79e1001640 1 --2- 172.21.15.78:0/3645298525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79c80051c0 0x7f79c800b9c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f79d400a7d0 tx=0x7f79c8005830 comp rx=0 tx=0).stop 2024-09-15T22:09:38.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.218+0000 7f79e0800640 1 -- 172.21.15.78:0/3645298525 reap_dead start 2024-09-15T22:09:38.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.219+0000 7f79e1001640 1 -- 172.21.15.78:0/3645298525 shutdown_connections 2024-09-15T22:09:38.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.219+0000 7f79e1001640 1 -- 172.21.15.78:0/3645298525 >> 172.21.15.78:0/3645298525 conn(0x7f79dc0bb970 msgr2=0x7f79dc0bbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.219+0000 7f79e1001640 1 -- 172.21.15.78:0/3645298525 shutdown_connections 2024-09-15T22:09:38.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.219+0000 7f05d1084640 1 Processor -- start 2024-09-15T22:09:38.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.219+0000 7f05d1084640 1 -- start start 2024-09-15T22:09:38.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.219+0000 7f384bfff640 1 --2- 172.21.15.78:0/2543748249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f384c072d30 0x7f384c149110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f383c0097a0 tx=0x7f383c02a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=638a10886c600da8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.220+0000 7f05d1084640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f05c401b200 0x7f05c40d2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.219+0000 7f384affd640 1 -- 172.21.15.78:0/2543748249 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c037070 con 0x7f384c072d30 2024-09-15T22:09:38.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.220+0000 7f384affd640 1 -- 172.21.15.78:0/2543748249 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f383c02ae50 con 0x7f384c072d30 2024-09-15T22:09:38.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.220+0000 7f384affd640 1 -- 172.21.15.78:0/2543748249 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c032660 con 0x7f384c072d30 2024-09-15T22:09:38.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.219+0000 7f5f79b6f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5f7406c4e0 0x7f5f7409c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.220+0000 7f5f79b6f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f7406c8c0 con 0x7f5f7413fdd0 2024-09-15T22:09:38.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.220+0000 7f5f79b6f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f740b59e0 con 0x7f5f7413f960 2024-09-15T22:09:38.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.220+0000 7f5f79b6f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5f7409d750 con 0x7f5f7406c4e0 2024-09-15T22:09:38.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.220+0000 7f5f73fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5f7413fdd0 0x7f5f74150160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57052/0 (socket says 172.21.15.78:57052) 2024-09-15T22:09:38.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.220+0000 7f5f73fff640 1 -- 172.21.15.78:0/1888137937 learned_addr learned my addr 172.21.15.78:0/1888137937 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:38.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.220+0000 7f5f737fe640 1 --2- 172.21.15.78:0/1888137937 >> v2:172.21.15.175:3300/0 conn(0x7f5f7406c4e0 0x7f5f7409c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.220+0000 7f05cb7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f05c401b200 0x7f05c40d2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.220+0000 7f05d0883640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f05c40d3310 0x7f05c40c9ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57058/0 (socket says 172.21.15.78:57058) 2024-09-15T22:09:38.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.220+0000 7f05cb7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f05c401b200 0x7f05c40d2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.78:33248/0 (socket says 172.21.15.78:33248) 2024-09-15T22:09:38.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.220+0000 7f05d1084640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c40d1800 con 0x7f05c40d3310 2024-09-15T22:09:38.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.220+0000 7f05d1084640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c4007060 con 0x7f05c4006c80 2024-09-15T22:09:38.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.220+0000 7f05d1084640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f05c401ba90 con 0x7f05c401b200 2024-09-15T22:09:38.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.221+0000 7f3851482640 1 -- 172.21.15.78:0/2543748249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f384c072d30 msgr2=0x7f384c149110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.221+0000 7f05d0883640 1 -- 172.21.15.78:0/2111361207 learned_addr learned my addr 172.21.15.78:0/2111361207 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:38.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.221+0000 7fb8f39d6640 1 Processor -- start 2024-09-15T22:09:38.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.219+0000 7f79e1001640 1 -- 172.21.15.78:0/3645298525 wait complete. 2024-09-15T22:09:38.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.221+0000 7f5f737fe640 1 -- 172.21.15.78:0/1888137937 >> v1:172.21.15.175:6789/0 conn(0x7f5f7413f960 legacy=0x7f5f7409e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:38.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.221+0000 7f5f737fe640 1 -- 172.21.15.78:0/1888137937 >> v1:172.21.15.78:6789/0 conn(0x7f5f7413fdd0 legacy=0x7f5f74150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.221+0000 7f05caffd640 1 -- 172.21.15.78:0/2111361207 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4248766428 0 0) 0x7f05cc050ea0 con 0x7f05c40d3310 2024-09-15T22:09:38.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.221+0000 7f05cb7fe640 1 -- 172.21.15.78:0/2111361207 >> v1:172.21.15.175:6789/0 conn(0x7f05c4006c80 legacy=0x7f05c40d0b10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:09:38.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.221+0000 7f05cb7fe640 1 -- 172.21.15.78:0/2111361207 >> v1:172.21.15.78:6789/0 conn(0x7f05c40d3310 legacy=0x7f05c40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.221+0000 7f05cb7fe640 1 -- 172.21.15.78:0/2111361207 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c40d0330 con 0x7f05c401b200 2024-09-15T22:09:38.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7f3851482640 1 --2- 172.21.15.78:0/2543748249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f384c072d30 0x7f384c149110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f383c0097a0 tx=0x7f383c02a140 comp rx=0 tx=0).stop 2024-09-15T22:09:38.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7f3851482640 1 -- 172.21.15.78:0/2543748249 shutdown_connections 2024-09-15T22:09:38.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7f3851482640 1 --2- 172.21.15.78:0/2543748249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f384c072d30 0x7f384c149110 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7f3851482640 1 -- 172.21.15.78:0/2543748249 >> 172.21.15.78:0/2543748249 conn(0x7f384c0bb2b0 msgr2=0x7f384c0bb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7f36dfb28640 1 Processor -- start 2024-09-15T22:09:38.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.221+0000 7fb8f39d6640 1 -- start start 2024-09-15T22:09:38.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.221+0000 7f79e1001640 1 Processor -- start 2024-09-15T22:09:38.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7f79e1001640 1 -- start start 2024-09-15T22:09:38.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7f05cb7fe640 1 --2- 172.21.15.78:0/2111361207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c401b200 0x7f05c40d2dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f05b80097a0 tx=0x7f05b802a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75dbfa8122c82d6d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7f3851482640 1 -- 172.21.15.78:0/2543748249 shutdown_connections 2024-09-15T22:09:38.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7f3851482640 1 -- 172.21.15.78:0/2543748249 wait complete. 2024-09-15T22:09:38.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7fb8f39d6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ec071950 0x7fb8ec142b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7fb8f39d6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8ec1430b0 0x7fb8ec0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7fb8f39d6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8ec0725c0 0x7fb8ec0b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7fb8f39d6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fb8ec071d30 con 0x7fb8ec0725c0 2024-09-15T22:09:38.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7fb8f39d6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb8ec0bbc20 con 0x7fb8ec1430b0 2024-09-15T22:09:38.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7f5f737fe640 1 -- 172.21.15.78:0/1888137937 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f740b01b0 con 0x7f5f7406c4e0 2024-09-15T22:09:38.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7fb8f39d6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb8ec0bbf00 con 0x7fb8ec071950 2024-09-15T22:09:38.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7fb8f1f73640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8ec0725c0 0x7fb8ec0b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7fb8f0f71640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8ec1430b0 0x7fb8ec0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.222+0000 7fb8f1772640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ec071950 0x7fb8ec142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.223+0000 7fb8f1f73640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8ec0725c0 0x7fb8ec0b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49878/0 (socket says 172.21.15.78:49878) 2024-09-15T22:09:38.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.223+0000 7fb8f1f73640 1 -- 172.21.15.78:0/874072232 learned_addr learned my addr 172.21.15.78:0/874072232 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:38.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.223+0000 7f05caffd640 1 -- 172.21.15.78:0/2111361207 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b8037070 con 0x7f05c401b200 2024-09-15T22:09:38.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.223+0000 7f05caffd640 1 -- 172.21.15.78:0/2111361207 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b8032440 con 0x7f05c401b200 2024-09-15T22:09:38.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f79e1001640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c80051c0 0x7f79dc148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f79e1001640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79dc1ea2b0 0x7f79dc1ea730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f79e1001640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79dc1e35b0 0x7f79dc1e3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f79e1001640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc14c5a0 con 0x7f79dc1e35b0 2024-09-15T22:09:38.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f79e1001640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc0b8200 con 0x7f79c80051c0 2024-09-15T22:09:38.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f79e1001640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f79dc14c720 con 0x7f79dc1ea2b0 2024-09-15T22:09:38.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.223+0000 7f36dfb28640 1 -- start start 2024-09-15T22:09:38.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f36dfb28640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f36d806c4e0 0x7f36d80ae650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f36dfb28640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36d809f240 0x7f36d8144230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f36dfb28640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f36d8144770 0x7f36d8146440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f36dfb28640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f36d8143da0 con 0x7f36d806c4e0 2024-09-15T22:09:38.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f36dfb28640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f36d806c8c0 con 0x7f36d8144770 2024-09-15T22:09:38.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f36dfb28640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f36d80aeb90 con 0x7f36d809f240 2024-09-15T22:09:38.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.223+0000 7f5f737fe640 1 --2- 172.21.15.78:0/1888137937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f7406c4e0 0x7f5f7409c290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5f640097a0 tx=0x7f5f6402a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83c2dd5f4d9ded28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f05d1084640 1 -- 172.21.15.78:0/2111361207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c401b200 msgr2=0x7f05c40d2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f36dd8c4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f36d806c4e0 0x7f36d80ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f36dd8c4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f36d806c4e0 0x7f36d80ae650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49894/0 (socket says 172.21.15.78:49894) 2024-09-15T22:09:38.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f36dd8c4640 1 -- 172.21.15.78:0/1199570385 learned_addr learned my addr 172.21.15.78:0/1199570385 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:38.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f5f727fc640 1 -- 172.21.15.78:0/1888137937 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f64037070 con 0x7f5f7406c4e0 2024-09-15T22:09:38.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f5f727fc640 1 -- 172.21.15.78:0/1888137937 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f6402ad60 con 0x7f5f7406c4e0 2024-09-15T22:09:38.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f36de0c5640 1 --2- 172.21.15.78:0/1199570385 >> v2:172.21.15.175:3300/0 conn(0x7f36d8144770 0x7f36d8146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.223+0000 7fb8f1f73640 1 -- 172.21.15.78:0/874072232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ec071950 msgr2=0x7fb8ec142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:38.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.223+0000 7fb8f1f73640 1 --2- 172.21.15.78:0/874072232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ec071950 0x7fb8ec142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.223+0000 7fb8f1f73640 1 -- 172.21.15.78:0/874072232 >> v2:172.21.15.175:3300/0 conn(0x7fb8ec1430b0 msgr2=0x7fb8ec0b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:38.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.223+0000 7fb8f1f73640 1 --2- 172.21.15.78:0/874072232 >> v2:172.21.15.175:3300/0 conn(0x7fb8ec1430b0 0x7fb8ec0b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.223+0000 7fb8f1f73640 1 -- 172.21.15.78:0/874072232 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ec072c90 con 0x7fb8ec0725c0 2024-09-15T22:09:38.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f3851482640 1 Processor -- start 2024-09-15T22:09:38.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f05d1084640 1 --2- 172.21.15.78:0/2111361207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c401b200 0x7f05c40d2dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f05b80097a0 tx=0x7f05b802a160 comp rx=0 tx=0).stop 2024-09-15T22:09:38.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f05d1084640 1 -- 172.21.15.78:0/2111361207 shutdown_connections 2024-09-15T22:09:38.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f05d1084640 1 --2- 172.21.15.78:0/2111361207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c401b200 0x7f05c40d2dd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f05d1084640 1 -- 172.21.15.78:0/2111361207 >> 172.21.15.78:0/2111361207 conn(0x7f05c4009280 msgr2=0x7f05c4009690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7fb8f0f71640 1 --2- 172.21.15.78:0/874072232 >> v2:172.21.15.175:3300/0 conn(0x7fb8ec1430b0 0x7fb8ec0b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:38.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7f3851482640 1 -- start start 2024-09-15T22:09:38.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7f79dad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c80051c0 0x7f79dc148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7f79dad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c80051c0 0x7f79dc148a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.78:33262/0 (socket says 172.21.15.78:33262) 2024-09-15T22:09:38.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7fb8f1f73640 1 --2- 172.21.15.78:0/874072232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8ec0725c0 0x7fb8ec0b5e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0b7270 tx=0x7fb8e8032b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507c926082eb0a8d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7f79dad9d640 1 -- 172.21.15.78:0/3965254825 learned_addr learned my addr 172.21.15.78:0/3965254825 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:38.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7f36dd8c4640 1 -- 172.21.15.78:0/1199570385 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36d809f240 msgr2=0x7f36d8144230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:09:38.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7f36dd8c4640 1 --2- 172.21.15.78:0/1199570385 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36d809f240 0x7f36d8144230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7f36dd8c4640 1 -- 172.21.15.78:0/1199570385 >> v2:172.21.15.175:3300/0 conn(0x7f36d8144770 msgr2=0x7f36d8146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:38.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7f36dd8c4640 1 --2- 172.21.15.78:0/1199570385 >> v2:172.21.15.175:3300/0 conn(0x7f36d8144770 0x7f36d8146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7f36dd8c4640 1 -- 172.21.15.78:0/1199570385 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d80aee50 con 0x7f36d806c4e0 2024-09-15T22:09:38.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f05d1084640 1 -- 172.21.15.78:0/2111361207 shutdown_connections 2024-09-15T22:09:38.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f05d1084640 1 -- 172.21.15.78:0/2111361207 wait complete. 2024-09-15T22:09:38.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7fb8e3fff640 1 -- 172.21.15.78:0/874072232 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e800f2f0 con 0x7fb8ec0725c0 2024-09-15T22:09:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.224+0000 7f5f727fc640 1 -- 172.21.15.78:0/1888137937 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f64032660 con 0x7f5f7406c4e0 2024-09-15T22:09:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7f5f79b6f640 1 -- 172.21.15.78:0/1888137937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f7406c4e0 msgr2=0x7f5f7409c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7f5f79b6f640 1 --2- 172.21.15.78:0/1888137937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f7406c4e0 0x7f5f7409c290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5f640097a0 tx=0x7f5f6402a0d0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7f5f79b6f640 1 -- 172.21.15.78:0/1888137937 shutdown_connections 2024-09-15T22:09:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7f5f79b6f640 1 --2- 172.21.15.78:0/1888137937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f7406c4e0 0x7f5f7409c290 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.225+0000 7f5f79b6f640 1 -- 172.21.15.78:0/1888137937 >> 172.21.15.78:0/1888137937 conn(0x7f5f740b9170 msgr2=0x7f5f740b9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f5f79b6f640 1 -- 172.21.15.78:0/1888137937 shutdown_connections 2024-09-15T22:09:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f3851482640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f384c072d30 0x7f384c1d2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f79e0800640 1 --2- 172.21.15.78:0/3965254825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79dc1e35b0 0x7f79dc1e3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f79d259c640 1 --2- 172.21.15.78:0/3965254825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79dc1ea2b0 0x7f79dc1ea730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f79dad9d640 1 -- 172.21.15.78:0/3965254825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79dc1ea2b0 msgr2=0x7f79dc1ea730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f79dad9d640 1 --2- 172.21.15.78:0/3965254825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79dc1ea2b0 0x7f79dc1ea730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f79dad9d640 1 -- 172.21.15.78:0/3965254825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79dc1e35b0 msgr2=0x7f79dc1e3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f79dad9d640 1 --2- 172.21.15.78:0/3965254825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79dc1e35b0 0x7f79dc1e3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f79dad9d640 1 -- 172.21.15.78:0/3965254825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79dc0b4790 con 0x7f79c80051c0 2024-09-15T22:09:38.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f36dd8c4640 1 --2- 172.21.15.78:0/1199570385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d806c4e0 0x7f36d80ae650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f36d0007980 tx=0x7f36d002ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ae723abee29384 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f36dc8c2640 1 -- 172.21.15.78:0/1199570385 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d000be60 con 0x7f36d806c4e0 2024-09-15T22:09:38.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f384bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f384c072d30 0x7f384c1d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f384bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f384c072d30 0x7f384c1d2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49906/0 (socket says 172.21.15.78:49906) 2024-09-15T22:09:38.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f384bfff640 1 -- 172.21.15.78:0/2580057182 learned_addr learned my addr 172.21.15.78:0/2580057182 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:38.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f3851482640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f384c073110 0x7f384c1daf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f36dc8c2640 1 -- 172.21.15.78:0/1199570385 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d0030920 con 0x7f36d806c4e0 2024-09-15T22:09:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.226+0000 7f05d1084640 1 Processor -- start 2024-09-15T22:09:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.227+0000 7f3851482640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f384c145d40 0x7f384c1de4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.227+0000 7f384b7fe640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f384c073110 0x7f384c1daf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.227+0000 7f05d1084640 1 -- start start 2024-09-15T22:09:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.227+0000 7f3851482640 1 -- 172.21.15.78:0/2580057182 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f384c1458b0 con 0x7f384c072d30 2024-09-15T22:09:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.227+0000 7f3851482640 1 -- 172.21.15.78:0/2580057182 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f384c146190 con 0x7f384c073110 2024-09-15T22:09:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.227+0000 7f3850c81640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f384c145d40 0x7f384c1de4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.227+0000 7f3851482640 1 -- 172.21.15.78:0/2580057182 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f384c146310 con 0x7f384c145d40 2024-09-15T22:09:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.227+0000 7f36dfb28640 1 -- 172.21.15.78:0/1199570385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d806c4e0 msgr2=0x7f36d80ae650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.227+0000 7f36dfb28640 1 --2- 172.21.15.78:0/1199570385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d806c4e0 0x7f36d80ae650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f36d0007980 tx=0x7f36d002ec00 comp rx=0 tx=0).stop 2024-09-15T22:09:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f79dad9d640 1 --2- 172.21.15.78:0/3965254825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c80051c0 0x7f79dc148a20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f79c400b3c0 tx=0x7f79c400b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05d1084640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c4006c80 0x7f05c4022180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05d1084640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05c40d3310 0x7f05c4031870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05d1084640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c4031db0 0x7f05c40cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05d1084640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f05c401b7b0 con 0x7f05c4031db0 2024-09-15T22:09:38.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05d1084640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05c40d0680 con 0x7f05c4006c80 2024-09-15T22:09:38.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05d1084640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f05c4034260 con 0x7f05c40d3310 2024-09-15T22:09:38.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f3850c81640 1 -- 172.21.15.78:0/2580057182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f384c073110 msgr2=0x7f384c1daf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f3850c81640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f384c073110 0x7f384c1daf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f3850c81640 1 -- 172.21.15.78:0/2580057182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f384c072d30 msgr2=0x7f384c1d2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05d0883640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c4031db0 0x7f05c40cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05cbfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c4006c80 0x7f05c4022180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05d0883640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c4031db0 0x7f05c40cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49918/0 (socket says 172.21.15.78:49918) 2024-09-15T22:09:38.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05cbfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c4006c80 0x7f05c4022180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.78:33280/0 (socket says 172.21.15.78:33280) 2024-09-15T22:09:38.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05d0883640 1 -- 172.21.15.78:0/3939153845 learned_addr learned my addr 172.21.15.78:0/3939153845 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:38.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f3850c81640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f384c072d30 0x7f384c1d2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f3850c81640 1 -- 172.21.15.78:0/2580057182 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384c1d1980 con 0x7f384c145d40 2024-09-15T22:09:38.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f384bfff640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f384c072d30 0x7f384c1d2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:09:38.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.227+0000 7fb8e3fff640 1 -- 172.21.15.78:0/874072232 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e800e4e0 con 0x7fb8ec0725c0 2024-09-15T22:09:38.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.227+0000 7fb8e3fff640 1 -- 172.21.15.78:0/874072232 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e800e910 con 0x7fb8ec0725c0 2024-09-15T22:09:38.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7fb8f39d6640 1 -- 172.21.15.78:0/874072232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8ec0725c0 msgr2=0x7fb8ec0b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7fb8f39d6640 1 --2- 172.21.15.78:0/874072232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8ec0725c0 0x7fb8ec0b5e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0b7270 tx=0x7fb8e8032b10 comp rx=0 tx=0).stop 2024-09-15T22:09:38.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7fb8f39d6640 1 -- 172.21.15.78:0/874072232 shutdown_connections 2024-09-15T22:09:38.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7fb8f39d6640 1 --2- 172.21.15.78:0/874072232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8ec0725c0 0x7fb8ec0b5e00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f79d3fff640 1 -- 172.21.15.78:0/3965254825 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4011830 con 0x7f79c80051c0 2024-09-15T22:09:38.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f79e1001640 1 -- 172.21.15.78:0/3965254825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79dc0b5dd0 con 0x7f79c80051c0 2024-09-15T22:09:38.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f79e1001640 1 -- 172.21.15.78:0/3965254825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79dc0b5af0 con 0x7f79c80051c0 2024-09-15T22:09:38.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f3850c81640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f384c145d40 0x7f384c1de4b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f384400be00 tx=0x7f384400bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f79d3fff640 1 -- 172.21.15.78:0/3965254825 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c4016070 con 0x7f79c80051c0 2024-09-15T22:09:38.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7fb8f39d6640 1 --2- 172.21.15.78:0/874072232 >> v2:172.21.15.175:3300/0 conn(0x7fb8ec1430b0 0x7fb8ec0b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7fb8f39d6640 1 --2- 172.21.15.78:0/874072232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ec071950 0x7fb8ec142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7fb8f39d6640 1 -- 172.21.15.78:0/874072232 >> 172.21.15.78:0/874072232 conn(0x7fb8ec075360 msgr2=0x7fb8ec0bb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.227+0000 7f5f79b6f640 1 -- 172.21.15.78:0/1888137937 wait complete. 2024-09-15T22:09:38.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05cbfff640 1 -- 172.21.15.78:0/3939153845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05c40d3310 msgr2=0x7f05c4031870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:09:38.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05cbfff640 1 --2- 172.21.15.78:0/3939153845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05c40d3310 0x7f05c4031870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05cbfff640 1 -- 172.21.15.78:0/3939153845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c4031db0 msgr2=0x7f05c40cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05cbfff640 1 --2- 172.21.15.78:0/3939153845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c4031db0 0x7f05c40cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f05cbfff640 1 -- 172.21.15.78:0/3939153845 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c4035e20 con 0x7f05c4006c80 2024-09-15T22:09:38.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f3848ff9640 1 -- 172.21.15.78:0/2580057182 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384400ce10 con 0x7f384c145d40 2024-09-15T22:09:38.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f3848ff9640 1 -- 172.21.15.78:0/2580057182 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3844003970 con 0x7f384c145d40 2024-09-15T22:09:38.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7f3848ff9640 1 -- 172.21.15.78:0/2580057182 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844003da0 con 0x7f384c145d40 2024-09-15T22:09:38.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.229+0000 7f3851482640 1 -- 172.21.15.78:0/2580057182 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f384c1d0080 con 0x7f384c145d40 2024-09-15T22:09:38.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.229+0000 7f3851482640 1 -- 172.21.15.78:0/2580057182 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f384c142600 con 0x7f384c145d40 2024-09-15T22:09:38.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.229+0000 7f05cbfff640 1 --2- 172.21.15.78:0/3939153845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c4006c80 0x7f05c4022180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009fd0 tx=0x7f05c000b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.229+0000 7f79d3fff640 1 -- 172.21.15.78:0/3965254825 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4011830 con 0x7f79c80051c0 2024-09-15T22:09:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.229+0000 7f36dfb28640 1 -- 172.21.15.78:0/1199570385 shutdown_connections 2024-09-15T22:09:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.229+0000 7f36dfb28640 1 --2- 172.21.15.78:0/1199570385 >> v2:172.21.15.175:3300/0 conn(0x7f36d8144770 0x7f36d8146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.229+0000 7f36dfb28640 1 --2- 172.21.15.78:0/1199570385 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36d809f240 0x7f36d8144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.230+0000 7f36dfb28640 1 --2- 172.21.15.78:0/1199570385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d806c4e0 0x7f36d80ae650 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.230+0000 7f36dfb28640 1 -- 172.21.15.78:0/1199570385 >> 172.21.15.78:0/1199570385 conn(0x7f36d80b9170 msgr2=0x7f36d80b9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.228+0000 7fb8f39d6640 1 -- 172.21.15.78:0/874072232 shutdown_connections 2024-09-15T22:09:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.229+0000 7fb8f39d6640 1 -- 172.21.15.78:0/874072232 wait complete. 2024-09-15T22:09:38.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.229+0000 7f5f79b6f640 1 Processor -- start 2024-09-15T22:09:38.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.230+0000 7f5f79b6f640 1 -- start start 2024-09-15T22:09:38.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.230+0000 7f3851482640 1 -- 172.21.15.78:0/2580057182 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f384c0ba3a0 con 0x7f384c145d40 2024-09-15T22:09:38.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.231+0000 7f5f79b6f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7406c4e0 0x7f5f740b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.231+0000 7f5f79b6f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f7413f960 0x7f5f74144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.231+0000 7f5f79b6f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f7413fdd0 0x7f5f741e1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.230+0000 7f05c8ff9640 1 -- 172.21.15.78:0/3939153845 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0015020 con 0x7f05c4006c80 2024-09-15T22:09:38.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.230+0000 7f05d1084640 1 -- 172.21.15.78:0/3939153845 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c4027870 con 0x7f05c4006c80 2024-09-15T22:09:38.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.230+0000 7f05d1084640 1 -- 172.21.15.78:0/3939153845 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c4031070 con 0x7f05c4006c80 2024-09-15T22:09:38.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.231+0000 7f05c8ff9640 1 -- 172.21.15.78:0/3939153845 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c0011830 con 0x7f05c4006c80 2024-09-15T22:09:38.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.232+0000 7f05c8ff9640 1 -- 172.21.15.78:0/3939153845 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011c20 con 0x7f05c4006c80 2024-09-15T22:09:38.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.232+0000 7f05d1084640 1 -- 172.21.15.78:0/3939153845 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ac005290 con 0x7f05c4006c80 2024-09-15T22:09:38.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.231+0000 7f3848ff9640 1 -- 172.21.15.78:0/2580057182 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3844003f80 con 0x7f384c145d40 2024-09-15T22:09:38.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.232+0000 7f3848ff9640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3838070790 0x7f3838072c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.232+0000 7f3848ff9640 1 -- 172.21.15.78:0/2580057182 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f384408b700 con 0x7f384c145d40 2024-09-15T22:09:38.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.232+0000 7f384bfff640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3838070790 0x7f3838072c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.231+0000 7f5f79b6f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7409d9a0 con 0x7f5f7406c4e0 2024-09-15T22:09:38.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.231+0000 7f5f79b6f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5f740b54c0 con 0x7f5f7413fdd0 2024-09-15T22:09:38.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.231+0000 7f5f79b6f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5f7409e820 con 0x7f5f7413f960 2024-09-15T22:09:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.231+0000 7f5f73fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f7413fdd0 0x7f5f741e1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.231+0000 7f5f72ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f7413f960 0x7f5f74144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.231+0000 7f5f72ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f7413f960 0x7f5f74144d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.78:51214/0 (socket says 172.21.15.78:51214) 2024-09-15T22:09:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.231+0000 7f5f72ffd640 1 -- 172.21.15.78:0/2080341248 learned_addr learned my addr 172.21.15.78:0/2080341248 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.232+0000 7f5f737fe640 1 --2- 172.21.15.78:0/2080341248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7406c4e0 0x7f5f740b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.232+0000 7f5f737fe640 1 -- 172.21.15.78:0/2080341248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f7413f960 msgr2=0x7f5f74144d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.232+0000 7f5f737fe640 1 --2- 172.21.15.78:0/2080341248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f7413f960 0x7f5f74144d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.232+0000 7f5f737fe640 1 -- 172.21.15.78:0/2080341248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f7413fdd0 msgr2=0x7f5f741e1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.232+0000 7f5f737fe640 1 --2- 172.21.15.78:0/2080341248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f7413fdd0 0x7f5f741e1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.232+0000 7f5f737fe640 1 -- 172.21.15.78:0/2080341248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f740b22a0 con 0x7f5f7406c4e0 2024-09-15T22:09:38.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.231+0000 7f36dfb28640 1 -- 172.21.15.78:0/1199570385 shutdown_connections 2024-09-15T22:09:38.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.233+0000 7fb8f39d6640 1 Processor -- start 2024-09-15T22:09:38.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.231+0000 7f36dfb28640 1 -- 172.21.15.78:0/1199570385 wait complete. 2024-09-15T22:09:38.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.233+0000 7f5f737fe640 1 --2- 172.21.15.78:0/2080341248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7406c4e0 0x7f5f740b0540 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5f64031000 tx=0x7f5f640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.233+0000 7f36dfb28640 1 Processor -- start 2024-09-15T22:09:38.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.233+0000 7f36dfb28640 1 -- start start 2024-09-15T22:09:38.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.232+0000 7f79e1001640 1 -- 172.21.15.78:0/3965254825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c0005290 con 0x7f79c80051c0 2024-09-15T22:09:38.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.233+0000 7f79d3fff640 1 -- 172.21.15.78:0/3965254825 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f79c40119d0 con 0x7f79c80051c0 2024-09-15T22:09:38.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f79d3fff640 1 --2- 172.21.15.78:0/3965254825 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f79bc06c6e0 0x7f79bc06eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.233+0000 7f384bfff640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3838070790 0x7f3838072c50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f383c009560 tx=0x7f383c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f79d3fff640 1 -- 172.21.15.78:0/3965254825 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f79c4011630 con 0x7f79c80051c0 2024-09-15T22:09:38.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.233+0000 7f05c8ff9640 1 -- 172.21.15.78:0/3939153845 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f05c0018020 con 0x7f05c4006c80 2024-09-15T22:09:38.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f05c8ff9640 1 --2- 172.21.15.78:0/3939153845 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f05b006c380 0x7f05b006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.233+0000 7f5f5bfff640 1 -- 172.21.15.78:0/2080341248 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f64042070 con 0x7f5f7406c4e0 2024-09-15T22:09:38.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.233+0000 7f5f5bfff640 1 -- 172.21.15.78:0/2080341248 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f64004240 con 0x7f5f7406c4e0 2024-09-15T22:09:38.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.233+0000 7f5f5bfff640 1 -- 172.21.15.78:0/2080341248 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f64037040 con 0x7f5f7406c4e0 2024-09-15T22:09:38.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f5f79b6f640 1 -- 172.21.15.78:0/2080341248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f740b2b60 con 0x7f5f7406c4e0 2024-09-15T22:09:38.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f5f79b6f640 1 -- 172.21.15.78:0/2080341248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f740b3120 con 0x7f5f7406c4e0 2024-09-15T22:09:38.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f79d259c640 1 --2- 172.21.15.78:0/3965254825 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f79bc06c6e0 0x7f79bc06eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.233+0000 7fb8f39d6640 1 -- start start 2024-09-15T22:09:38.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7fb8f39d6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ec071950 0x7fb8ec141550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7fb8f39d6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8ec0725c0 0x7fb8ec0ba960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7fb8f39d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8ec1430b0 0x7fb8ec0baea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7fb8f39d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec0b54f0 con 0x7fb8ec1430b0 2024-09-15T22:09:38.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7fb8f39d6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec0b5370 con 0x7fb8ec0725c0 2024-09-15T22:09:38.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7fb8f39d6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb8ec0b5670 con 0x7fb8ec071950 2024-09-15T22:09:38.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7fb8f1772640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ec071950 0x7fb8ec141550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7fb8f1f73640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8ec1430b0 0x7fb8ec0baea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7fb8f1772640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ec071950 0x7fb8ec141550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.78:51236/0 (socket says 172.21.15.78:51236) 2024-09-15T22:09:38.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7fb8f1772640 1 -- 172.21.15.78:0/1415669857 learned_addr learned my addr 172.21.15.78:0/1415669857 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:38.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f36dfb28640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36d806c4e0 0x7f36d80b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f36dfb28640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36d809f240 0x7f36d81ea6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f36dfb28640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d8144770 0x7f36d81eac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f36dfb28640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f36d80b9c90 con 0x7f36d8144770 2024-09-15T22:09:38.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f36dfb28640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36d81439c0 con 0x7f36d809f240 2024-09-15T22:09:38.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f36dfb28640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f36d80b9e10 con 0x7f36d806c4e0 2024-09-15T22:09:38.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f36dd8c4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36d806c4e0 0x7f36d80b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f36dd8c4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36d806c4e0 0x7f36d80b0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.78:51230/0 (socket says 172.21.15.78:51230) 2024-09-15T22:09:38.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f36dd8c4640 1 -- 172.21.15.78:0/3693485303 learned_addr learned my addr 172.21.15.78:0/3693485303 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:38.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.235+0000 7f36dd0c3640 1 --2- 172.21.15.78:0/3693485303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36d809f240 0x7f36d81ea6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.235+0000 7f79d259c640 1 --2- 172.21.15.78:0/3965254825 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f79bc06c6e0 0x7f79bc06eba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f79dc06bcc0 tx=0x7f79cc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.234+0000 7f05cb7fe640 1 --2- 172.21.15.78:0/3939153845 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f05b006c380 0x7f05b006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.235+0000 7f05cb7fe640 1 --2- 172.21.15.78:0/3939153845 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f05b006c380 0x7f05b006e840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f05b8034000 tx=0x7f05b802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.235+0000 7f36dd0c3640 1 -- 172.21.15.78:0/3693485303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36d806c4e0 msgr2=0x7f36d80b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.235+0000 7f36dd0c3640 1 --2- 172.21.15.78:0/3693485303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36d806c4e0 0x7f36d80b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.235+0000 7f36dd0c3640 1 -- 172.21.15.78:0/3693485303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d8144770 msgr2=0x7f36d81eac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.235+0000 7f36de0c5640 1 --2- 172.21.15.78:0/3693485303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d8144770 0x7f36d81eac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.235+0000 7f36dd0c3640 1 --2- 172.21.15.78:0/3693485303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d8144770 0x7f36d81eac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.235+0000 7f05c8ff9640 1 -- 172.21.15.78:0/3939153845 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f05c008b450 con 0x7f05c4006c80 2024-09-15T22:09:38.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.235+0000 7f36dd0c3640 1 -- 172.21.15.78:0/3693485303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d80b2790 con 0x7f36d809f240 2024-09-15T22:09:38.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.236+0000 7f36de0c5640 1 --2- 172.21.15.78:0/3693485303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d8144770 0x7f36d81eac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:38.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.235+0000 7fb8f0f71640 1 --2- 172.21.15.78:0/1415669857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8ec0725c0 0x7fb8ec0ba960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.236+0000 7fb8f1772640 1 -- 172.21.15.78:0/1415669857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8ec0725c0 msgr2=0x7fb8ec0ba960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.236+0000 7fb8f1772640 1 --2- 172.21.15.78:0/1415669857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8ec0725c0 0x7fb8ec0ba960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.236+0000 7fb8f1772640 1 -- 172.21.15.78:0/1415669857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8ec1430b0 msgr2=0x7fb8ec0baea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.236+0000 7fb8f1772640 1 --2- 172.21.15.78:0/1415669857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8ec1430b0 0x7fb8ec0baea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.236+0000 7fb8f1772640 1 -- 172.21.15.78:0/1415669857 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ec1cf1b0 con 0x7fb8ec071950 2024-09-15T22:09:38.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.236+0000 7f36dd0c3640 1 --2- 172.21.15.78:0/3693485303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36d809f240 0x7f36d81ea6e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f36c800b390 tx=0x7f36c800b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.236+0000 7fb8f1772640 1 --2- 172.21.15.78:0/1415669857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ec071950 0x7fb8ec141550 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00e8a0 tx=0x7fb8dc00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.236+0000 7f5f79b6f640 1 -- 172.21.15.78:0/2080341248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f7413cd30 con 0x7f5f7406c4e0 2024-09-15T22:09:38.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.237+0000 7f5f5bfff640 1 -- 172.21.15.78:0/2080341248 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5f64003610 con 0x7f5f7406c4e0 2024-09-15T22:09:38.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.237+0000 7f5f5bfff640 1 --2- 172.21.15.78:0/2080341248 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5f6006c300 0x7f5f6006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.237+0000 7f5f5bfff640 1 -- 172.21.15.78:0/2080341248 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5f640abd90 con 0x7f5f7406c4e0 2024-09-15T22:09:38.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.237+0000 7f5f72ffd640 1 --2- 172.21.15.78:0/2080341248 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5f6006c300 0x7f5f6006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.238+0000 7f5f72ffd640 1 --2- 172.21.15.78:0/2080341248 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5f6006c300 0x7f5f6006e7c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5f740b3770 tx=0x7f5f68007ef0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.241+0000 7fb8e1ffb640 1 -- 172.21.15.78:0/1415669857 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc017070 con 0x7fb8ec071950 2024-09-15T22:09:38.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.241+0000 7fb8f39d6640 1 -- 172.21.15.78:0/1415669857 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ec1cf490 con 0x7fb8ec071950 2024-09-15T22:09:38.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.241+0000 7f3848ff9640 1 -- 172.21.15.78:0/2580057182 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3844059550 con 0x7f384c145d40 2024-09-15T22:09:38.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.242+0000 7fb8f39d6640 1 -- 172.21.15.78:0/1415669857 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8ec1cea40 con 0x7fb8ec071950 2024-09-15T22:09:38.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.242+0000 7f79d3fff640 1 -- 172.21.15.78:0/3965254825 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79c40590e0 con 0x7f79c80051c0 2024-09-15T22:09:38.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.242+0000 7fb8e1ffb640 1 -- 172.21.15.78:0/1415669857 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8dc00c940 con 0x7fb8ec071950 2024-09-15T22:09:38.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.242+0000 7fb8e1ffb640 1 -- 172.21.15.78:0/1415669857 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc00cd30 con 0x7fb8ec071950 2024-09-15T22:09:38.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.243+0000 7fb8f39d6640 1 -- 172.21.15.78:0/1415669857 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8cc005290 con 0x7fb8ec071950 2024-09-15T22:09:38.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.245+0000 7fb8e1ffb640 1 -- 172.21.15.78:0/1415669857 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb8dc01a070 con 0x7fb8ec071950 2024-09-15T22:09:38.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.245+0000 7fb8e1ffb640 1 --2- 172.21.15.78:0/1415669857 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb8d006c3b0 0x7fb8d006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.245+0000 7fb8f0f71640 1 --2- 172.21.15.78:0/1415669857 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb8d006c3b0 0x7fb8d006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.246+0000 7fb8e1ffb640 1 -- 172.21.15.78:0/1415669857 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb8dc08b850 con 0x7fb8ec071950 2024-09-15T22:09:38.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.246+0000 7f5f5bfff640 1 -- 172.21.15.78:0/2080341248 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5f7413cd30 con 0x7f5f7406c4e0 2024-09-15T22:09:38.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.246+0000 7fb8f0f71640 1 --2- 172.21.15.78:0/1415669857 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb8d006c3b0 0x7fb8d006e870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec1cfda0 tx=0x7fb8e4007770 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.248+0000 7f36ce7fc640 1 -- 172.21.15.78:0/3693485303 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8015030 con 0x7f36d809f240 2024-09-15T22:09:38.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.249+0000 7f36ce7fc640 1 -- 172.21.15.78:0/3693485303 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c80059e0 con 0x7f36d809f240 2024-09-15T22:09:38.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.249+0000 7f05c8ff9640 1 -- 172.21.15.78:0/3939153845 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05c001f030 con 0x7f05c4006c80 2024-09-15T22:09:38.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.249+0000 7f36dfb28640 1 -- 172.21.15.78:0/3693485303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36d8070080 con 0x7f36d809f240 2024-09-15T22:09:38.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.249+0000 7f36dfb28640 1 -- 172.21.15.78:0/3693485303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36d8141140 con 0x7f36d809f240 2024-09-15T22:09:38.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.250+0000 7f36ce7fc640 1 -- 172.21.15.78:0/3693485303 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8005e30 con 0x7f36d809f240 2024-09-15T22:09:38.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.252+0000 7f427c4a5640 1 Processor -- start 2024-09-15T22:09:38.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.252+0000 7f36ce7fc640 1 -- 172.21.15.78:0/3693485303 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f36c8018070 con 0x7f36d809f240 2024-09-15T22:09:38.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.252+0000 7f427c4a5640 1 -- start start 2024-09-15T22:09:38.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.253+0000 7f427c4a5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4274144230 0x7f4274146440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.253+0000 7f427c4a5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4274144eb0 con 0x7f42740b9c90 2024-09-15T22:09:38.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.253+0000 7f427c4a5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42741439c0 con 0x7f427409f240 2024-09-15T22:09:38.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.253+0000 7f427c4a5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4274143da0 con 0x7f4274144230 2024-09-15T22:09:38.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.253+0000 7f36dfb28640 1 -- 172.21.15.78:0/3693485303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36d80ae650 con 0x7f36d809f240 2024-09-15T22:09:38.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.254+0000 7f36ce7fc640 1 --2- 172.21.15.78:0/3693485303 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f36bc06c380 0x7f36bc06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.254+0000 7f36ce7fc640 1 -- 172.21.15.78:0/3693485303 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f36c808b1d0 con 0x7f36d809f240 2024-09-15T22:09:38.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.254+0000 7f427a241640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f42740b9c90 0x7f42740ae650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57066/0 (socket says 172.21.15.78:57066) 2024-09-15T22:09:38.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.254+0000 7f427a241640 1 -- 172.21.15.78:0/330726340 learned_addr learned my addr 172.21.15.78:0/330726340 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:38.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.255+0000 7f427923f640 1 -- 172.21.15.78:0/330726340 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 102489348 0 0) 0x7f4274144eb0 con 0x7f42740b9c90 2024-09-15T22:09:38.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.255+0000 7f427923f640 1 -- 172.21.15.78:0/330726340 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4260003520 con 0x7f42740b9c90 2024-09-15T22:09:38.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.255+0000 7f36dd8c4640 1 --2- 172.21.15.78:0/3693485303 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f36bc06c380 0x7f36bc06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.255+0000 7f427aa42640 1 --2- 172.21.15.78:0/330726340 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4274144230 0x7f4274146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.255+0000 7f427aa42640 1 -- 172.21.15.78:0/330726340 >> v1:172.21.15.175:6789/0 conn(0x7f427409f240 legacy=0x7f427406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.255+0000 7f427923f640 1 -- 172.21.15.78:0/330726340 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1861144158 0 0) 0x7f4260003520 con 0x7f42740b9c90 2024-09-15T22:09:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.255+0000 7f427aa42640 1 -- 172.21.15.78:0/330726340 >> v1:172.21.15.78:6789/0 conn(0x7f42740b9c90 legacy=0x7f42740ae650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.255+0000 7f36dd8c4640 1 --2- 172.21.15.78:0/3693485303 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f36bc06c380 0x7f36bc06e840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f36d002ec40 tx=0x7f36d000d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.255+0000 7f427aa42640 1 -- 172.21.15.78:0/330726340 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427414b340 con 0x7f4274144230 2024-09-15T22:09:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.255+0000 7fb8e1ffb640 1 -- 172.21.15.78:0/1415669857 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8dc059610 con 0x7fb8ec071950 2024-09-15T22:09:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.256+0000 7f427aa42640 1 --2- 172.21.15.78:0/330726340 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4274144230 0x7f4274146440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f42700097d0 tx=0x7f427002a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24aec6558a03be24 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.257+0000 7f427923f640 1 -- 172.21.15.78:0/330726340 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4270037070 con 0x7f4274144230 2024-09-15T22:09:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.257+0000 7f427923f640 1 -- 172.21.15.78:0/330726340 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f427002ab40 con 0x7f4274144230 2024-09-15T22:09:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.258+0000 7f427c4a5640 1 -- 172.21.15.78:0/330726340 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4274144230 msgr2=0x7f4274146440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.258+0000 7f427c4a5640 1 --2- 172.21.15.78:0/330726340 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4274144230 0x7f4274146440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f42700097d0 tx=0x7f427002a0b0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.258+0000 7f427c4a5640 1 -- 172.21.15.78:0/330726340 shutdown_connections 2024-09-15T22:09:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.258+0000 7f427c4a5640 1 --2- 172.21.15.78:0/330726340 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4274144230 0x7f4274146440 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.258+0000 7f427c4a5640 1 -- 172.21.15.78:0/330726340 >> 172.21.15.78:0/330726340 conn(0x7f42740b9170 msgr2=0x7f42740b9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.259+0000 7f427c4a5640 1 -- 172.21.15.78:0/330726340 shutdown_connections 2024-09-15T22:09:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.259+0000 7f36ce7fc640 1 -- 172.21.15.78:0/3693485303 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f36c8059670 con 0x7f36d809f240 2024-09-15T22:09:38.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.259+0000 7f427c4a5640 1 -- 172.21.15.78:0/330726340 wait complete. 2024-09-15T22:09:38.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.260+0000 7f427c4a5640 1 Processor -- start 2024-09-15T22:09:38.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.261+0000 7f427c4a5640 1 -- start start 2024-09-15T22:09:38.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.261+0000 7f427c4a5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427409f240 0x7f4274140290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.262+0000 7f427c4a5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42740b9c90 0x7f42741db020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.262+0000 7f427c4a5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42741db560 0x7f42741e4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.262+0000 7f427c4a5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4274146980 con 0x7f427409f240 2024-09-15T22:09:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.262+0000 7f427c4a5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f42741448a0 con 0x7f42741db560 2024-09-15T22:09:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.262+0000 7f427c4a5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4274146b00 con 0x7f42740b9c90 2024-09-15T22:09:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.262+0000 7f4279a40640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42740b9c90 0x7f42741db020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.262+0000 7f4279a40640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42740b9c90 0x7f42741db020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.78:51246/0 (socket says 172.21.15.78:51246) 2024-09-15T22:09:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.262+0000 7f4279a40640 1 -- 172.21.15.78:0/1919069145 learned_addr learned my addr 172.21.15.78:0/1919069145 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.262+0000 7f427a241640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427409f240 0x7f4274140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.262+0000 7f427aa42640 1 --2- 172.21.15.78:0/1919069145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42741db560 0x7f42741e4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.263+0000 7f427a241640 1 -- 172.21.15.78:0/1919069145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42740b9c90 msgr2=0x7f42741db020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.263+0000 7f427a241640 1 --2- 172.21.15.78:0/1919069145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42740b9c90 0x7f42741db020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.263+0000 7f427a241640 1 -- 172.21.15.78:0/1919069145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42741db560 msgr2=0x7f42741e4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.263+0000 7f427a241640 1 --2- 172.21.15.78:0/1919069145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42741db560 0x7f42741e4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.263+0000 7f427a241640 1 -- 172.21.15.78:0/1919069145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42740b4520 con 0x7f427409f240 2024-09-15T22:09:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.263+0000 7f427a241640 1 --2- 172.21.15.78:0/1919069145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427409f240 0x7f4274140290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f42740ba1d0 tx=0x7f426c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.267+0000 7f426affd640 1 -- 172.21.15.78:0/1919069145 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c018070 con 0x7f427409f240 2024-09-15T22:09:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.267+0000 7f427c4a5640 1 -- 172.21.15.78:0/1919069145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42741e5490 con 0x7f427409f240 2024-09-15T22:09:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.267+0000 7f427c4a5640 1 -- 172.21.15.78:0/1919069145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42741dab00 con 0x7f427409f240 2024-09-15T22:09:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.270+0000 7f426affd640 1 -- 172.21.15.78:0/1919069145 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f426c00a7c0 con 0x7f427409f240 2024-09-15T22:09:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.270+0000 7f426affd640 1 -- 172.21.15.78:0/1919069145 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c00abb0 con 0x7f427409f240 2024-09-15T22:09:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.270+0000 7f426affd640 1 -- 172.21.15.78:0/1919069145 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f426c01b070 con 0x7f427409f240 2024-09-15T22:09:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.270+0000 7f426affd640 1 --2- 172.21.15.78:0/1919069145 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f426006c680 0x7f426006eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.271+0000 7f4279a40640 1 --2- 172.21.15.78:0/1919069145 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f426006c680 0x7f426006eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.271+0000 7f427c4a5640 1 -- 172.21.15.78:0/1919069145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f425c005290 con 0x7f427409f240 2024-09-15T22:09:38.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.272+0000 7f4279a40640 1 --2- 172.21.15.78:0/1919069145 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f426006c680 0x7f426006eb40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f427413e360 tx=0x7f4264009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.272+0000 7f426affd640 1 -- 172.21.15.78:0/1919069145 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f426c08af90 con 0x7f427409f240 2024-09-15T22:09:38.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.281+0000 7f426affd640 1 -- 172.21.15.78:0/1919069145 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f426c058de0 con 0x7f427409f240 2024-09-15T22:09:38.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.290+0000 7fc40d366640 1 Processor -- start 2024-09-15T22:09:38.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.290+0000 7fc40d366640 1 -- start start 2024-09-15T22:09:38.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.291+0000 7fc40d366640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc408074e10 0x7fc4080b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.291+0000 7fc40d366640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4080b4f90 0x7fc408149130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.291+0000 7fc40d366640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4080751f0 con 0x7fc408149670 2024-09-15T22:09:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.291+0000 7fc40d366640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fc4080b6ad0 con 0x7fc408074e10 2024-09-15T22:09:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.291+0000 7fc40d366640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc4080b53d0 con 0x7fc4080b4f90 2024-09-15T22:09:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.291+0000 7fc406ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc408074e10 0x7fc4080b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.291+0000 7fc406ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc408074e10 0x7fc4080b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49954/0 (socket says 172.21.15.78:49954) 2024-09-15T22:09:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.291+0000 7fc406ffd640 1 -- 172.21.15.78:0/1429538123 learned_addr learned my addr 172.21.15.78:0/1429538123 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.291+0000 7fc4067fc640 1 --2- 172.21.15.78:0/1429538123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4080b4f90 0x7fc408149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.292+0000 7fc4067fc640 1 -- 172.21.15.78:0/1429538123 >> v2:172.21.15.78:3300/0 conn(0x7fc408074e10 msgr2=0x7fc4080b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.292+0000 7fc4067fc640 1 --2- 172.21.15.78:0/1429538123 >> v2:172.21.15.78:3300/0 conn(0x7fc408074e10 0x7fc4080b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.292+0000 7fc4067fc640 1 -- 172.21.15.78:0/1429538123 >> v1:172.21.15.175:6789/0 conn(0x7fc408149670 legacy=0x7fc40814c200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:09:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.292+0000 7fc4067fc640 1 -- 172.21.15.78:0/1429538123 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4080b56a0 con 0x7fc4080b4f90 2024-09-15T22:09:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.293+0000 7fc4067fc640 1 --2- 172.21.15.78:0/1429538123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4080b4f90 0x7fc408149130 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc3f80097a0 tx=0x7fc3f803b0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ada2499c3ca743f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.296+0000 7fc405ffb640 1 -- 172.21.15.78:0/1429538123 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8048070 con 0x7fc4080b4f90 2024-09-15T22:09:38.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.296+0000 7fc405ffb640 1 -- 172.21.15.78:0/1429538123 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f803bdf0 con 0x7fc4080b4f90 2024-09-15T22:09:38.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.296+0000 7fc405ffb640 1 -- 172.21.15.78:0/1429538123 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8043640 con 0x7fc4080b4f90 2024-09-15T22:09:38.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.298+0000 7fc40d366640 1 -- 172.21.15.78:0/1429538123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4080b4f90 msgr2=0x7fc408149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.298+0000 7fc40d366640 1 --2- 172.21.15.78:0/1429538123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4080b4f90 0x7fc408149130 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc3f80097a0 tx=0x7fc3f803b0e0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.302+0000 7fc40d366640 1 -- 172.21.15.78:0/1429538123 shutdown_connections 2024-09-15T22:09:38.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.302+0000 7fc40d366640 1 --2- 172.21.15.78:0/1429538123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4080b4f90 0x7fc408149130 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.302+0000 7fc40d366640 1 --2- 172.21.15.78:0/1429538123 >> v2:172.21.15.78:3300/0 conn(0x7fc408074e10 0x7fc4080b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.302+0000 7fc40d366640 1 -- 172.21.15.78:0/1429538123 >> 172.21.15.78:0/1429538123 conn(0x7fc4080ba2d0 msgr2=0x7fc4080ba6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.306+0000 7fc40d366640 1 -- 172.21.15.78:0/1429538123 shutdown_connections 2024-09-15T22:09:38.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.310+0000 7fc40d366640 1 -- 172.21.15.78:0/1429538123 wait complete. 2024-09-15T22:09:38.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.311+0000 7fc40d366640 1 Processor -- start 2024-09-15T22:09:38.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.315+0000 7fc40d366640 1 -- start start 2024-09-15T22:09:38.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.316+0000 7fc40d366640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc408074e10 0x7fc4080b9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.316+0000 7fc40d366640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4080b4f90 0x7fc40814d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.316+0000 7fc406ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc408074e10 0x7fc4080b9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.316+0000 7fc406ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc408074e10 0x7fc4080b9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.78:33338/0 (socket says 172.21.15.78:33338) 2024-09-15T22:09:38.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.316+0000 7fc4067fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4080b4f90 0x7fc40814d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.316+0000 7fc4067fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4080b4f90 0x7fc40814d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49960/0 (socket says 172.21.15.78:49960) 2024-09-15T22:09:38.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.316+0000 7fc406ffd640 1 -- 172.21.15.78:0/1043389532 learned_addr learned my addr 172.21.15.78:0/1043389532 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:38.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.316+0000 7fc40d366640 1 --2- 172.21.15.78:0/1043389532 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc408149670 0x7fc408073690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.316+0000 7fc40d366640 1 -- 172.21.15.78:0/1043389532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc40814c910 con 0x7fc4080b4f90 2024-09-15T22:09:38.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.316+0000 7fc40d366640 1 -- 172.21.15.78:0/1043389532 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc4080b6760 con 0x7fc408074e10 2024-09-15T22:09:38.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.316+0000 7fc40d366640 1 -- 172.21.15.78:0/1043389532 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc40814ca90 con 0x7fc408149670 2024-09-15T22:09:38.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.317+0000 7fc4067fc640 1 -- 172.21.15.78:0/1043389532 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc408149670 msgr2=0x7fc408073690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:09:38.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.317+0000 7fc4067fc640 1 --2- 172.21.15.78:0/1043389532 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc408149670 0x7fc408073690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.317+0000 7fc4067fc640 1 -- 172.21.15.78:0/1043389532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc408074e10 msgr2=0x7fc4080b9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.317+0000 7fc4067fc640 1 --2- 172.21.15.78:0/1043389532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc408074e10 0x7fc4080b9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.317+0000 7fc4067fc640 1 -- 172.21.15.78:0/1043389532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40814dda0 con 0x7fc4080b4f90 2024-09-15T22:09:38.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.317+0000 7fc4067fc640 1 --2- 172.21.15.78:0/1043389532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4080b4f90 0x7fc40814d860 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8042000 tx=0x7fc3f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.321+0000 7fc3ef7fe640 1 -- 172.21.15.78:0/1043389532 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8052020 con 0x7fc4080b4f90 2024-09-15T22:09:38.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.321+0000 7fc3ef7fe640 1 -- 172.21.15.78:0/1043389532 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f804c600 con 0x7fc4080b4f90 2024-09-15T22:09:38.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.321+0000 7fc3ef7fe640 1 -- 172.21.15.78:0/1043389532 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8048040 con 0x7fc4080b4f90 2024-09-15T22:09:38.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.322+0000 7fc40d366640 1 -- 172.21.15.78:0/1043389532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40814e020 con 0x7fc4080b4f90 2024-09-15T22:09:38.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.322+0000 7fc40d366640 1 -- 172.21.15.78:0/1043389532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc408072b00 con 0x7fc4080b4f90 2024-09-15T22:09:38.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.325+0000 7fc3ed7fa640 1 -- 172.21.15.78:0/1043389532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e0005290 con 0x7fc4080b4f90 2024-09-15T22:09:38.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.327+0000 7fc3ef7fe640 1 -- 172.21.15.78:0/1043389532 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc3f8055020 con 0x7fc4080b4f90 2024-09-15T22:09:38.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.327+0000 7fc3ef7fe640 1 --2- 172.21.15.78:0/1043389532 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc3f406c3b0 0x7fc3f406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:38.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.328+0000 7fc406ffd640 1 --2- 172.21.15.78:0/1043389532 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc3f406c3b0 0x7fc3f406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:38.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.328+0000 7fc406ffd640 1 --2- 172.21.15.78:0/1043389532 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc3f406c3b0 0x7fc3f406e870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc4000114f0 tx=0x7fc40000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:38.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.329+0000 7fc3ef7fe640 1 -- 172.21.15.78:0/1043389532 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc3f80bca70 con 0x7fc4080b4f90 2024-09-15T22:09:38.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.338+0000 7fc3ef7fe640 1 -- 172.21.15.78:0/1043389532 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3f805c030 con 0x7fc4080b4f90 2024-09-15T22:09:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.592+0000 7f79e1001640 1 -- 172.21.15.78:0/3965254825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f79c0005580 con 0x7f79c80051c0 2024-09-15T22:09:38.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.604+0000 7f79d3fff640 1 -- 172.21.15.78:0/3965254825 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f79c40590e0 con 0x7f79c80051c0 2024-09-15T22:09:38.609 INFO:teuthology.orchestra.run.smithi078.stdout:60129542152 2024-09-15T22:09:38.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.607+0000 7f79e1001640 1 -- 172.21.15.78:0/3965254825 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f79bc06c6e0 msgr2=0x7f79bc06eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.607+0000 7f79e1001640 1 --2- 172.21.15.78:0/3965254825 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f79bc06c6e0 0x7f79bc06eba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f79dc06bcc0 tx=0x7f79cc008040 comp rx=0 tx=0).stop 2024-09-15T22:09:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.607+0000 7f79e1001640 1 -- 172.21.15.78:0/3965254825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c80051c0 msgr2=0x7f79dc148a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.607+0000 7f79e1001640 1 --2- 172.21.15.78:0/3965254825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c80051c0 0x7f79dc148a20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f79c400b3c0 tx=0x7f79c400b880 comp rx=0 tx=0).stop 2024-09-15T22:09:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.607+0000 7f79e1001640 1 -- 172.21.15.78:0/3965254825 shutdown_connections 2024-09-15T22:09:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.607+0000 7f79e1001640 1 --2- 172.21.15.78:0/3965254825 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f79bc06c6e0 0x7f79bc06eba0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.607+0000 7f79e1001640 1 --2- 172.21.15.78:0/3965254825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79dc1e35b0 0x7f79dc1e3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.607+0000 7f79e1001640 1 --2- 172.21.15.78:0/3965254825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79dc1ea2b0 0x7f79dc1ea730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.607+0000 7f79e1001640 1 --2- 172.21.15.78:0/3965254825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79c80051c0 0x7f79dc148a20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.607+0000 7f79e1001640 1 -- 172.21.15.78:0/3965254825 >> 172.21.15.78:0/3965254825 conn(0x7f79dc0bb970 msgr2=0x7f79dc074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.608+0000 7f79e1001640 1 -- 172.21.15.78:0/3965254825 shutdown_connections 2024-09-15T22:09:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.608+0000 7f79e1001640 1 -- 172.21.15.78:0/3965254825 wait complete. 2024-09-15T22:09:38.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.7 2024-09-15T22:09:38.626 DEBUG:teuthology.parallel:result is None 2024-09-15T22:09:38.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.645+0000 7f5f79b6f640 1 -- 172.21.15.78:0/2080341248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5f7409e110 con 0x7f5f7406c4e0 2024-09-15T22:09:38.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.645+0000 7f3851482640 1 -- 172.21.15.78:0/2580057182 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f384c0ba680 con 0x7f384c145d40 2024-09-15T22:09:38.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.646+0000 7f5f5bfff640 1 -- 172.21.15.78:0/2080341248 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5f64079c50 con 0x7f5f7406c4e0 2024-09-15T22:09:38.649 INFO:teuthology.orchestra.run.smithi078.stdout:60129542152 2024-09-15T22:09:38.649 INFO:teuthology.orchestra.run.smithi078.stdout:60129542154 2024-09-15T22:09:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.647+0000 7f3848ff9640 1 -- 172.21.15.78:0/2580057182 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f384405d850 con 0x7f384c145d40 2024-09-15T22:09:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.648+0000 7f5f79b6f640 1 -- 172.21.15.78:0/2080341248 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5f6006c300 msgr2=0x7f5f6006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.648+0000 7f5f79b6f640 1 --2- 172.21.15.78:0/2080341248 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5f6006c300 0x7f5f6006e7c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5f740b3770 tx=0x7f5f68007ef0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.648+0000 7f5f79b6f640 1 -- 172.21.15.78:0/2080341248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7406c4e0 msgr2=0x7f5f740b0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.649+0000 7f5f79b6f640 1 --2- 172.21.15.78:0/2080341248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7406c4e0 0x7f5f740b0540 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5f64031000 tx=0x7f5f640046c0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.649+0000 7f5f79b6f640 1 -- 172.21.15.78:0/2080341248 shutdown_connections 2024-09-15T22:09:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.649+0000 7f5f79b6f640 1 --2- 172.21.15.78:0/2080341248 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5f6006c300 0x7f5f6006e7c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.649+0000 7f5f79b6f640 1 --2- 172.21.15.78:0/2080341248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f7413fdd0 0x7f5f741e1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.649+0000 7f5f79b6f640 1 --2- 172.21.15.78:0/2080341248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f7413f960 0x7f5f74144d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.649+0000 7f5f79b6f640 1 --2- 172.21.15.78:0/2080341248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7406c4e0 0x7f5f740b0540 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.649+0000 7f5f79b6f640 1 -- 172.21.15.78:0/2080341248 >> 172.21.15.78:0/2080341248 conn(0x7f5f740b9170 msgr2=0x7f5f7413c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.649+0000 7f5f79b6f640 1 -- 172.21.15.78:0/2080341248 shutdown_connections 2024-09-15T22:09:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.649+0000 7f5f79b6f640 1 -- 172.21.15.78:0/2080341248 wait complete. 2024-09-15T22:09:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.650+0000 7f3851482640 1 -- 172.21.15.78:0/2580057182 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3838070790 msgr2=0x7f3838072c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.650+0000 7f3851482640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3838070790 0x7f3838072c50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f383c009560 tx=0x7f383c02e000 comp rx=0 tx=0).stop 2024-09-15T22:09:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.650+0000 7f3851482640 1 -- 172.21.15.78:0/2580057182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f384c145d40 msgr2=0x7f384c1de4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.650+0000 7f3851482640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f384c145d40 0x7f384c1de4b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f384400be00 tx=0x7f384400bef0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.650+0000 7f3851482640 1 -- 172.21.15.78:0/2580057182 shutdown_connections 2024-09-15T22:09:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.650+0000 7f3851482640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3838070790 0x7f3838072c50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.650+0000 7f3851482640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f384c145d40 0x7f384c1de4b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.650+0000 7f3851482640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f384c073110 0x7f384c1daf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.650+0000 7f3851482640 1 --2- 172.21.15.78:0/2580057182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f384c072d30 0x7f384c1d2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.650+0000 7f3851482640 1 -- 172.21.15.78:0/2580057182 >> 172.21.15.78:0/2580057182 conn(0x7f384c0bb2b0 msgr2=0x7f384c071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.650+0000 7f3851482640 1 -- 172.21.15.78:0/2580057182 shutdown_connections 2024-09-15T22:09:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.650+0000 7f3851482640 1 -- 172.21.15.78:0/2580057182 wait complete. 2024-09-15T22:09:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.658+0000 7f36dfb28640 1 -- 172.21.15.78:0/3693485303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f36d8142820 con 0x7f36d809f240 2024-09-15T22:09:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.658+0000 7f36ce7fc640 1 -- 172.21.15.78:0/3693485303 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f36c8058f70 con 0x7f36d809f240 2024-09-15T22:09:38.660 INFO:teuthology.orchestra.run.smithi078.stdout:60129542152 2024-09-15T22:09:38.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.6 2024-09-15T22:09:38.664 DEBUG:teuthology.parallel:result is None 2024-09-15T22:09:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.662+0000 7f36dfb28640 1 -- 172.21.15.78:0/3693485303 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f36bc06c380 msgr2=0x7f36bc06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.662+0000 7f36dfb28640 1 --2- 172.21.15.78:0/3693485303 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f36bc06c380 0x7f36bc06e840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f36d002ec40 tx=0x7f36d000d040 comp rx=0 tx=0).stop 2024-09-15T22:09:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.662+0000 7f36dfb28640 1 -- 172.21.15.78:0/3693485303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36d809f240 msgr2=0x7f36d81ea6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.662+0000 7f36dfb28640 1 --2- 172.21.15.78:0/3693485303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36d809f240 0x7f36d81ea6e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f36c800b390 tx=0x7f36c800b850 comp rx=0 tx=0).stop 2024-09-15T22:09:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.662+0000 7f36dfb28640 1 -- 172.21.15.78:0/3693485303 shutdown_connections 2024-09-15T22:09:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.662+0000 7f36dfb28640 1 --2- 172.21.15.78:0/3693485303 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f36bc06c380 0x7f36bc06e840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.662+0000 7f36dfb28640 1 --2- 172.21.15.78:0/3693485303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d8144770 0x7f36d81eac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.662+0000 7f36dfb28640 1 --2- 172.21.15.78:0/3693485303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36d809f240 0x7f36d81ea6e0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f36c800b390 tx=0x7f36c800b850 comp rx=0 tx=0).stop 2024-09-15T22:09:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.662+0000 7f36dfb28640 1 --2- 172.21.15.78:0/3693485303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36d806c4e0 0x7f36d80b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.662+0000 7f36dfb28640 1 -- 172.21.15.78:0/3693485303 >> 172.21.15.78:0/3693485303 conn(0x7f36d80b9170 msgr2=0x7f36d8146340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.662+0000 7f36dfb28640 1 -- 172.21.15.78:0/3693485303 shutdown_connections 2024-09-15T22:09:38.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.662+0000 7f36dfb28640 1 -- 172.21.15.78:0/3693485303 wait complete. 2024-09-15T22:09:38.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.3 2024-09-15T22:09:38.669 DEBUG:teuthology.parallel:result is None 2024-09-15T22:09:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.671+0000 7fb8f39d6640 1 -- 172.21.15.78:0/1415669857 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb8cc005580 con 0x7fb8ec071950 2024-09-15T22:09:38.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.672+0000 7fb8e1ffb640 1 -- 172.21.15.78:0/1415669857 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8dc05d910 con 0x7fb8ec071950 2024-09-15T22:09:38.674 INFO:teuthology.orchestra.run.smithi078.stdout:60129542152 2024-09-15T22:09:38.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.0 2024-09-15T22:09:38.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.675+0000 7fb8f39d6640 1 -- 172.21.15.78:0/1415669857 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb8d006c3b0 msgr2=0x7fb8d006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.675+0000 7fb8f39d6640 1 --2- 172.21.15.78:0/1415669857 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb8d006c3b0 0x7fb8d006e870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec1cfda0 tx=0x7fb8e4007770 comp rx=0 tx=0).stop 2024-09-15T22:09:38.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.675+0000 7fb8f39d6640 1 -- 172.21.15.78:0/1415669857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ec071950 msgr2=0x7fb8ec141550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.675+0000 7fb8f39d6640 1 --2- 172.21.15.78:0/1415669857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ec071950 0x7fb8ec141550 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00e8a0 tx=0x7fb8dc00ed60 comp rx=0 tx=0).stop 2024-09-15T22:09:38.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.675+0000 7fb8f39d6640 1 -- 172.21.15.78:0/1415669857 shutdown_connections 2024-09-15T22:09:38.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.675+0000 7fb8f39d6640 1 --2- 172.21.15.78:0/1415669857 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb8d006c3b0 0x7fb8d006e870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.675+0000 7fb8f39d6640 1 --2- 172.21.15.78:0/1415669857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8ec1430b0 0x7fb8ec0baea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.675+0000 7fb8f39d6640 1 --2- 172.21.15.78:0/1415669857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8ec0725c0 0x7fb8ec0ba960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.675+0000 7fb8f39d6640 1 --2- 172.21.15.78:0/1415669857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ec071950 0x7fb8ec141550 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.675+0000 7fb8f39d6640 1 -- 172.21.15.78:0/1415669857 >> 172.21.15.78:0/1415669857 conn(0x7fb8ec075360 msgr2=0x7fb8ec0b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.675+0000 7fb8f39d6640 1 -- 172.21.15.78:0/1415669857 shutdown_connections 2024-09-15T22:09:38.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.675+0000 7fb8f39d6640 1 -- 172.21.15.78:0/1415669857 wait complete. 2024-09-15T22:09:38.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.5 2024-09-15T22:09:38.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.690+0000 7f427c4a5640 1 -- 172.21.15.78:0/1919069145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f425c005580 con 0x7f427409f240 2024-09-15T22:09:38.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.690+0000 7f426affd640 1 -- 172.21.15.78:0/1919069145 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f426c05d0e0 con 0x7f427409f240 2024-09-15T22:09:38.692 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2024-09-15T22:09:38.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.692+0000 7f427c4a5640 1 -- 172.21.15.78:0/1919069145 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f426006c680 msgr2=0x7f426006eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.692+0000 7f427c4a5640 1 --2- 172.21.15.78:0/1919069145 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f426006c680 0x7f426006eb40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f427413e360 tx=0x7f4264009040 comp rx=0 tx=0).stop 2024-09-15T22:09:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.692+0000 7f427c4a5640 1 -- 172.21.15.78:0/1919069145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427409f240 msgr2=0x7f4274140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.692+0000 7f427c4a5640 1 --2- 172.21.15.78:0/1919069145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427409f240 0x7f4274140290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f42740ba1d0 tx=0x7f426c00cf50 comp rx=0 tx=0).stop 2024-09-15T22:09:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.692+0000 7f427c4a5640 1 -- 172.21.15.78:0/1919069145 shutdown_connections 2024-09-15T22:09:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.692+0000 7f427c4a5640 1 --2- 172.21.15.78:0/1919069145 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f426006c680 0x7f426006eb40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.692+0000 7f427c4a5640 1 --2- 172.21.15.78:0/1919069145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42741db560 0x7f42741e4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.692+0000 7f427c4a5640 1 --2- 172.21.15.78:0/1919069145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42740b9c90 0x7f42741db020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.692+0000 7f427c4a5640 1 --2- 172.21.15.78:0/1919069145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427409f240 0x7f4274140290 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.693+0000 7f427c4a5640 1 -- 172.21.15.78:0/1919069145 >> 172.21.15.78:0/1919069145 conn(0x7f42740b9170 msgr2=0x7f42741365d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.693+0000 7f427c4a5640 1 -- 172.21.15.78:0/1919069145 shutdown_connections 2024-09-15T22:09:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.693+0000 7f427c4a5640 1 -- 172.21.15.78:0/1919069145 wait complete. 2024-09-15T22:09:38.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-09-15T22:09:38.705 DEBUG:teuthology.parallel:result is None 2024-09-15T22:09:38.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.723+0000 7f05d1084640 1 -- 172.21.15.78:0/3939153845 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f05ac005850 con 0x7f05c4006c80 2024-09-15T22:09:38.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.723+0000 7f05c8ff9640 1 -- 172.21.15.78:0/3939153845 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f05c00598f0 con 0x7f05c4006c80 2024-09-15T22:09:38.725 INFO:teuthology.orchestra.run.smithi078.stdout:60129542153 2024-09-15T22:09:38.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.725+0000 7f05d1084640 1 -- 172.21.15.78:0/3939153845 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f05b006c380 msgr2=0x7f05b006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.725+0000 7f05d1084640 1 --2- 172.21.15.78:0/3939153845 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f05b006c380 0x7f05b006e840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f05b8034000 tx=0x7f05b802e000 comp rx=0 tx=0).stop 2024-09-15T22:09:38.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.725+0000 7f05d1084640 1 -- 172.21.15.78:0/3939153845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c4006c80 msgr2=0x7f05c4022180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.725+0000 7f05d1084640 1 --2- 172.21.15.78:0/3939153845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c4006c80 0x7f05c4022180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009fd0 tx=0x7f05c000b870 comp rx=0 tx=0).stop 2024-09-15T22:09:38.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.725+0000 7f05d1084640 1 -- 172.21.15.78:0/3939153845 shutdown_connections 2024-09-15T22:09:38.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.725+0000 7f05d1084640 1 --2- 172.21.15.78:0/3939153845 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f05b006c380 0x7f05b006e840 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.725+0000 7f05d1084640 1 --2- 172.21.15.78:0/3939153845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c4031db0 0x7f05c40cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.725+0000 7f05d1084640 1 --2- 172.21.15.78:0/3939153845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05c40d3310 0x7f05c4031870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.725+0000 7f05d1084640 1 --2- 172.21.15.78:0/3939153845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c4006c80 0x7f05c4022180 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.725+0000 7f05d1084640 1 -- 172.21.15.78:0/3939153845 >> 172.21.15.78:0/3939153845 conn(0x7f05c4009280 msgr2=0x7f05c4005940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.725+0000 7f05d1084640 1 -- 172.21.15.78:0/3939153845 shutdown_connections 2024-09-15T22:09:38.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.725+0000 7f05d1084640 1 -- 172.21.15.78:0/3939153845 wait complete. 2024-09-15T22:09:38.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.2 2024-09-15T22:09:38.738 DEBUG:teuthology.parallel:result is None 2024-09-15T22:09:38.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.784+0000 7fc3ed7fa640 1 -- 172.21.15.78:0/1043389532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc3e0005580 con 0x7fc4080b4f90 2024-09-15T22:09:38.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.784+0000 7fc3ef7fe640 1 -- 172.21.15.78:0/1043389532 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc40814dda0 con 0x7fc4080b4f90 2024-09-15T22:09:38.786 INFO:teuthology.orchestra.run.smithi078.stdout:60129542153 2024-09-15T22:09:38.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.786+0000 7fc3ed7fa640 1 -- 172.21.15.78:0/1043389532 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc3f406c3b0 msgr2=0x7fc3f406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.786+0000 7fc3ed7fa640 1 --2- 172.21.15.78:0/1043389532 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc3f406c3b0 0x7fc3f406e870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc4000114f0 tx=0x7fc40000b040 comp rx=0 tx=0).stop 2024-09-15T22:09:38.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.786+0000 7fc3ed7fa640 1 -- 172.21.15.78:0/1043389532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4080b4f90 msgr2=0x7fc40814d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:38.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.786+0000 7fc3ed7fa640 1 --2- 172.21.15.78:0/1043389532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4080b4f90 0x7fc40814d860 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8042000 tx=0x7fc3f80046c0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.786+0000 7fc3ed7fa640 1 -- 172.21.15.78:0/1043389532 shutdown_connections 2024-09-15T22:09:38.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.786+0000 7fc3ed7fa640 1 --2- 172.21.15.78:0/1043389532 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc3f406c3b0 0x7fc3f406e870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.786+0000 7fc3ed7fa640 1 --2- 172.21.15.78:0/1043389532 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc408149670 0x7fc408073690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.786+0000 7fc3ed7fa640 1 --2- 172.21.15.78:0/1043389532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4080b4f90 0x7fc40814d860 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.786+0000 7fc3ed7fa640 1 --2- 172.21.15.78:0/1043389532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc408074e10 0x7fc4080b9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.786+0000 7fc3ed7fa640 1 -- 172.21.15.78:0/1043389532 >> 172.21.15.78:0/1043389532 conn(0x7fc4080ba2d0 msgr2=0x7fc40806d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.786+0000 7fc3ed7fa640 1 -- 172.21.15.78:0/1043389532 shutdown_connections 2024-09-15T22:09:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:38.786+0000 7fc3ed7fa640 1 -- 172.21.15.78:0/1043389532 wait complete. 2024-09-15T22:09:38.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.4 2024-09-15T22:09:39.677 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T22:09:39.688 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T22:09:39.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.787+0000 7f87a5949640 1 Processor -- start 2024-09-15T22:09:39.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.787+0000 7f87a5949640 1 -- start start 2024-09-15T22:09:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.788+0000 7f87a5949640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f87a013f5b0 0x7f87a013fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.788+0000 7f87a5949640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87a013ff80 con 0x7f87a00b2af0 2024-09-15T22:09:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.788+0000 7f87a5949640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87a00b3be0 con 0x7f87a0075950 2024-09-15T22:09:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.788+0000 7f87a5949640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f87a00b2ed0 con 0x7f87a013f5b0 2024-09-15T22:09:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.788+0000 7f879f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f87a013f5b0 0x7f87a013fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.788+0000 7f879effd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f87a00b2af0 0x7f87a00b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57068/0 (socket says 172.21.15.78:57068) 2024-09-15T22:09:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.788+0000 7f879effd640 1 -- 172.21.15.78:0/2103434313 learned_addr learned my addr 172.21.15.78:0/2103434313 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:39.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.788+0000 7f879f7fe640 1 -- 172.21.15.78:0/2103434313 >> v1:172.21.15.175:6789/0 conn(0x7f87a0075950 legacy=0x7f87a0145770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:39.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.788+0000 7f879f7fe640 1 -- 172.21.15.78:0/2103434313 >> v1:172.21.15.78:6789/0 conn(0x7f87a00b2af0 legacy=0x7f87a00b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:39.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.788+0000 7f879f7fe640 1 -- 172.21.15.78:0/2103434313 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a00b4d10 con 0x7f87a013f5b0 2024-09-15T22:09:39.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.789+0000 7f879f7fe640 1 --2- 172.21.15.78:0/2103434313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a013f5b0 0x7f87a013fa40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f87900097a0 tx=0x7f879002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68f2bea08de3817 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:39.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.789+0000 7f879dffb640 1 -- 172.21.15.78:0/2103434313 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790037070 con 0x7f87a013f5b0 2024-09-15T22:09:39.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.789+0000 7f879dffb640 1 -- 172.21.15.78:0/2103434313 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f879002ae50 con 0x7f87a013f5b0 2024-09-15T22:09:39.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.789+0000 7f879dffb640 1 -- 172.21.15.78:0/2103434313 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790032660 con 0x7f87a013f5b0 2024-09-15T22:09:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.790+0000 7f87a5949640 1 -- 172.21.15.78:0/2103434313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a013f5b0 msgr2=0x7f87a013fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.790+0000 7f87a5949640 1 --2- 172.21.15.78:0/2103434313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a013f5b0 0x7f87a013fa40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f87900097a0 tx=0x7f879002a140 comp rx=0 tx=0).stop 2024-09-15T22:09:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.790+0000 7f87a5949640 1 -- 172.21.15.78:0/2103434313 shutdown_connections 2024-09-15T22:09:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.790+0000 7f87a5949640 1 --2- 172.21.15.78:0/2103434313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a013f5b0 0x7f87a013fa40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.790+0000 7f87a5949640 1 -- 172.21.15.78:0/2103434313 >> 172.21.15.78:0/2103434313 conn(0x7f87a006c270 msgr2=0x7f87a006c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.790+0000 7f87a5949640 1 -- 172.21.15.78:0/2103434313 shutdown_connections 2024-09-15T22:09:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.790+0000 7f87a5949640 1 -- 172.21.15.78:0/2103434313 wait complete. 2024-09-15T22:09:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.791+0000 7f87a5949640 1 Processor -- start 2024-09-15T22:09:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.791+0000 7f87a5949640 1 -- start start 2024-09-15T22:09:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f87a5949640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87a0075950 0x7f87a0073e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f87a5949640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87a00b2af0 0x7f87a0147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f87a5949640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a013f5b0 0x7f87a013b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f87a5949640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f87a009c290 con 0x7f87a013f5b0 2024-09-15T22:09:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f87a5949640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f87a0075430 con 0x7f87a00b2af0 2024-09-15T22:09:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f87a5949640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f87a009c410 con 0x7f87a0075950 2024-09-15T22:09:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f879f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a013f5b0 0x7f87a013b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f879f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a013f5b0 0x7f87a013b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49976/0 (socket says 172.21.15.78:49976) 2024-09-15T22:09:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f879f7fe640 1 -- 172.21.15.78:0/599669193 learned_addr learned my addr 172.21.15.78:0/599669193 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f879e7fc640 1 --2- 172.21.15.78:0/599669193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87a00b2af0 0x7f87a0147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f879effd640 1 --2- 172.21.15.78:0/599669193 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87a0075950 0x7f87a0073e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f879f7fe640 1 -- 172.21.15.78:0/599669193 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87a0075950 msgr2=0x7f87a0073e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f879f7fe640 1 --2- 172.21.15.78:0/599669193 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87a0075950 0x7f87a0073e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f879f7fe640 1 -- 172.21.15.78:0/599669193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87a00b2af0 msgr2=0x7f87a0147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f879f7fe640 1 --2- 172.21.15.78:0/599669193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87a00b2af0 0x7f87a0147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f879f7fe640 1 -- 172.21.15.78:0/599669193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a0148e50 con 0x7f87a013f5b0 2024-09-15T22:09:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f879e7fc640 1 --2- 172.21.15.78:0/599669193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87a00b2af0 0x7f87a0147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f879f7fe640 1 --2- 172.21.15.78:0/599669193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a013f5b0 0x7f87a013b240 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f87900097a0 tx=0x7f87900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f8797fff640 1 -- 172.21.15.78:0/599669193 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790041070 con 0x7f87a013f5b0 2024-09-15T22:09:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.792+0000 7f8797fff640 1 -- 172.21.15.78:0/599669193 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8790032e10 con 0x7f87a013f5b0 2024-09-15T22:09:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.793+0000 7f8797fff640 1 -- 172.21.15.78:0/599669193 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790037040 con 0x7f87a013f5b0 2024-09-15T22:09:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.793+0000 7f87a5949640 1 -- 172.21.15.78:0/599669193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a0144e80 con 0x7f87a013f5b0 2024-09-15T22:09:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.793+0000 7f87a5949640 1 -- 172.21.15.78:0/599669193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a01467d0 con 0x7f87a013f5b0 2024-09-15T22:09:39.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.794+0000 7f87a5949640 1 -- 172.21.15.78:0/599669193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87a013fa40 con 0x7f87a013f5b0 2024-09-15T22:09:39.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.794+0000 7f8797fff640 1 -- 172.21.15.78:0/599669193 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8790044070 con 0x7f87a013f5b0 2024-09-15T22:09:39.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.794+0000 7f8797fff640 1 --2- 172.21.15.78:0/599669193 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f878006c2e0 0x7f878006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.795+0000 7f8797fff640 1 -- 172.21.15.78:0/599669193 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f87900abe00 con 0x7f87a013f5b0 2024-09-15T22:09:39.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.795+0000 7f879effd640 1 --2- 172.21.15.78:0/599669193 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f878006c2e0 0x7f878006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.795+0000 7f879effd640 1 --2- 172.21.15.78:0/599669193 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f878006c2e0 0x7f878006e7a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f87980012e0 tx=0x7f8798009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:39.800 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T22:09:39.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.799+0000 7f8797fff640 1 -- 172.21.15.78:0/599669193 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f879007a2c0 con 0x7f87a013f5b0 2024-09-15T22:09:39.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.826+0000 7f3d12c74640 1 Processor -- start 2024-09-15T22:09:39.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.826+0000 7f3d12c74640 1 -- start start 2024-09-15T22:09:39.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.827+0000 7f3d12c74640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d0c06d5c0 0x7f3d0c0b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.827+0000 7f3d12c74640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d0c144820 0x7f3d0c14f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.827+0000 7f3d12c74640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d0c0b1470 con 0x7f3d0c06d9a0 2024-09-15T22:09:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.827+0000 7f3d12c74640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f3d0c0b51e0 con 0x7f3d0c06d5c0 2024-09-15T22:09:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.827+0000 7f3d12c74640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3d0c0b4e70 con 0x7f3d0c144820 2024-09-15T22:09:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.827+0000 7f3d10a10640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d0c06d5c0 0x7f3d0c0b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.827+0000 7f3d10a10640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d0c06d5c0 0x7f3d0c0b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49988/0 (socket says 172.21.15.78:49988) 2024-09-15T22:09:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.827+0000 7f3d10a10640 1 -- 172.21.15.78:0/3134048194 learned_addr learned my addr 172.21.15.78:0/3134048194 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.827+0000 7f3d11211640 1 --2- 172.21.15.78:0/3134048194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d0c144820 0x7f3d0c14f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.827+0000 7f3d10a10640 1 -- 172.21.15.78:0/3134048194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d0c144820 msgr2=0x7f3d0c14f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.827+0000 7f3d10a10640 1 --2- 172.21.15.78:0/3134048194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d0c144820 0x7f3d0c14f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.827+0000 7f3d10a10640 1 -- 172.21.15.78:0/3134048194 >> v1:172.21.15.175:6789/0 conn(0x7f3d0c06d9a0 legacy=0x7f3d0c0b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.827+0000 7f3d10a10640 1 -- 172.21.15.78:0/3134048194 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c144cb0 con 0x7f3d0c06d5c0 2024-09-15T22:09:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.827+0000 7f3d11211640 1 --2- 172.21.15.78:0/3134048194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d0c144820 0x7f3d0c14f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.828+0000 7f3d10a10640 1 --2- 172.21.15.78:0/3134048194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d0c06d5c0 0x7f3d0c0b5670 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009870 tx=0x7f3d0002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41df1e79b71845c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:39.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.828+0000 7f3d0b7fe640 1 -- 172.21.15.78:0/3134048194 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00037070 con 0x7f3d0c06d5c0 2024-09-15T22:09:39.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.828+0000 7f3d0b7fe640 1 -- 172.21.15.78:0/3134048194 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d00032440 con 0x7f3d0c06d5c0 2024-09-15T22:09:39.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.828+0000 7f3d0b7fe640 1 -- 172.21.15.78:0/3134048194 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00032810 con 0x7f3d0c06d5c0 2024-09-15T22:09:39.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.829+0000 7f3d12c74640 1 -- 172.21.15.78:0/3134048194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d0c06d5c0 msgr2=0x7f3d0c0b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:39.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.829+0000 7f3d12c74640 1 --2- 172.21.15.78:0/3134048194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d0c06d5c0 0x7f3d0c0b5670 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009870 tx=0x7f3d0002a130 comp rx=0 tx=0).stop 2024-09-15T22:09:39.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.829+0000 7f3d12c74640 1 -- 172.21.15.78:0/3134048194 shutdown_connections 2024-09-15T22:09:39.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.829+0000 7f3d12c74640 1 --2- 172.21.15.78:0/3134048194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d0c144820 0x7f3d0c14f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.829+0000 7f3d12c74640 1 --2- 172.21.15.78:0/3134048194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d0c06d5c0 0x7f3d0c0b5670 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.829+0000 7f3d12c74640 1 -- 172.21.15.78:0/3134048194 >> 172.21.15.78:0/3134048194 conn(0x7f3d0c0ba2d0 msgr2=0x7f3d0c0ba6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:39.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.829+0000 7f3d12c74640 1 -- 172.21.15.78:0/3134048194 shutdown_connections 2024-09-15T22:09:39.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.829+0000 7f3d12c74640 1 -- 172.21.15.78:0/3134048194 wait complete. 2024-09-15T22:09:39.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.830+0000 7f3d12c74640 1 Processor -- start 2024-09-15T22:09:39.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.830+0000 7f3d12c74640 1 -- start start 2024-09-15T22:09:39.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d12c74640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d0c06d5c0 0x7f3d0c09e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d12c74640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d0c06d9a0 0x7f3d0c1d1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d12c74640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d0c144820 0x7f3d0c1e0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d12c74640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c09cfd0 con 0x7f3d0c144820 2024-09-15T22:09:39.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d12c74640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c09ce50 con 0x7f3d0c06d5c0 2024-09-15T22:09:39.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d12c74640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3d0c0badf0 con 0x7f3d0c06d9a0 2024-09-15T22:09:39.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d11211640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d0c144820 0x7f3d0c1e0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d11211640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d0c144820 0x7f3d0c1e0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50000/0 (socket says 172.21.15.78:50000) 2024-09-15T22:09:39.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d11211640 1 -- 172.21.15.78:0/2914756857 learned_addr learned my addr 172.21.15.78:0/2914756857 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:39.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d10a10640 1 --2- 172.21.15.78:0/2914756857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d0c06d5c0 0x7f3d0c09e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d0bfff640 1 --2- 172.21.15.78:0/2914756857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d0c06d9a0 0x7f3d0c1d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d11211640 1 -- 172.21.15.78:0/2914756857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d0c06d9a0 msgr2=0x7f3d0c1d1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:39.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d11211640 1 --2- 172.21.15.78:0/2914756857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d0c06d9a0 0x7f3d0c1d1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d11211640 1 -- 172.21.15.78:0/2914756857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d0c06d5c0 msgr2=0x7f3d0c09e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:39.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d11211640 1 --2- 172.21.15.78:0/2914756857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d0c06d5c0 0x7f3d0c09e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d11211640 1 -- 172.21.15.78:0/2914756857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c0b1c20 con 0x7f3d0c144820 2024-09-15T22:09:39.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d0bfff640 1 --2- 172.21.15.78:0/2914756857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d0c06d9a0 0x7f3d0c1d1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:39.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.831+0000 7f3d11211640 1 --2- 172.21.15.78:0/2914756857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d0c144820 0x7f3d0c1e0ea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3d04007df0 tx=0x7f3d0400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:39.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.832+0000 7f3d097fa640 1 -- 172.21.15.78:0/2914756857 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0401a070 con 0x7f3d0c144820 2024-09-15T22:09:39.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.832+0000 7f3d097fa640 1 -- 172.21.15.78:0/2914756857 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d04003990 con 0x7f3d0c144820 2024-09-15T22:09:39.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.832+0000 7f3d097fa640 1 -- 172.21.15.78:0/2914756857 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04003d80 con 0x7f3d0c144820 2024-09-15T22:09:39.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.832+0000 7f3d12c74640 1 -- 172.21.15.78:0/2914756857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d0c0b1f00 con 0x7f3d0c144820 2024-09-15T22:09:39.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.832+0000 7f3d12c74640 1 -- 172.21.15.78:0/2914756857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d0c0b95a0 con 0x7f3d0c144820 2024-09-15T22:09:39.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.833+0000 7f3d12c74640 1 -- 172.21.15.78:0/2914756857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d0c145760 con 0x7f3d0c144820 2024-09-15T22:09:39.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.833+0000 7f3d097fa640 1 -- 172.21.15.78:0/2914756857 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3d0401d070 con 0x7f3d0c144820 2024-09-15T22:09:39.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.834+0000 7f3d097fa640 1 --2- 172.21.15.78:0/2914756857 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3cf006c2b0 0x7f3cf006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.834+0000 7f3d097fa640 1 -- 172.21.15.78:0/2914756857 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3d0408b940 con 0x7f3d0c144820 2024-09-15T22:09:39.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.834+0000 7f3d10a10640 1 --2- 172.21.15.78:0/2914756857 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3cf006c2b0 0x7f3cf006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.835+0000 7f3d10a10640 1 --2- 172.21.15.78:0/2914756857 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3cf006c2b0 0x7f3cf006e770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3d00034000 tx=0x7f3d0002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:39.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.838+0000 7f3d097fa640 1 -- 172.21.15.78:0/2914756857 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d04010070 con 0x7f3d0c144820 2024-09-15T22:09:39.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.908+0000 7f3278d98640 1 Processor -- start 2024-09-15T22:09:39.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.908+0000 7f3278d98640 1 -- start start 2024-09-15T22:09:39.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.909+0000 7f3278d98640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f32740ba270 0x7f32740b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.909+0000 7f3278d98640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f32741417f0 0x7f3274141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.909+0000 7f3278d98640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32740b6c90 con 0x7f32740b7f70 2024-09-15T22:09:39.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.909+0000 7f3278d98640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f32740b6f00 con 0x7f32740ba270 2024-09-15T22:09:39.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.909+0000 7f3278d98640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f32740b7a80 con 0x7f32741417f0 2024-09-15T22:09:39.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.909+0000 7f327259c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f32740ba270 0x7f32740b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.909+0000 7f327259c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f32740ba270 0x7f32740b97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50016/0 (socket says 172.21.15.78:50016) 2024-09-15T22:09:39.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.909+0000 7f327259c640 1 -- 172.21.15.78:0/328604435 learned_addr learned my addr 172.21.15.78:0/328604435 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:39.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.909+0000 7f3271d9b640 1 --2- 172.21.15.78:0/328604435 >> v2:172.21.15.175:3300/0 conn(0x7f32741417f0 0x7f3274141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.910+0000 7f327259c640 1 -- 172.21.15.78:0/328604435 >> v2:172.21.15.175:3300/0 conn(0x7f32741417f0 msgr2=0x7f3274141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:39.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.910+0000 7f327259c640 1 --2- 172.21.15.78:0/328604435 >> v2:172.21.15.175:3300/0 conn(0x7f32741417f0 0x7f3274141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.910+0000 7f327259c640 1 -- 172.21.15.78:0/328604435 >> v1:172.21.15.175:6789/0 conn(0x7f32740b7f70 legacy=0x7f32740b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:39.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.910+0000 7f327259c640 1 -- 172.21.15.78:0/328604435 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32740ba650 con 0x7f32740ba270 2024-09-15T22:09:39.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.910+0000 7f327259c640 1 --2- 172.21.15.78:0/328604435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32740ba270 0x7f32740b97b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f32740b6510 tx=0x7f326402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdb1bcef494bf01 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:39.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.910+0000 7f327159a640 1 -- 172.21.15.78:0/328604435 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3264037070 con 0x7f32740ba270 2024-09-15T22:09:39.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.911+0000 7f327159a640 1 -- 172.21.15.78:0/328604435 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f326402ae20 con 0x7f32740ba270 2024-09-15T22:09:39.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.911+0000 7f327159a640 1 -- 172.21.15.78:0/328604435 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3264032660 con 0x7f32740ba270 2024-09-15T22:09:39.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.911+0000 7f3278d98640 1 -- 172.21.15.78:0/328604435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32740ba270 msgr2=0x7f32740b97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:39.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.911+0000 7f3278d98640 1 --2- 172.21.15.78:0/328604435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32740ba270 0x7f32740b97b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f32740b6510 tx=0x7f326402a110 comp rx=0 tx=0).stop 2024-09-15T22:09:39.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.911+0000 7f3278d98640 1 -- 172.21.15.78:0/328604435 shutdown_connections 2024-09-15T22:09:39.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.911+0000 7f3278d98640 1 --2- 172.21.15.78:0/328604435 >> v2:172.21.15.175:3300/0 conn(0x7f32741417f0 0x7f3274141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.911+0000 7f3278d98640 1 --2- 172.21.15.78:0/328604435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32740ba270 0x7f32740b97b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.911+0000 7f3278d98640 1 -- 172.21.15.78:0/328604435 >> 172.21.15.78:0/328604435 conn(0x7f3274074ba0 msgr2=0x7f3274074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:39.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.912+0000 7f3278d98640 1 -- 172.21.15.78:0/328604435 shutdown_connections 2024-09-15T22:09:39.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.912+0000 7f3278d98640 1 -- 172.21.15.78:0/328604435 wait complete. 2024-09-15T22:09:39.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.913+0000 7f3278d98640 1 Processor -- start 2024-09-15T22:09:39.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.913+0000 7f3278d98640 1 -- start start 2024-09-15T22:09:39.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.914+0000 7f3278d98640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32740b7f70 0x7f3274147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.914+0000 7f3278d98640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32740ba270 0x7f32741e1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.914+0000 7f3278d98640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32741417f0 0x7f327413f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.914+0000 7f3278d98640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32740b77a0 con 0x7f32740b7f70 2024-09-15T22:09:39.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.914+0000 7f3278d98640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f32740b74c0 con 0x7f32741417f0 2024-09-15T22:09:39.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.914+0000 7f3278d98640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f32740b4a70 con 0x7f32740ba270 2024-09-15T22:09:39.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.914+0000 7f327259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32740b7f70 0x7f3274147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.914+0000 7f327259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32740b7f70 0x7f3274147d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50032/0 (socket says 172.21.15.78:50032) 2024-09-15T22:09:39.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.914+0000 7f327259c640 1 -- 172.21.15.78:0/3160411333 learned_addr learned my addr 172.21.15.78:0/3160411333 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:39.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.915+0000 7f3272d9d640 1 --2- 172.21.15.78:0/3160411333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32741417f0 0x7f327413f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.915+0000 7f3271d9b640 1 --2- 172.21.15.78:0/3160411333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32740ba270 0x7f32741e1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.915+0000 7f327259c640 1 -- 172.21.15.78:0/3160411333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32740ba270 msgr2=0x7f32741e1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:39.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.915+0000 7f327259c640 1 --2- 172.21.15.78:0/3160411333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32740ba270 0x7f32741e1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.915+0000 7f327259c640 1 -- 172.21.15.78:0/3160411333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32741417f0 msgr2=0x7f327413f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:39.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.915+0000 7f327259c640 1 --2- 172.21.15.78:0/3160411333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32741417f0 0x7f327413f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.915+0000 7f327259c640 1 -- 172.21.15.78:0/3160411333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32740ab2e0 con 0x7f32740b7f70 2024-09-15T22:09:39.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.915+0000 7f3271d9b640 1 --2- 172.21.15.78:0/3160411333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32740ba270 0x7f32741e1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:39.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.915+0000 7f327259c640 1 --2- 172.21.15.78:0/3160411333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32740b7f70 0x7f3274147d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3264000c00 tx=0x7f32640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:39.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.915+0000 7f3262ffd640 1 -- 172.21.15.78:0/3160411333 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3264041070 con 0x7f32740b7f70 2024-09-15T22:09:39.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.915+0000 7f3262ffd640 1 -- 172.21.15.78:0/3160411333 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f326403c670 con 0x7f32740b7f70 2024-09-15T22:09:39.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.915+0000 7f3278d98640 1 -- 172.21.15.78:0/3160411333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32740ab550 con 0x7f32740b7f70 2024-09-15T22:09:39.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.915+0000 7f3262ffd640 1 -- 172.21.15.78:0/3160411333 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3264037040 con 0x7f32740b7f70 2024-09-15T22:09:39.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.915+0000 7f3278d98640 1 -- 172.21.15.78:0/3160411333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32741e0a70 con 0x7f32740b7f70 2024-09-15T22:09:39.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.916+0000 7f3278d98640 1 -- 172.21.15.78:0/3160411333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32740b5ce0 con 0x7f32740b7f70 2024-09-15T22:09:39.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.917+0000 7f3262ffd640 1 -- 172.21.15.78:0/3160411333 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3264044070 con 0x7f32740b7f70 2024-09-15T22:09:39.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.917+0000 7f3262ffd640 1 --2- 172.21.15.78:0/3160411333 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f325406c2b0 0x7f325406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:39.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.917+0000 7f3262ffd640 1 -- 172.21.15.78:0/3160411333 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f32640abf40 con 0x7f32740b7f70 2024-09-15T22:09:39.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.917+0000 7f3271d9b640 1 --2- 172.21.15.78:0/3160411333 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f325406c2b0 0x7f325406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:39.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.918+0000 7f3271d9b640 1 --2- 172.21.15.78:0/3160411333 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f325406c2b0 0x7f325406e770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f32741d25b0 tx=0x7f3268008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:39.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.926+0000 7f3262ffd640 1 -- 172.21.15.78:0/3160411333 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f326407a520 con 0x7f32740b7f70 2024-09-15T22:09:39.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.979+0000 7f87a5949640 1 -- 172.21.15.78:0/599669193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f87a01477c0 con 0x7f87a013f5b0 2024-09-15T22:09:39.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.980+0000 7f8797fff640 1 -- 172.21.15.78:0/599669193 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8790079bc0 con 0x7f87a013f5b0 2024-09-15T22:09:39.982 INFO:teuthology.orchestra.run.smithi078.stdout:60129542152 2024-09-15T22:09:39.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.982+0000 7f87a5949640 1 -- 172.21.15.78:0/599669193 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f878006c2e0 msgr2=0x7f878006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:39.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.982+0000 7f87a5949640 1 --2- 172.21.15.78:0/599669193 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f878006c2e0 0x7f878006e7a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f87980012e0 tx=0x7f8798009040 comp rx=0 tx=0).stop 2024-09-15T22:09:39.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.982+0000 7f87a5949640 1 -- 172.21.15.78:0/599669193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a013f5b0 msgr2=0x7f87a013b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:39.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.982+0000 7f87a5949640 1 --2- 172.21.15.78:0/599669193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a013f5b0 0x7f87a013b240 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f87900097a0 tx=0x7f87900046c0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.982+0000 7f87a5949640 1 -- 172.21.15.78:0/599669193 shutdown_connections 2024-09-15T22:09:39.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.982+0000 7f87a5949640 1 --2- 172.21.15.78:0/599669193 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f878006c2e0 0x7f878006e7a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.982+0000 7f87a5949640 1 --2- 172.21.15.78:0/599669193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a013f5b0 0x7f87a013b240 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.982+0000 7f87a5949640 1 --2- 172.21.15.78:0/599669193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87a00b2af0 0x7f87a0147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.982+0000 7f87a5949640 1 --2- 172.21.15.78:0/599669193 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87a0075950 0x7f87a0073e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:39.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.982+0000 7f87a5949640 1 -- 172.21.15.78:0/599669193 >> 172.21.15.78:0/599669193 conn(0x7f87a006c270 msgr2=0x7f87a00b5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:39.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.982+0000 7f87a5949640 1 -- 172.21.15.78:0/599669193 shutdown_connections 2024-09-15T22:09:39.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:39.982+0000 7f87a5949640 1 -- 172.21.15.78:0/599669193 wait complete. 2024-09-15T22:09:39.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.0 2024-09-15T22:09:40.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.027+0000 7f3d12c74640 1 -- 172.21.15.78:0/2914756857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f3d0c143030 con 0x7f3d0c144820 2024-09-15T22:09:40.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.028+0000 7f3d097fa640 1 -- 172.21.15.78:0/2914756857 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3d04059720 con 0x7f3d0c144820 2024-09-15T22:09:40.030 INFO:teuthology.orchestra.run.smithi078.stdout:60129542152 2024-09-15T22:09:40.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.030+0000 7f3d12c74640 1 -- 172.21.15.78:0/2914756857 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3cf006c2b0 msgr2=0x7f3cf006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:40.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.030+0000 7f3d12c74640 1 --2- 172.21.15.78:0/2914756857 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3cf006c2b0 0x7f3cf006e770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3d00034000 tx=0x7f3d0002e000 comp rx=0 tx=0).stop 2024-09-15T22:09:40.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.030+0000 7f3d12c74640 1 -- 172.21.15.78:0/2914756857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d0c144820 msgr2=0x7f3d0c1e0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:40.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.030+0000 7f3d12c74640 1 --2- 172.21.15.78:0/2914756857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d0c144820 0x7f3d0c1e0ea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3d04007df0 tx=0x7f3d0400d4a0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.030+0000 7f3d12c74640 1 -- 172.21.15.78:0/2914756857 shutdown_connections 2024-09-15T22:09:40.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.030+0000 7f3d12c74640 1 --2- 172.21.15.78:0/2914756857 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3cf006c2b0 0x7f3cf006e770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.030+0000 7f3d12c74640 1 --2- 172.21.15.78:0/2914756857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d0c144820 0x7f3d0c1e0ea0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.030+0000 7f3d12c74640 1 --2- 172.21.15.78:0/2914756857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d0c06d9a0 0x7f3d0c1d1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.030+0000 7f3d12c74640 1 --2- 172.21.15.78:0/2914756857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d0c06d5c0 0x7f3d0c09e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.030+0000 7f3d12c74640 1 -- 172.21.15.78:0/2914756857 >> 172.21.15.78:0/2914756857 conn(0x7f3d0c0ba2d0 msgr2=0x7f3d0c141930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:40.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.030+0000 7f3d12c74640 1 -- 172.21.15.78:0/2914756857 shutdown_connections 2024-09-15T22:09:40.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.030+0000 7f3d12c74640 1 -- 172.21.15.78:0/2914756857 wait complete. 2024-09-15T22:09:40.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.5 2024-09-15T22:09:40.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.100+0000 7f3278d98640 1 -- 172.21.15.78:0/3160411333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f32741d3570 con 0x7f32740b7f70 2024-09-15T22:09:40.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.101+0000 7f3262ffd640 1 -- 172.21.15.78:0/3160411333 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f326402ae20 con 0x7f32740b7f70 2024-09-15T22:09:40.103 INFO:teuthology.orchestra.run.smithi078.stdout:60129542153 2024-09-15T22:09:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.103+0000 7f3278d98640 1 -- 172.21.15.78:0/3160411333 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f325406c2b0 msgr2=0x7f325406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.103+0000 7f3278d98640 1 --2- 172.21.15.78:0/3160411333 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f325406c2b0 0x7f325406e770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f32741d25b0 tx=0x7f3268008040 comp rx=0 tx=0).stop 2024-09-15T22:09:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.103+0000 7f3278d98640 1 -- 172.21.15.78:0/3160411333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32740b7f70 msgr2=0x7f3274147d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.103+0000 7f3278d98640 1 --2- 172.21.15.78:0/3160411333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32740b7f70 0x7f3274147d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3264000c00 tx=0x7f32640046c0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.103+0000 7f3278d98640 1 -- 172.21.15.78:0/3160411333 shutdown_connections 2024-09-15T22:09:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.103+0000 7f3278d98640 1 --2- 172.21.15.78:0/3160411333 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f325406c2b0 0x7f325406e770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.103+0000 7f3278d98640 1 --2- 172.21.15.78:0/3160411333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32741417f0 0x7f327413f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.103+0000 7f3278d98640 1 --2- 172.21.15.78:0/3160411333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32740ba270 0x7f32741e1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.103+0000 7f3278d98640 1 --2- 172.21.15.78:0/3160411333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32740b7f70 0x7f3274147d20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.103+0000 7f3278d98640 1 -- 172.21.15.78:0/3160411333 >> 172.21.15.78:0/3160411333 conn(0x7f3274074ba0 msgr2=0x7f3274140b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:40.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.103+0000 7f3278d98640 1 -- 172.21.15.78:0/3160411333 shutdown_connections 2024-09-15T22:09:40.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:40.103+0000 7f3278d98640 1 -- 172.21.15.78:0/3160411333 wait complete. 2024-09-15T22:09:40.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.4 2024-09-15T22:09:40.995 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T22:09:41.044 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T22:09:41.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.096+0000 7f275616d640 1 Processor -- start 2024-09-15T22:09:41.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.096+0000 7f275616d640 1 -- start start 2024-09-15T22:09:41.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.097+0000 7f275616d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f275006d5c0 0x7f27500b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.097+0000 7f275616d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f275006d9a0 0x7f2750144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.097+0000 7f275616d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27500b0730 0x7f27500b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.097+0000 7f275616d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f2750144d60 con 0x7f27500b0730 2024-09-15T22:09:41.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.097+0000 7f275616d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f27500b51e0 con 0x7f275006d5c0 2024-09-15T22:09:41.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.097+0000 7f275616d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f27500b1470 con 0x7f275006d9a0 2024-09-15T22:09:41.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.097+0000 7f274ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27500b0730 0x7f27500b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.097+0000 7f274ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27500b0730 0x7f27500b0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37192/0 (socket says 172.21.15.78:37192) 2024-09-15T22:09:41.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.097+0000 7f274ffff640 1 -- 172.21.15.78:0/3333925755 learned_addr learned my addr 172.21.15.78:0/3333925755 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:41.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.097+0000 7f274f7fe640 1 --2- 172.21.15.78:0/3333925755 >> v2:172.21.15.175:3300/0 conn(0x7f275006d5c0 0x7f27500b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.097+0000 7f2746ffd640 1 --2- 172.21.15.78:0/3333925755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f275006d9a0 0x7f2750144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.098+0000 7f274ffff640 1 -- 172.21.15.78:0/3333925755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f275006d9a0 msgr2=0x7f2750144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:41.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.098+0000 7f274ffff640 1 --2- 172.21.15.78:0/3333925755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f275006d9a0 0x7f2750144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.098+0000 7f274ffff640 1 -- 172.21.15.78:0/3333925755 >> v2:172.21.15.175:3300/0 conn(0x7f275006d5c0 msgr2=0x7f27500b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:41.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.098+0000 7f274ffff640 1 --2- 172.21.15.78:0/3333925755 >> v2:172.21.15.175:3300/0 conn(0x7f275006d5c0 0x7f27500b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.098+0000 7f274ffff640 1 -- 172.21.15.78:0/3333925755 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27500b4e70 con 0x7f27500b0730 2024-09-15T22:09:41.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.098+0000 7f274f7fe640 1 --2- 172.21.15.78:0/3333925755 >> v2:172.21.15.175:3300/0 conn(0x7f275006d5c0 0x7f27500b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:41.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.099+0000 7f274ffff640 1 --2- 172.21.15.78:0/3333925755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27500b0730 0x7f27500b0be0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2748009e50 tx=0x7f274802a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e741d2a38a719c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:41.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.099+0000 7f274effd640 1 -- 172.21.15.78:0/3333925755 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748036070 con 0x7f27500b0730 2024-09-15T22:09:41.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.099+0000 7f274effd640 1 -- 172.21.15.78:0/3333925755 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2748031600 con 0x7f27500b0730 2024-09-15T22:09:41.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.099+0000 7f274effd640 1 -- 172.21.15.78:0/3333925755 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480319d0 con 0x7f27500b0730 2024-09-15T22:09:41.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.100+0000 7f275616d640 1 -- 172.21.15.78:0/3333925755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27500b0730 msgr2=0x7f27500b0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.100+0000 7f275616d640 1 --2- 172.21.15.78:0/3333925755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27500b0730 0x7f27500b0be0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2748009e50 tx=0x7f274802a5b0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.100+0000 7f275616d640 1 -- 172.21.15.78:0/3333925755 shutdown_connections 2024-09-15T22:09:41.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.100+0000 7f275616d640 1 --2- 172.21.15.78:0/3333925755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27500b0730 0x7f27500b0be0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.100+0000 7f275616d640 1 --2- 172.21.15.78:0/3333925755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f275006d9a0 0x7f2750144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.100+0000 7f275616d640 1 --2- 172.21.15.78:0/3333925755 >> v2:172.21.15.175:3300/0 conn(0x7f275006d5c0 0x7f27500b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.100+0000 7f275616d640 1 -- 172.21.15.78:0/3333925755 >> 172.21.15.78:0/3333925755 conn(0x7f27500ba2d0 msgr2=0x7f27500ba6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:41.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.100+0000 7f275616d640 1 -- 172.21.15.78:0/3333925755 shutdown_connections 2024-09-15T22:09:41.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.100+0000 7f275616d640 1 -- 172.21.15.78:0/3333925755 wait complete. 2024-09-15T22:09:41.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.101+0000 7f275616d640 1 Processor -- start 2024-09-15T22:09:41.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.101+0000 7f275616d640 1 -- start start 2024-09-15T22:09:41.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.101+0000 7f275616d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f275006d5c0 0x7f2750072ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.101+0000 7f275616d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f275006d9a0 0x7f27500b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.101+0000 7f275616d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27500b0730 0x7f27500b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.101+0000 7f275616d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f275009cfd0 con 0x7f275006d9a0 2024-09-15T22:09:41.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.101+0000 7f275616d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f275009ce50 con 0x7f27500b0730 2024-09-15T22:09:41.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.101+0000 7f275616d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f27500badf0 con 0x7f275006d5c0 2024-09-15T22:09:41.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f2746ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f275006d9a0 0x7f27500b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f2746ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f275006d9a0 0x7f27500b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37204/0 (socket says 172.21.15.78:37204) 2024-09-15T22:09:41.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f2746ffd640 1 -- 172.21.15.78:0/507346958 learned_addr learned my addr 172.21.15.78:0/507346958 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:41.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f274f7fe640 1 --2- 172.21.15.78:0/507346958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f275006d5c0 0x7f2750072ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f274ffff640 1 --2- 172.21.15.78:0/507346958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27500b0730 0x7f27500b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f2746ffd640 1 -- 172.21.15.78:0/507346958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f275006d5c0 msgr2=0x7f2750072ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f2746ffd640 1 --2- 172.21.15.78:0/507346958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f275006d5c0 0x7f2750072ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f2746ffd640 1 -- 172.21.15.78:0/507346958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27500b0730 msgr2=0x7f27500b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f2746ffd640 1 --2- 172.21.15.78:0/507346958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27500b0730 0x7f27500b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f2746ffd640 1 -- 172.21.15.78:0/507346958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27500b1a00 con 0x7f275006d9a0 2024-09-15T22:09:41.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f2746ffd640 1 --2- 172.21.15.78:0/507346958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f275006d9a0 0x7f27500b21e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f273800e980 tx=0x7f273800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:41.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f274cff9640 1 -- 172.21.15.78:0/507346958 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738017070 con 0x7f275006d9a0 2024-09-15T22:09:41.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f274cff9640 1 -- 172.21.15.78:0/507346958 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f273800ca00 con 0x7f275006d9a0 2024-09-15T22:09:41.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f275616d640 1 -- 172.21.15.78:0/507346958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2750073710 con 0x7f275006d9a0 2024-09-15T22:09:41.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f274cff9640 1 -- 172.21.15.78:0/507346958 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273800cdd0 con 0x7f275006d9a0 2024-09-15T22:09:41.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.102+0000 7f275616d640 1 -- 172.21.15.78:0/507346958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f275009f1a0 con 0x7f275006d9a0 2024-09-15T22:09:41.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.103+0000 7f2745ffb640 1 -- 172.21.15.78:0/507346958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2728005290 con 0x7f275006d9a0 2024-09-15T22:09:41.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.104+0000 7f274cff9640 1 -- 172.21.15.78:0/507346958 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f273801a070 con 0x7f275006d9a0 2024-09-15T22:09:41.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.104+0000 7f274cff9640 1 --2- 172.21.15.78:0/507346958 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f273006c2e0 0x7f273006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.104+0000 7f274cff9640 1 -- 172.21.15.78:0/507346958 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f273808bad0 con 0x7f275006d9a0 2024-09-15T22:09:41.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.104+0000 7f274f7fe640 1 --2- 172.21.15.78:0/507346958 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f273006c2e0 0x7f273006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.105+0000 7f274f7fe640 1 --2- 172.21.15.78:0/507346958 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f273006c2e0 0x7f273006e7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2740009950 tx=0x7f2740008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:41.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.109+0000 7f274cff9640 1 -- 172.21.15.78:0/507346958 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2738059810 con 0x7f275006d9a0 2024-09-15T22:09:41.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T22:09:41.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.145+0000 7f2dc872c640 1 Processor -- start 2024-09-15T22:09:41.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.145+0000 7f2dc872c640 1 -- start start 2024-09-15T22:09:41.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.146+0000 7f2dc872c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2dc00630c0 0x7f2dc00afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.146+0000 7f2dc872c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2dc00736b0 0x7f2dc0147b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.146+0000 7f2dc872c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc00b63c0 con 0x7f2dc00af950 2024-09-15T22:09:41.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.146+0000 7f2dc872c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f2dc00634a0 con 0x7f2dc00630c0 2024-09-15T22:09:41.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.146+0000 7f2dc872c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f2dc00b0440 con 0x7f2dc00736b0 2024-09-15T22:09:41.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.146+0000 7f2dc64c8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2dc00630c0 0x7f2dc00afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.146+0000 7f2dc64c8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2dc00630c0 0x7f2dc00afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37214/0 (socket says 172.21.15.78:37214) 2024-09-15T22:09:41.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.146+0000 7f2dc5cc7640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2dc00af950 0x7f2dc0072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54778/0 (socket says 172.21.15.78:54778) 2024-09-15T22:09:41.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.146+0000 7f2dc64c8640 1 -- 172.21.15.78:0/1312886370 learned_addr learned my addr 172.21.15.78:0/1312886370 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:41.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.146+0000 7f2dc6cc9640 1 --2- 172.21.15.78:0/1312886370 >> v2:172.21.15.175:3300/0 conn(0x7f2dc00736b0 0x7f2dc0147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.147+0000 7f2dc64c8640 1 -- 172.21.15.78:0/1312886370 >> v2:172.21.15.175:3300/0 conn(0x7f2dc00736b0 msgr2=0x7f2dc0147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:41.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.147+0000 7f2dc64c8640 1 --2- 172.21.15.78:0/1312886370 >> v2:172.21.15.175:3300/0 conn(0x7f2dc00736b0 0x7f2dc0147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.147+0000 7f2dc64c8640 1 -- 172.21.15.78:0/1312886370 >> v1:172.21.15.78:6789/0 conn(0x7f2dc00af950 legacy=0x7f2dc0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.147+0000 7f2dc54c6640 1 -- 172.21.15.78:0/1312886370 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 270950280 0 0) 0x7f2dc00b63c0 con 0x7f2dc00af950 2024-09-15T22:09:41.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.147+0000 7f2dc64c8640 1 -- 172.21.15.78:0/1312886370 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc00b0720 con 0x7f2dc00630c0 2024-09-15T22:09:41.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.147+0000 7f2dc64c8640 1 --2- 172.21.15.78:0/1312886370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc00630c0 0x7f2dc00afde0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0074400 tx=0x7f2dbc02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dc1e50bf248f84 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:41.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.147+0000 7f2dc54c6640 1 -- 172.21.15.78:0/1312886370 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc037070 con 0x7f2dc00630c0 2024-09-15T22:09:41.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.148+0000 7f2dc54c6640 1 -- 172.21.15.78:0/1312886370 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dbc032440 con 0x7f2dc00630c0 2024-09-15T22:09:41.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.148+0000 7f2dc54c6640 1 -- 172.21.15.78:0/1312886370 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc032810 con 0x7f2dc00630c0 2024-09-15T22:09:41.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.148+0000 7f2dc872c640 1 -- 172.21.15.78:0/1312886370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc00630c0 msgr2=0x7f2dc00afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.148+0000 7f2dc872c640 1 --2- 172.21.15.78:0/1312886370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc00630c0 0x7f2dc00afde0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0074400 tx=0x7f2dbc02a150 comp rx=0 tx=0).stop 2024-09-15T22:09:41.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.148+0000 7f2dc872c640 1 -- 172.21.15.78:0/1312886370 shutdown_connections 2024-09-15T22:09:41.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.148+0000 7f2dc872c640 1 --2- 172.21.15.78:0/1312886370 >> v2:172.21.15.175:3300/0 conn(0x7f2dc00736b0 0x7f2dc0147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.148+0000 7f2dc872c640 1 --2- 172.21.15.78:0/1312886370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc00630c0 0x7f2dc00afde0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.148+0000 7f2dc872c640 1 -- 172.21.15.78:0/1312886370 >> 172.21.15.78:0/1312886370 conn(0x7f2dc00ba760 msgr2=0x7f2dc00b65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:41.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.148+0000 7f2dc872c640 1 -- 172.21.15.78:0/1312886370 shutdown_connections 2024-09-15T22:09:41.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.148+0000 7f2dc872c640 1 -- 172.21.15.78:0/1312886370 wait complete. 2024-09-15T22:09:41.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.149+0000 7f2dc872c640 1 Processor -- start 2024-09-15T22:09:41.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.150+0000 7f2dc872c640 1 -- start start 2024-09-15T22:09:41.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.150+0000 7f2dc872c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2dc00630c0 0x7f2dc01ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.150+0000 7f2dc872c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc00736b0 0x7f2dc0070c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.150+0000 7f2dc872c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc00af950 0x7f2dc00711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.150+0000 7f2dc872c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc00af360 con 0x7f2dc00736b0 2024-09-15T22:09:41.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.150+0000 7f2dc872c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc00af1e0 con 0x7f2dc00af950 2024-09-15T22:09:41.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.150+0000 7f2dc872c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc00af4e0 con 0x7f2dc00630c0 2024-09-15T22:09:41.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.150+0000 7f2dc5cc7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc00736b0 0x7f2dc0070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.150+0000 7f2dc5cc7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc00736b0 0x7f2dc0070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37228/0 (socket says 172.21.15.78:37228) 2024-09-15T22:09:41.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.150+0000 7f2dc5cc7640 1 -- 172.21.15.78:0/2213718695 learned_addr learned my addr 172.21.15.78:0/2213718695 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:41.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.150+0000 7f2dc6cc9640 1 --2- 172.21.15.78:0/2213718695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc00af950 0x7f2dc00711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.150+0000 7f2dc64c8640 1 --2- 172.21.15.78:0/2213718695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2dc00630c0 0x7f2dc01ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.151+0000 7f2dc5cc7640 1 -- 172.21.15.78:0/2213718695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2dc00630c0 msgr2=0x7f2dc01ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.151+0000 7f2dc5cc7640 1 --2- 172.21.15.78:0/2213718695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2dc00630c0 0x7f2dc01ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.151+0000 7f2dc5cc7640 1 -- 172.21.15.78:0/2213718695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc00af950 msgr2=0x7f2dc00711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.151+0000 7f2dc5cc7640 1 --2- 172.21.15.78:0/2213718695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc00af950 0x7f2dc00711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.151+0000 7f2dc5cc7640 1 -- 172.21.15.78:0/2213718695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc01cf9c0 con 0x7f2dc00736b0 2024-09-15T22:09:41.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.151+0000 7f2dc64c8640 1 --2- 172.21.15.78:0/2213718695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2dc00630c0 0x7f2dc01ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:41.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.151+0000 7f2dc5cc7640 1 --2- 172.21.15.78:0/2213718695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc00736b0 0x7f2dc0070c90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2db000c440 tx=0x7f2db0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:41.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.151+0000 7f2db6ffd640 1 -- 172.21.15.78:0/2213718695 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db00074e0 con 0x7f2dc00736b0 2024-09-15T22:09:41.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.151+0000 7f2db6ffd640 1 -- 172.21.15.78:0/2213718695 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db0007680 con 0x7f2dc00736b0 2024-09-15T22:09:41.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.151+0000 7f2db6ffd640 1 -- 172.21.15.78:0/2213718695 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0004a20 con 0x7f2dc00736b0 2024-09-15T22:09:41.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.151+0000 7f2dc872c640 1 -- 172.21.15.78:0/2213718695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc01d0e20 con 0x7f2dc00736b0 2024-09-15T22:09:41.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.151+0000 7f2dc872c640 1 -- 172.21.15.78:0/2213718695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc01cfc60 con 0x7f2dc00736b0 2024-09-15T22:09:41.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.152+0000 7f2dc872c640 1 -- 172.21.15.78:0/2213718695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc00afde0 con 0x7f2dc00736b0 2024-09-15T22:09:41.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.153+0000 7f2db6ffd640 1 -- 172.21.15.78:0/2213718695 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2db001a020 con 0x7f2dc00736b0 2024-09-15T22:09:41.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.154+0000 7f2db6ffd640 1 --2- 172.21.15.78:0/2213718695 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f2da406c2e0 0x7f2da406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.154+0000 7f2db6ffd640 1 -- 172.21.15.78:0/2213718695 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2db008ae80 con 0x7f2dc00736b0 2024-09-15T22:09:41.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.154+0000 7f2dc64c8640 1 --2- 172.21.15.78:0/2213718695 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f2da406c2e0 0x7f2da406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.154+0000 7f2dc64c8640 1 --2- 172.21.15.78:0/2213718695 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f2da406c2e0 0x7f2da406e7a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc034000 tx=0x7f2dbc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:41.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.158+0000 7f2db6ffd640 1 -- 172.21.15.78:0/2213718695 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2db00592b0 con 0x7f2dc00736b0 2024-09-15T22:09:41.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.218+0000 7fc202d91640 1 Processor -- start 2024-09-15T22:09:41.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.218+0000 7fc202d91640 1 -- start start 2024-09-15T22:09:41.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.218+0000 7fc202d91640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc1fc1417f0 0x7fc1fc141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.218+0000 7fc202d91640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1fc1502e0 0x7fc1fc1526d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.218+0000 7fc202d91640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1fc0b6c90 con 0x7fc1fc0ba270 2024-09-15T22:09:41.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.218+0000 7fc202d91640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc1fc0b6f00 con 0x7fc1fc1417f0 2024-09-15T22:09:41.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.218+0000 7fc202d91640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc1fc0b7a80 con 0x7fc1fc1502e0 2024-09-15T22:09:41.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.219+0000 7fc20132e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1fc1502e0 0x7fc1fc1526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.219+0000 7fc1fbfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc1fc1417f0 0x7fc1fc141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.219+0000 7fc200b2d640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc1fc0ba270 0x7fc1fc0b97b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.78:38292/0 (socket says 172.21.15.78:38292) 2024-09-15T22:09:41.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.219+0000 7fc200b2d640 1 -- 172.21.15.78:0/3123720031 learned_addr learned my addr 172.21.15.78:0/3123720031 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:41.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.219+0000 7fc20132e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1fc1502e0 0x7fc1fc1526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.78:39374/0 (socket says 172.21.15.78:39374) 2024-09-15T22:09:41.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.219+0000 7fc1fbfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc1fc1417f0 0x7fc1fc141c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.78:39336/0 (socket says 172.21.15.78:39336) 2024-09-15T22:09:41.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.219+0000 7fc20132e640 1 -- 172.21.15.78:0/3123720031 >> v2:172.21.15.175:3300/0 conn(0x7fc1fc1417f0 msgr2=0x7fc1fc141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:41.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.219+0000 7fc20132e640 1 --2- 172.21.15.78:0/3123720031 >> v2:172.21.15.175:3300/0 conn(0x7fc1fc1417f0 0x7fc1fc141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.219+0000 7fc20132e640 1 -- 172.21.15.78:0/3123720031 >> v1:172.21.15.175:6789/0 conn(0x7fc1fc0ba270 legacy=0x7fc1fc0b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.219+0000 7fc20132e640 1 -- 172.21.15.78:0/3123720031 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1fc0ba650 con 0x7fc1fc1502e0 2024-09-15T22:09:41.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.219+0000 7fc1fbfff640 1 --2- 172.21.15.78:0/3123720031 >> v2:172.21.15.175:3300/0 conn(0x7fc1fc1417f0 0x7fc1fc141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:09:41.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.220+0000 7fc20132e640 1 --2- 172.21.15.78:0/3123720031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1fc1502e0 0x7fc1fc1526d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4009d90 tx=0x7fc1f402a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5be3075a3c64d483 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.221+0000 7fc1fb7fe640 1 -- 172.21.15.78:0/3123720031 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4007740 con 0x7fc1fc1502e0 2024-09-15T22:09:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.221+0000 7fc1fb7fe640 1 -- 172.21.15.78:0/3123720031 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f40078e0 con 0x7fc1fc1502e0 2024-09-15T22:09:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.221+0000 7fc1fb7fe640 1 -- 172.21.15.78:0/3123720031 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4007cb0 con 0x7fc1fc1502e0 2024-09-15T22:09:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.221+0000 7fc202d91640 1 -- 172.21.15.78:0/3123720031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1fc1502e0 msgr2=0x7fc1fc1526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.221+0000 7fc202d91640 1 --2- 172.21.15.78:0/3123720031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1fc1502e0 0x7fc1fc1526d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4009d90 tx=0x7fc1f402a530 comp rx=0 tx=0).stop 2024-09-15T22:09:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.221+0000 7fc202d91640 1 -- 172.21.15.78:0/3123720031 shutdown_connections 2024-09-15T22:09:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.221+0000 7fc202d91640 1 --2- 172.21.15.78:0/3123720031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1fc1502e0 0x7fc1fc1526d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.221+0000 7fc202d91640 1 --2- 172.21.15.78:0/3123720031 >> v2:172.21.15.175:3300/0 conn(0x7fc1fc1417f0 0x7fc1fc141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.221+0000 7fc202d91640 1 -- 172.21.15.78:0/3123720031 >> 172.21.15.78:0/3123720031 conn(0x7fc1fc074ba0 msgr2=0x7fc1fc074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.221+0000 7fc202d91640 1 -- 172.21.15.78:0/3123720031 shutdown_connections 2024-09-15T22:09:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.221+0000 7fc202d91640 1 -- 172.21.15.78:0/3123720031 wait complete. 2024-09-15T22:09:41.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.222+0000 7fc202d91640 1 Processor -- start 2024-09-15T22:09:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.222+0000 7fc202d91640 1 -- start start 2024-09-15T22:09:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc202d91640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1fc0ba270 0x7fc1fc1442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc202d91640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1fc1417f0 0x7fc1fc0bdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc202d91640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1fc1502e0 0x7fc1fc1e05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc202d91640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc0b77a0 con 0x7fc1fc1417f0 2024-09-15T22:09:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc202d91640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc0b74c0 con 0x7fc1fc1502e0 2024-09-15T22:09:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc202d91640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc1fc0b4a70 con 0x7fc1fc0ba270 2024-09-15T22:09:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc1fbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1fc1417f0 0x7fc1fc0bdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc1fbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1fc1417f0 0x7fc1fc0bdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37232/0 (socket says 172.21.15.78:37232) 2024-09-15T22:09:41.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc1fbfff640 1 -- 172.21.15.78:0/2965994957 learned_addr learned my addr 172.21.15.78:0/2965994957 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:41.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc20132e640 1 --2- 172.21.15.78:0/2965994957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1fc1502e0 0x7fc1fc1e05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc200b2d640 1 --2- 172.21.15.78:0/2965994957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1fc0ba270 0x7fc1fc1442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc1fbfff640 1 -- 172.21.15.78:0/2965994957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1fc0ba270 msgr2=0x7fc1fc1442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc1fbfff640 1 --2- 172.21.15.78:0/2965994957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1fc0ba270 0x7fc1fc1442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc1fbfff640 1 -- 172.21.15.78:0/2965994957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1fc1502e0 msgr2=0x7fc1fc1e05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc1fbfff640 1 --2- 172.21.15.78:0/2965994957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1fc1502e0 0x7fc1fc1e05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc1fbfff640 1 -- 172.21.15.78:0/2965994957 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1fc0bc5d0 con 0x7fc1fc1417f0 2024-09-15T22:09:41.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.223+0000 7fc200b2d640 1 --2- 172.21.15.78:0/2965994957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1fc0ba270 0x7fc1fc1442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:41.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.224+0000 7fc1fbfff640 1 --2- 172.21.15.78:0/2965994957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1fc1417f0 0x7fc1fc0bdd30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800ebe0 tx=0x7fc1e800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:41.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.224+0000 7fc1f97fa640 1 -- 172.21.15.78:0/2965994957 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8017070 con 0x7fc1fc1417f0 2024-09-15T22:09:41.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.224+0000 7fc1f97fa640 1 -- 172.21.15.78:0/2965994957 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e800cc30 con 0x7fc1fc1417f0 2024-09-15T22:09:41.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.224+0000 7fc1f97fa640 1 -- 172.21.15.78:0/2965994957 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8013470 con 0x7fc1fc1417f0 2024-09-15T22:09:41.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.224+0000 7fc202d91640 1 -- 172.21.15.78:0/2965994957 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1fc144f50 con 0x7fc1fc1417f0 2024-09-15T22:09:41.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.224+0000 7fc202d91640 1 -- 172.21.15.78:0/2965994957 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1fc0be270 con 0x7fc1fc1417f0 2024-09-15T22:09:41.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.225+0000 7fc202d91640 1 -- 172.21.15.78:0/2965994957 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1fc0bb870 con 0x7fc1fc1417f0 2024-09-15T22:09:41.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.225+0000 7fc1f97fa640 1 -- 172.21.15.78:0/2965994957 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc1e801a070 con 0x7fc1fc1417f0 2024-09-15T22:09:41.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.226+0000 7fc1f97fa640 1 --2- 172.21.15.78:0/2965994957 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc1e006c2b0 0x7fc1e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.226+0000 7fc200b2d640 1 --2- 172.21.15.78:0/2965994957 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc1e006c2b0 0x7fc1e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.226+0000 7fc1f97fa640 1 -- 172.21.15.78:0/2965994957 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc1e808b940 con 0x7fc1fc1417f0 2024-09-15T22:09:41.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.227+0000 7fc200b2d640 1 --2- 172.21.15.78:0/2965994957 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc1e006c2b0 0x7fc1e006e770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0000f60 tx=0x7fc1f0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:41.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.234+0000 7fc1f97fa640 1 -- 172.21.15.78:0/2965994957 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1fc0bb870 con 0x7fc1fc1417f0 2024-09-15T22:09:41.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.289+0000 7f2745ffb640 1 -- 172.21.15.78:0/507346958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2728005580 con 0x7f275006d9a0 2024-09-15T22:09:41.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.289+0000 7f274cff9640 1 -- 172.21.15.78:0/507346958 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f273805db10 con 0x7f275006d9a0 2024-09-15T22:09:41.292 INFO:teuthology.orchestra.run.smithi078.stdout:60129542153 2024-09-15T22:09:41.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.291+0000 7f2745ffb640 1 -- 172.21.15.78:0/507346958 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f273006c2e0 msgr2=0x7f273006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.291+0000 7f2745ffb640 1 --2- 172.21.15.78:0/507346958 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f273006c2e0 0x7f273006e7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2740009950 tx=0x7f2740008040 comp rx=0 tx=0).stop 2024-09-15T22:09:41.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.291+0000 7f2745ffb640 1 -- 172.21.15.78:0/507346958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f275006d9a0 msgr2=0x7f27500b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.291+0000 7f2745ffb640 1 --2- 172.21.15.78:0/507346958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f275006d9a0 0x7f27500b21e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f273800e980 tx=0x7f273800ee40 comp rx=0 tx=0).stop 2024-09-15T22:09:41.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.291+0000 7f2745ffb640 1 -- 172.21.15.78:0/507346958 shutdown_connections 2024-09-15T22:09:41.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.291+0000 7f2745ffb640 1 --2- 172.21.15.78:0/507346958 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f273006c2e0 0x7f273006e7a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.291+0000 7f2745ffb640 1 --2- 172.21.15.78:0/507346958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27500b0730 0x7f27500b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.291+0000 7f2745ffb640 1 --2- 172.21.15.78:0/507346958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f275006d9a0 0x7f27500b21e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.291+0000 7f2745ffb640 1 --2- 172.21.15.78:0/507346958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f275006d5c0 0x7f2750072ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.291+0000 7f2745ffb640 1 -- 172.21.15.78:0/507346958 >> 172.21.15.78:0/507346958 conn(0x7f27500ba2d0 msgr2=0x7f27500ba6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:41.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.292+0000 7f2745ffb640 1 -- 172.21.15.78:0/507346958 shutdown_connections 2024-09-15T22:09:41.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.292+0000 7f2745ffb640 1 -- 172.21.15.78:0/507346958 wait complete. 2024-09-15T22:09:41.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.0 2024-09-15T22:09:41.304 DEBUG:teuthology.parallel:result is None 2024-09-15T22:09:41.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.341+0000 7f2dc872c640 1 -- 172.21.15.78:0/2213718695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2dc0145f00 con 0x7f2dc00736b0 2024-09-15T22:09:41.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.342+0000 7f2db6ffd640 1 -- 172.21.15.78:0/2213718695 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2db0058bb0 con 0x7f2dc00736b0 2024-09-15T22:09:41.344 INFO:teuthology.orchestra.run.smithi078.stdout:60129542153 2024-09-15T22:09:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.344+0000 7f2dc872c640 1 -- 172.21.15.78:0/2213718695 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f2da406c2e0 msgr2=0x7f2da406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.344+0000 7f2dc872c640 1 --2- 172.21.15.78:0/2213718695 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f2da406c2e0 0x7f2da406e7a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc034000 tx=0x7f2dbc02e000 comp rx=0 tx=0).stop 2024-09-15T22:09:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.344+0000 7f2dc872c640 1 -- 172.21.15.78:0/2213718695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc00736b0 msgr2=0x7f2dc0070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.344+0000 7f2dc872c640 1 --2- 172.21.15.78:0/2213718695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc00736b0 0x7f2dc0070c90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2db000c440 tx=0x7f2db0001e70 comp rx=0 tx=0).stop 2024-09-15T22:09:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.344+0000 7f2dc872c640 1 -- 172.21.15.78:0/2213718695 shutdown_connections 2024-09-15T22:09:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.344+0000 7f2dc872c640 1 --2- 172.21.15.78:0/2213718695 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f2da406c2e0 0x7f2da406e7a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.344+0000 7f2dc872c640 1 --2- 172.21.15.78:0/2213718695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc00af950 0x7f2dc00711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.344+0000 7f2dc872c640 1 --2- 172.21.15.78:0/2213718695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc00736b0 0x7f2dc0070c90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.344+0000 7f2dc872c640 1 --2- 172.21.15.78:0/2213718695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2dc00630c0 0x7f2dc01ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.344+0000 7f2dc872c640 1 -- 172.21.15.78:0/2213718695 >> 172.21.15.78:0/2213718695 conn(0x7f2dc00ba760 msgr2=0x7f2dc00b8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:41.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.344+0000 7f2dc872c640 1 -- 172.21.15.78:0/2213718695 shutdown_connections 2024-09-15T22:09:41.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.344+0000 7f2dc872c640 1 -- 172.21.15.78:0/2213718695 wait complete. 2024-09-15T22:09:41.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.5 2024-09-15T22:09:41.356 DEBUG:teuthology.parallel:result is None 2024-09-15T22:09:41.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.412+0000 7fc202d91640 1 -- 172.21.15.78:0/2965994957 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc1fc0b5ce0 con 0x7fc1fc1417f0 2024-09-15T22:09:41.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.412+0000 7fc1f97fa640 1 -- 172.21.15.78:0/2965994957 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc1e80597b0 con 0x7fc1fc1417f0 2024-09-15T22:09:41.414 INFO:teuthology.orchestra.run.smithi078.stdout:60129542154 2024-09-15T22:09:41.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.414+0000 7fc202d91640 1 -- 172.21.15.78:0/2965994957 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc1e006c2b0 msgr2=0x7fc1e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.414+0000 7fc202d91640 1 --2- 172.21.15.78:0/2965994957 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc1e006c2b0 0x7fc1e006e770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0000f60 tx=0x7fc1f0009040 comp rx=0 tx=0).stop 2024-09-15T22:09:41.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.414+0000 7fc202d91640 1 -- 172.21.15.78:0/2965994957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1fc1417f0 msgr2=0x7fc1fc0bdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.414+0000 7fc202d91640 1 --2- 172.21.15.78:0/2965994957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1fc1417f0 0x7fc1fc0bdd30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800ebe0 tx=0x7fc1e800c520 comp rx=0 tx=0).stop 2024-09-15T22:09:41.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.414+0000 7fc202d91640 1 -- 172.21.15.78:0/2965994957 shutdown_connections 2024-09-15T22:09:41.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.414+0000 7fc202d91640 1 --2- 172.21.15.78:0/2965994957 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc1e006c2b0 0x7fc1e006e770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.414+0000 7fc202d91640 1 --2- 172.21.15.78:0/2965994957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1fc1502e0 0x7fc1fc1e05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.414+0000 7fc202d91640 1 --2- 172.21.15.78:0/2965994957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1fc1417f0 0x7fc1fc0bdd30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.414+0000 7fc202d91640 1 --2- 172.21.15.78:0/2965994957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1fc0ba270 0x7fc1fc1442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.414+0000 7fc202d91640 1 -- 172.21.15.78:0/2965994957 >> 172.21.15.78:0/2965994957 conn(0x7fc1fc074ba0 msgr2=0x7fc1fc139850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:41.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.414+0000 7fc202d91640 1 -- 172.21.15.78:0/2965994957 shutdown_connections 2024-09-15T22:09:41.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.414+0000 7fc202d91640 1 -- 172.21.15.78:0/2965994957 wait complete. 2024-09-15T22:09:41.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.4 2024-09-15T22:09:41.427 DEBUG:teuthology.parallel:result is None 2024-09-15T22:09:41.427 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:09:41.427 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:09:41.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.524+0000 7fca27023640 1 Processor -- start 2024-09-15T22:09:41.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.524+0000 7fca27023640 1 -- start start 2024-09-15T22:09:41.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca27023640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fca2009d4c0 0x7fca20148290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca27023640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca20148b60 con 0x7fca20147eb0 2024-09-15T22:09:41.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca27023640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca20148880 con 0x7fca200b41a0 2024-09-15T22:09:41.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca27023640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fca200b3d10 con 0x7fca2009d4c0 2024-09-15T22:09:41.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca24dbf640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fca20147eb0 0x7fca20141860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54782/0 (socket says 172.21.15.78:54782) 2024-09-15T22:09:41.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca24dbf640 1 -- 172.21.15.78:0/4279752631 learned_addr learned my addr 172.21.15.78:0/4279752631 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:41.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca17fff640 1 --2- 172.21.15.78:0/4279752631 >> v2:172.21.15.175:3300/0 conn(0x7fca2009d4c0 0x7fca20148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca177fe640 1 -- 172.21.15.78:0/4279752631 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3428776290 0 0) 0x7fca20148b60 con 0x7fca20147eb0 2024-09-15T22:09:41.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca177fe640 1 -- 172.21.15.78:0/4279752631 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca08003520 con 0x7fca20147eb0 2024-09-15T22:09:41.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca177fe640 1 -- 172.21.15.78:0/4279752631 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2113676430 0 0) 0x7fca08003520 con 0x7fca20147eb0 2024-09-15T22:09:41.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca177fe640 1 -- 172.21.15.78:0/4279752631 >> v2:172.21.15.175:3300/0 conn(0x7fca2009d4c0 msgr2=0x7fca20148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:41.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca177fe640 1 --2- 172.21.15.78:0/4279752631 >> v2:172.21.15.175:3300/0 conn(0x7fca2009d4c0 0x7fca20148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca177fe640 1 -- 172.21.15.78:0/4279752631 >> v1:172.21.15.175:6789/0 conn(0x7fca200b41a0 legacy=0x7fca2014ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca177fe640 1 -- 172.21.15.78:0/4279752631 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2009c290 con 0x7fca20147eb0 2024-09-15T22:09:41.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca177fe640 1 -- 172.21.15.78:0/4279752631 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3961011974 0 0) 0x7fca1c001670 con 0x7fca20147eb0 2024-09-15T22:09:41.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca177fe640 1 -- 172.21.15.78:0/4279752631 >> v1:172.21.15.78:6789/0 conn(0x7fca20147eb0 legacy=0x7fca20141860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca177fe640 1 --2- 172.21.15.78:0/4279752631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca080039b0 0x7fca08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca177fe640 1 --2- 172.21.15.78:0/4279752631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca08004800 0x7fca08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca177fe640 1 --2- 172.21.15.78:0/4279752631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca080051c0 0x7fca0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca177fe640 1 -- 172.21.15.78:0/4279752631 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fca200b3d10 con 0x7fca08004800 2024-09-15T22:09:41.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca177fe640 1 -- 172.21.15.78:0/4279752631 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fca0800c160 con 0x7fca080039b0 2024-09-15T22:09:41.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca177fe640 1 -- 172.21.15.78:0/4279752631 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fca0800c360 con 0x7fca080051c0 2024-09-15T22:09:41.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.525+0000 7fca17fff640 1 --2- 172.21.15.78:0/4279752631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca08004800 0x7fca08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.526+0000 7fca255c0640 1 --2- 172.21.15.78:0/4279752631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca080051c0 0x7fca0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.526+0000 7fca24dbf640 1 --2- 172.21.15.78:0/4279752631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca080039b0 0x7fca08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.526+0000 7fca17fff640 1 -- 172.21.15.78:0/4279752631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca080051c0 msgr2=0x7fca0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:41.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.526+0000 7fca17fff640 1 --2- 172.21.15.78:0/4279752631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca080051c0 0x7fca0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.526+0000 7fca17fff640 1 -- 172.21.15.78:0/4279752631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca080039b0 msgr2=0x7fca08003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:41.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.526+0000 7fca17fff640 1 --2- 172.21.15.78:0/4279752631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca080039b0 0x7fca08003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.526+0000 7fca17fff640 1 -- 172.21.15.78:0/4279752631 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca08003520 con 0x7fca08004800 2024-09-15T22:09:41.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.526+0000 7fca255c0640 1 -- 172.21.15.78:0/4279752631 reap_dead start 2024-09-15T22:09:41.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.526+0000 7fca24dbf640 1 --2- 172.21.15.78:0/4279752631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca080039b0 0x7fca08003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:41.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.526+0000 7fca17fff640 1 --2- 172.21.15.78:0/4279752631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca08004800 0x7fca08004c80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fca10009ac0 tx=0x7fca08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2443fd4f482a70 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:41.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.527+0000 7fca177fe640 1 -- 172.21.15.78:0/4279752631 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10036070 con 0x7fca08004800 2024-09-15T22:09:41.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.527+0000 7fca177fe640 1 -- 172.21.15.78:0/4279752631 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10031400 con 0x7fca08004800 2024-09-15T22:09:41.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.527+0000 7fca177fe640 1 -- 172.21.15.78:0/4279752631 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10009690 con 0x7fca08004800 2024-09-15T22:09:41.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.527+0000 7fca27023640 1 -- 172.21.15.78:0/4279752631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca08004800 msgr2=0x7fca08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.527+0000 7fca27023640 1 --2- 172.21.15.78:0/4279752631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca08004800 0x7fca08004c80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fca10009ac0 tx=0x7fca08005830 comp rx=0 tx=0).stop 2024-09-15T22:09:41.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.527+0000 7fca27023640 1 -- 172.21.15.78:0/4279752631 shutdown_connections 2024-09-15T22:09:41.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.527+0000 7fca27023640 1 --2- 172.21.15.78:0/4279752631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca08004800 0x7fca08004c80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.527+0000 7fca27023640 1 -- 172.21.15.78:0/4279752631 >> 172.21.15.78:0/4279752631 conn(0x7fca2006c270 msgr2=0x7fca2006c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:41.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.527+0000 7fca27023640 1 -- 172.21.15.78:0/4279752631 shutdown_connections 2024-09-15T22:09:41.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.527+0000 7fca27023640 1 -- 172.21.15.78:0/4279752631 wait complete. 2024-09-15T22:09:41.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.528+0000 7fca27023640 1 Processor -- start 2024-09-15T22:09:41.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.528+0000 7fca27023640 1 -- start start 2024-09-15T22:09:41.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca27023640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca08004800 0x7fca200b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca27023640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca200b31f0 0x7fca201dd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca27023640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca200b1fe0 0x7fca201384d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca27023640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fca20148620 con 0x7fca08004800 2024-09-15T22:09:41.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca27023640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fca201484a0 con 0x7fca200b31f0 2024-09-15T22:09:41.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca27023640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fca2009c9e0 con 0x7fca200b1fe0 2024-09-15T22:09:41.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca24dbf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca08004800 0x7fca200b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca24dbf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca08004800 0x7fca200b8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37246/0 (socket says 172.21.15.78:37246) 2024-09-15T22:09:41.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca24dbf640 1 -- 172.21.15.78:0/1228599010 learned_addr learned my addr 172.21.15.78:0/1228599010 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:41.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca17fff640 1 --2- 172.21.15.78:0/1228599010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca200b31f0 0x7fca201dd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca255c0640 1 --2- 172.21.15.78:0/1228599010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca200b1fe0 0x7fca201384d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca24dbf640 1 -- 172.21.15.78:0/1228599010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca200b1fe0 msgr2=0x7fca201384d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca24dbf640 1 --2- 172.21.15.78:0/1228599010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca200b1fe0 0x7fca201384d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca24dbf640 1 -- 172.21.15.78:0/1228599010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca200b31f0 msgr2=0x7fca201dd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca24dbf640 1 --2- 172.21.15.78:0/1228599010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca200b31f0 0x7fca201dd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca24dbf640 1 -- 172.21.15.78:0/1228599010 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca200b2510 con 0x7fca08004800 2024-09-15T22:09:41.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca255c0640 1 --2- 172.21.15.78:0/1228599010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca200b1fe0 0x7fca201384d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:41.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca24dbf640 1 --2- 172.21.15.78:0/1228599010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca08004800 0x7fca200b8230 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0109c0 tx=0x7fca1c010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:41.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.529+0000 7fca157fa640 1 -- 172.21.15.78:0/1228599010 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c00eda0 con 0x7fca08004800 2024-09-15T22:09:41.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.530+0000 7fca157fa640 1 -- 172.21.15.78:0/1228599010 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1c012450 con 0x7fca08004800 2024-09-15T22:09:41.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.530+0000 7fca157fa640 1 -- 172.21.15.78:0/1228599010 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c012820 con 0x7fca08004800 2024-09-15T22:09:41.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.530+0000 7fca27023640 1 -- 172.21.15.78:0/1228599010 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca201cf040 con 0x7fca08004800 2024-09-15T22:09:41.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.530+0000 7fca27023640 1 -- 172.21.15.78:0/1228599010 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca201cf600 con 0x7fca08004800 2024-09-15T22:09:41.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.531+0000 7fca27023640 1 -- 172.21.15.78:0/1228599010 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca200b4660 con 0x7fca08004800 2024-09-15T22:09:41.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.531+0000 7fca157fa640 1 -- 172.21.15.78:0/1228599010 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fca1c0129c0 con 0x7fca08004800 2024-09-15T22:09:41.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.531+0000 7fca157fa640 1 --2- 172.21.15.78:0/1228599010 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fca0c06c2e0 0x7fca0c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.532+0000 7fca157fa640 1 -- 172.21.15.78:0/1228599010 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fca1c08db40 con 0x7fca08004800 2024-09-15T22:09:41.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.532+0000 7fca17fff640 1 --2- 172.21.15.78:0/1228599010 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fca0c06c2e0 0x7fca0c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.532+0000 7fca17fff640 1 --2- 172.21.15.78:0/1228599010 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fca0c06c2e0 0x7fca0c06e7a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fca10033000 tx=0x7fca10008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:41.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.536+0000 7fca157fa640 1 -- 172.21.15.78:0/1228599010 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca1c016030 con 0x7fca08004800 2024-09-15T22:09:41.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.697+0000 7fca27023640 1 -- 172.21.15.78:0/1228599010 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca201cf840 con 0x7fca0c06c2e0 2024-09-15T22:09:41.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.705+0000 7fca157fa640 1 -- 172.21.15.78:0/1228599010 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332611 (secure 0 0 0) 0x7fca201cf840 con 0x7fca0c06c2e0 2024-09-15T22:09:41.711 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:41.713 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-15T22:09:41.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.709+0000 7fca27023640 1 -- 172.21.15.78:0/1228599010 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fca0c06c2e0 msgr2=0x7fca0c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.709+0000 7fca27023640 1 --2- 172.21.15.78:0/1228599010 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fca0c06c2e0 0x7fca0c06e7a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fca10033000 tx=0x7fca10008030 comp rx=0 tx=0).stop 2024-09-15T22:09:41.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.709+0000 7fca27023640 1 -- 172.21.15.78:0/1228599010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca08004800 msgr2=0x7fca200b8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.709+0000 7fca27023640 1 --2- 172.21.15.78:0/1228599010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca08004800 0x7fca200b8230 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0109c0 tx=0x7fca1c010e80 comp rx=0 tx=0).stop 2024-09-15T22:09:41.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.709+0000 7fca27023640 1 -- 172.21.15.78:0/1228599010 shutdown_connections 2024-09-15T22:09:41.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.709+0000 7fca27023640 1 --2- 172.21.15.78:0/1228599010 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fca0c06c2e0 0x7fca0c06e7a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.709+0000 7fca27023640 1 --2- 172.21.15.78:0/1228599010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca200b1fe0 0x7fca201384d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.709+0000 7fca27023640 1 --2- 172.21.15.78:0/1228599010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca200b31f0 0x7fca201dd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.709+0000 7fca27023640 1 --2- 172.21.15.78:0/1228599010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca08004800 0x7fca200b8230 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.709+0000 7fca27023640 1 -- 172.21.15.78:0/1228599010 >> 172.21.15.78:0/1228599010 conn(0x7fca2006c270 msgr2=0x7fca2013fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:41.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.709+0000 7fca27023640 1 -- 172.21.15.78:0/1228599010 shutdown_connections 2024-09-15T22:09:41.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.709+0000 7fca27023640 1 -- 172.21.15.78:0/1228599010 wait complete. 2024-09-15T22:09:41.721 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-15T22:09:39.975456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218476,"kb_used_data":2240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756244,"statfs":{"total":773094113280,"available":772870393856,"internally_reserved":0,"allocated":2293760,"data_stored":2015420,"data_compressed":65044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002847"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857105+0000","last_change":"2024-09-15T22:09:16.403008+0000","last_active":"2024-09-15T22:09:22.857105+0000","last_peered":"2024-09-15T22:09:22.857105+0000","last_clean":"2024-09-15T22:09:22.857105+0000","last_became_active":"2024-09-15T22:09:16.402725+0000","last_became_peered":"2024-09-15T22:09:16.402725+0000","last_unstale":"2024-09-15T22:09:22.857105+0000","last_undegraded":"2024-09-15T22:09:22.857105+0000","last_fullsized":"2024-09-15T22:09:22.857105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:32.659951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432405+0000","last_change":"2024-09-15T22:09:17.400698+0000","last_active":"2024-09-15T22:09:22.432405+0000","last_peered":"2024-09-15T22:09:22.432405+0000","last_clean":"2024-09-15T22:09:22.432405+0000","last_became_active":"2024-09-15T22:09:17.400428+0000","last_became_peered":"2024-09-15T22:09:17.400428+0000","last_unstale":"2024-09-15T22:09:22.432405+0000","last_undegraded":"2024-09-15T22:09:22.432405+0000","last_fullsized":"2024-09-15T22:09:22.432405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:15.431072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432024+0000","last_change":"2024-09-15T22:09:21.449737+0000","last_active":"2024-09-15T22:09:22.432024+0000","last_peered":"2024-09-15T22:09:22.432024+0000","last_clean":"2024-09-15T22:09:22.432024+0000","last_became_active":"2024-09-15T22:09:21.449376+0000","last_became_peered":"2024-09-15T22:09:21.449376+0000","last_unstale":"2024-09-15T22:09:22.432024+0000","last_undegraded":"2024-09-15T22:09:22.432024+0000","last_fullsized":"2024-09-15T22:09:22.432024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:13.943283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432590+0000","last_change":"2024-09-15T22:09:16.407728+0000","last_active":"2024-09-15T22:09:22.432590+0000","last_peered":"2024-09-15T22:09:22.432590+0000","last_clean":"2024-09-15T22:09:22.432590+0000","last_became_active":"2024-09-15T22:09:16.407458+0000","last_became_peered":"2024-09-15T22:09:16.407458+0000","last_unstale":"2024-09-15T22:09:22.432590+0000","last_undegraded":"2024-09-15T22:09:22.432590+0000","last_fullsized":"2024-09-15T22:09:22.432590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856796+0000","last_change":"2024-09-15T22:09:17.415311+0000","last_active":"2024-09-15T22:09:22.856796+0000","last_peered":"2024-09-15T22:09:22.856796+0000","last_clean":"2024-09-15T22:09:22.856796+0000","last_became_active":"2024-09-15T22:09:17.414966+0000","last_became_peered":"2024-09-15T22:09:17.414966+0000","last_unstale":"2024-09-15T22:09:22.856796+0000","last_undegraded":"2024-09-15T22:09:22.856796+0000","last_fullsized":"2024-09-15T22:09:22.856796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432860+0000","last_change":"2024-09-15T22:09:21.454087+0000","last_active":"2024-09-15T22:09:22.432860+0000","last_peered":"2024-09-15T22:09:22.432860+0000","last_clean":"2024-09-15T22:09:22.432860+0000","last_became_active":"2024-09-15T22:09:21.453701+0000","last_became_peered":"2024-09-15T22:09:21.453701+0000","last_unstale":"2024-09-15T22:09:22.432860+0000","last_undegraded":"2024-09-15T22:09:22.432860+0000","last_fullsized":"2024-09-15T22:09:22.432860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:29.697947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433861+0000","last_change":"2024-09-15T22:09:16.405902+0000","last_active":"2024-09-15T22:09:22.433861+0000","last_peered":"2024-09-15T22:09:22.433861+0000","last_clean":"2024-09-15T22:09:22.433861+0000","last_became_active":"2024-09-15T22:09:16.405626+0000","last_became_peered":"2024-09-15T22:09:16.405626+0000","last_unstale":"2024-09-15T22:09:22.433861+0000","last_undegraded":"2024-09-15T22:09:22.433861+0000","last_fullsized":"2024-09-15T22:09:22.433861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:03.001838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446948+0000","last_change":"2024-09-15T22:09:17.416894+0000","last_active":"2024-09-15T22:09:22.446948+0000","last_peered":"2024-09-15T22:09:22.446948+0000","last_clean":"2024-09-15T22:09:22.446948+0000","last_became_active":"2024-09-15T22:09:17.416367+0000","last_became_peered":"2024-09-15T22:09:17.416367+0000","last_unstale":"2024-09-15T22:09:22.446948+0000","last_undegraded":"2024-09-15T22:09:22.446948+0000","last_fullsized":"2024-09-15T22:09:22.446948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:15.431072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434492+0000","last_change":"2024-09-15T22:09:21.455260+0000","last_active":"2024-09-15T22:09:22.434492+0000","last_peered":"2024-09-15T22:09:22.434492+0000","last_clean":"2024-09-15T22:09:22.434492+0000","last_became_active":"2024-09-15T22:09:21.454850+0000","last_became_peered":"2024-09-15T22:09:21.454850+0000","last_unstale":"2024-09-15T22:09:22.434492+0000","last_undegraded":"2024-09-15T22:09:22.434492+0000","last_fullsized":"2024-09-15T22:09:22.434492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:08.904123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434195+0000","last_change":"2024-09-15T22:09:16.407670+0000","last_active":"2024-09-15T22:09:22.434195+0000","last_peered":"2024-09-15T22:09:22.434195+0000","last_clean":"2024-09-15T22:09:22.434195+0000","last_became_active":"2024-09-15T22:09:16.407364+0000","last_became_peered":"2024-09-15T22:09:16.407364+0000","last_unstale":"2024-09-15T22:09:22.434195+0000","last_undegraded":"2024-09-15T22:09:22.434195+0000","last_fullsized":"2024-09-15T22:09:22.434195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:01.284777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447188+0000","last_change":"2024-09-15T22:09:17.408224+0000","last_active":"2024-09-15T22:09:22.447188+0000","last_peered":"2024-09-15T22:09:22.447188+0000","last_clean":"2024-09-15T22:09:22.447188+0000","last_became_active":"2024-09-15T22:09:17.407881+0000","last_became_peered":"2024-09-15T22:09:17.407881+0000","last_unstale":"2024-09-15T22:09:22.447188+0000","last_undegraded":"2024-09-15T22:09:22.447188+0000","last_fullsized":"2024-09-15T22:09:22.447188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:22.003479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432971+0000","last_change":"2024-09-15T22:09:21.450705+0000","last_active":"2024-09-15T22:09:22.432971+0000","last_peered":"2024-09-15T22:09:22.432971+0000","last_clean":"2024-09-15T22:09:22.432971+0000","last_became_active":"2024-09-15T22:09:21.450265+0000","last_became_peered":"2024-09-15T22:09:21.450265+0000","last_unstale":"2024-09-15T22:09:22.432971+0000","last_undegraded":"2024-09-15T22:09:22.432971+0000","last_fullsized":"2024-09-15T22:09:22.432971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:21.477522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856481+0000","last_change":"2024-09-15T22:09:17.410686+0000","last_active":"2024-09-15T22:09:22.856481+0000","last_peered":"2024-09-15T22:09:22.856481+0000","last_clean":"2024-09-15T22:09:22.856481+0000","last_became_active":"2024-09-15T22:09:17.410383+0000","last_became_peered":"2024-09-15T22:09:17.410383+0000","last_unstale":"2024-09-15T22:09:22.856481+0000","last_undegraded":"2024-09-15T22:09:22.856481+0000","last_fullsized":"2024-09-15T22:09:22.856481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433896+0000","last_change":"2024-09-15T22:09:16.405335+0000","last_active":"2024-09-15T22:09:22.433896+0000","last_peered":"2024-09-15T22:09:22.433896+0000","last_clean":"2024-09-15T22:09:22.433896+0000","last_became_active":"2024-09-15T22:09:16.405010+0000","last_became_peered":"2024-09-15T22:09:16.405010+0000","last_unstale":"2024-09-15T22:09:22.433896+0000","last_undegraded":"2024-09-15T22:09:22.433896+0000","last_fullsized":"2024-09-15T22:09:22.433896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:00.202736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433953+0000","last_change":"2024-09-15T22:09:21.453670+0000","last_active":"2024-09-15T22:09:22.433953+0000","last_peered":"2024-09-15T22:09:22.433953+0000","last_clean":"2024-09-15T22:09:22.433953+0000","last_became_active":"2024-09-15T22:09:21.453219+0000","last_became_peered":"2024-09-15T22:09:21.453219+0000","last_unstale":"2024-09-15T22:09:22.433953+0000","last_undegraded":"2024-09-15T22:09:22.433953+0000","last_fullsized":"2024-09-15T22:09:22.433953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:28.271273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432427+0000","last_change":"2024-09-15T22:09:17.405327+0000","last_active":"2024-09-15T22:09:22.432427+0000","last_peered":"2024-09-15T22:09:22.432427+0000","last_clean":"2024-09-15T22:09:22.432427+0000","last_became_active":"2024-09-15T22:09:17.405065+0000","last_became_peered":"2024-09-15T22:09:17.405065+0000","last_unstale":"2024-09-15T22:09:22.432427+0000","last_undegraded":"2024-09-15T22:09:22.432427+0000","last_fullsized":"2024-09-15T22:09:22.432427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857701+0000","last_change":"2024-09-15T22:09:16.406705+0000","last_active":"2024-09-15T22:09:22.857701+0000","last_peered":"2024-09-15T22:09:22.857701+0000","last_clean":"2024-09-15T22:09:22.857701+0000","last_became_active":"2024-09-15T22:09:16.406454+0000","last_became_peered":"2024-09-15T22:09:16.406454+0000","last_unstale":"2024-09-15T22:09:22.857701+0000","last_undegraded":"2024-09-15T22:09:22.857701+0000","last_fullsized":"2024-09-15T22:09:22.857701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:02.444245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433842+0000","last_change":"2024-09-15T22:09:21.456243+0000","last_active":"2024-09-15T22:09:22.433842+0000","last_peered":"2024-09-15T22:09:22.433842+0000","last_clean":"2024-09-15T22:09:22.433842+0000","last_became_active":"2024-09-15T22:09:21.455819+0000","last_became_peered":"2024-09-15T22:09:21.455819+0000","last_unstale":"2024-09-15T22:09:22.433842+0000","last_undegraded":"2024-09-15T22:09:22.433842+0000","last_fullsized":"2024-09-15T22:09:22.433842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:02.526090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432175+0000","last_change":"2024-09-15T22:09:17.399551+0000","last_active":"2024-09-15T22:09:22.432175+0000","last_peered":"2024-09-15T22:09:22.432175+0000","last_clean":"2024-09-15T22:09:22.432175+0000","last_became_active":"2024-09-15T22:09:17.399290+0000","last_became_peered":"2024-09-15T22:09:17.399290+0000","last_unstale":"2024-09-15T22:09:22.432175+0000","last_undegraded":"2024-09-15T22:09:22.432175+0000","last_fullsized":"2024-09-15T22:09:22.432175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857365+0000","last_change":"2024-09-15T22:09:16.408974+0000","last_active":"2024-09-15T22:09:22.857365+0000","last_peered":"2024-09-15T22:09:22.857365+0000","last_clean":"2024-09-15T22:09:22.857365+0000","last_became_active":"2024-09-15T22:09:16.408691+0000","last_became_peered":"2024-09-15T22:09:16.408691+0000","last_unstale":"2024-09-15T22:09:22.857365+0000","last_undegraded":"2024-09-15T22:09:22.857365+0000","last_fullsized":"2024-09-15T22:09:22.857365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:26:32.412274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857068+0000","last_change":"2024-09-15T22:09:21.458893+0000","last_active":"2024-09-15T22:09:22.857068+0000","last_peered":"2024-09-15T22:09:22.857068+0000","last_clean":"2024-09-15T22:09:22.857068+0000","last_became_active":"2024-09-15T22:09:21.458548+0000","last_became_peered":"2024-09-15T22:09:21.458548+0000","last_unstale":"2024-09-15T22:09:22.857068+0000","last_undegraded":"2024-09-15T22:09:22.857068+0000","last_fullsized":"2024-09-15T22:09:22.857068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:29.163692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434430+0000","last_change":"2024-09-15T22:09:17.400823+0000","last_active":"2024-09-15T22:09:22.434430+0000","last_peered":"2024-09-15T22:09:22.434430+0000","last_clean":"2024-09-15T22:09:22.434430+0000","last_became_active":"2024-09-15T22:09:17.400494+0000","last_became_peered":"2024-09-15T22:09:17.400494+0000","last_unstale":"2024-09-15T22:09:22.434430+0000","last_undegraded":"2024-09-15T22:09:22.434430+0000","last_fullsized":"2024-09-15T22:09:22.434430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:02.290840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432593+0000","last_change":"2024-09-15T22:09:16.409156+0000","last_active":"2024-09-15T22:09:22.432593+0000","last_peered":"2024-09-15T22:09:22.432593+0000","last_clean":"2024-09-15T22:09:22.432593+0000","last_became_active":"2024-09-15T22:09:16.408603+0000","last_became_peered":"2024-09-15T22:09:16.408603+0000","last_unstale":"2024-09-15T22:09:22.432593+0000","last_undegraded":"2024-09-15T22:09:22.432593+0000","last_fullsized":"2024-09-15T22:09:22.432593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:12.245902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433463+0000","last_change":"2024-09-15T22:09:21.447940+0000","last_active":"2024-09-15T22:09:22.433463+0000","last_peered":"2024-09-15T22:09:22.433463+0000","last_clean":"2024-09-15T22:09:22.433463+0000","last_became_active":"2024-09-15T22:09:21.447348+0000","last_became_peered":"2024-09-15T22:09:21.447348+0000","last_unstale":"2024-09-15T22:09:22.433463+0000","last_undegraded":"2024-09-15T22:09:22.433463+0000","last_fullsized":"2024-09-15T22:09:22.433463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:19.466950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.858001+0000","last_change":"2024-09-15T22:09:17.402826+0000","last_active":"2024-09-15T22:09:22.858001+0000","last_peered":"2024-09-15T22:09:22.858001+0000","last_clean":"2024-09-15T22:09:22.858001+0000","last_became_active":"2024-09-15T22:09:17.402585+0000","last_became_peered":"2024-09-15T22:09:17.402585+0000","last_unstale":"2024-09-15T22:09:22.858001+0000","last_undegraded":"2024-09-15T22:09:22.858001+0000","last_fullsized":"2024-09-15T22:09:22.858001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857204+0000","last_change":"2024-09-15T22:09:16.408097+0000","last_active":"2024-09-15T22:09:22.857204+0000","last_peered":"2024-09-15T22:09:22.857204+0000","last_clean":"2024-09-15T22:09:22.857204+0000","last_became_active":"2024-09-15T22:09:16.407657+0000","last_became_peered":"2024-09-15T22:09:16.407657+0000","last_unstale":"2024-09-15T22:09:22.857204+0000","last_undegraded":"2024-09-15T22:09:22.857204+0000","last_fullsized":"2024-09-15T22:09:22.857204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433301+0000","last_change":"2024-09-15T22:09:21.451205+0000","last_active":"2024-09-15T22:09:22.433301+0000","last_peered":"2024-09-15T22:09:22.433301+0000","last_clean":"2024-09-15T22:09:22.433301+0000","last_became_active":"2024-09-15T22:09:21.450731+0000","last_became_peered":"2024-09-15T22:09:21.450731+0000","last_unstale":"2024-09-15T22:09:22.433301+0000","last_undegraded":"2024-09-15T22:09:22.433301+0000","last_fullsized":"2024-09-15T22:09:22.433301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:38.650786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432489+0000","last_change":"2024-09-15T22:09:17.421690+0000","last_active":"2024-09-15T22:09:22.432489+0000","last_peered":"2024-09-15T22:09:22.432489+0000","last_clean":"2024-09-15T22:09:22.432489+0000","last_became_active":"2024-09-15T22:09:17.421379+0000","last_became_peered":"2024-09-15T22:09:17.421379+0000","last_unstale":"2024-09-15T22:09:22.432489+0000","last_undegraded":"2024-09-15T22:09:22.432489+0000","last_fullsized":"2024-09-15T22:09:22.432489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857039+0000","last_change":"2024-09-15T22:09:16.408662+0000","last_active":"2024-09-15T22:09:22.857039+0000","last_peered":"2024-09-15T22:09:22.857039+0000","last_clean":"2024-09-15T22:09:22.857039+0000","last_became_active":"2024-09-15T22:09:16.408068+0000","last_became_peered":"2024-09-15T22:09:16.408068+0000","last_unstale":"2024-09-15T22:09:22.857039+0000","last_undegraded":"2024-09-15T22:09:22.857039+0000","last_fullsized":"2024-09-15T22:09:22.857039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:29.217773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.431852+0000","last_change":"2024-09-15T22:09:21.457447+0000","last_active":"2024-09-15T22:09:22.431852+0000","last_peered":"2024-09-15T22:09:22.431852+0000","last_clean":"2024-09-15T22:09:22.431852+0000","last_became_active":"2024-09-15T22:09:21.457031+0000","last_became_peered":"2024-09-15T22:09:21.457031+0000","last_unstale":"2024-09-15T22:09:22.431852+0000","last_undegraded":"2024-09-15T22:09:22.431852+0000","last_fullsized":"2024-09-15T22:09:22.431852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:45.457068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856945+0000","last_change":"2024-09-15T22:09:17.400043+0000","last_active":"2024-09-15T22:09:22.856945+0000","last_peered":"2024-09-15T22:09:22.856945+0000","last_clean":"2024-09-15T22:09:22.856945+0000","last_became_active":"2024-09-15T22:09:17.399815+0000","last_became_peered":"2024-09-15T22:09:17.399815+0000","last_unstale":"2024-09-15T22:09:22.856945+0000","last_undegraded":"2024-09-15T22:09:22.856945+0000","last_fullsized":"2024-09-15T22:09:22.856945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:38.779044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434071+0000","last_change":"2024-09-15T22:09:16.407483+0000","last_active":"2024-09-15T22:09:22.434071+0000","last_peered":"2024-09-15T22:09:22.434071+0000","last_clean":"2024-09-15T22:09:22.434071+0000","last_became_active":"2024-09-15T22:09:16.407199+0000","last_became_peered":"2024-09-15T22:09:16.407199+0000","last_unstale":"2024-09-15T22:09:22.434071+0000","last_undegraded":"2024-09-15T22:09:22.434071+0000","last_fullsized":"2024-09-15T22:09:22.434071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:24.102281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857257+0000","last_change":"2024-09-15T22:09:21.449620+0000","last_active":"2024-09-15T22:09:22.857257+0000","last_peered":"2024-09-15T22:09:22.857257+0000","last_clean":"2024-09-15T22:09:22.857257+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:09:22.857257+0000","last_undegraded":"2024-09-15T22:09:22.857257+0000","last_fullsized":"2024-09-15T22:09:22.857257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:40.690811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447282+0000","last_change":"2024-09-15T22:09:17.414930+0000","last_active":"2024-09-15T22:09:22.447282+0000","last_peered":"2024-09-15T22:09:22.447282+0000","last_clean":"2024-09-15T22:09:22.447282+0000","last_became_active":"2024-09-15T22:09:17.414645+0000","last_became_peered":"2024-09-15T22:09:17.414645+0000","last_unstale":"2024-09-15T22:09:22.447282+0000","last_undegraded":"2024-09-15T22:09:22.447282+0000","last_fullsized":"2024-09-15T22:09:22.447282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:22.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857058+0000","last_change":"2024-09-15T22:09:16.408794+0000","last_active":"2024-09-15T22:09:22.857058+0000","last_peered":"2024-09-15T22:09:22.857058+0000","last_clean":"2024-09-15T22:09:22.857058+0000","last_became_active":"2024-09-15T22:09:16.408530+0000","last_became_peered":"2024-09-15T22:09:16.408530+0000","last_unstale":"2024-09-15T22:09:22.857058+0000","last_undegraded":"2024-09-15T22:09:22.857058+0000","last_fullsized":"2024-09-15T22:09:22.857058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:45.460989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857342+0000","last_change":"2024-09-15T22:09:21.451875+0000","last_active":"2024-09-15T22:09:22.857342+0000","last_peered":"2024-09-15T22:09:22.857342+0000","last_clean":"2024-09-15T22:09:22.857342+0000","last_became_active":"2024-09-15T22:09:21.451491+0000","last_became_peered":"2024-09-15T22:09:21.451491+0000","last_unstale":"2024-09-15T22:09:22.857342+0000","last_undegraded":"2024-09-15T22:09:22.857342+0000","last_fullsized":"2024-09-15T22:09:22.857342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:11.279572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434545+0000","last_change":"2024-09-15T22:09:17.409336+0000","last_active":"2024-09-15T22:09:22.434545+0000","last_peered":"2024-09-15T22:09:22.434545+0000","last_clean":"2024-09-15T22:09:22.434545+0000","last_became_active":"2024-09-15T22:09:17.409038+0000","last_became_peered":"2024-09-15T22:09:17.409038+0000","last_unstale":"2024-09-15T22:09:22.434545+0000","last_undegraded":"2024-09-15T22:09:22.434545+0000","last_fullsized":"2024-09-15T22:09:22.434545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:06.946537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447132+0000","last_change":"2024-09-15T22:09:16.409869+0000","last_active":"2024-09-15T22:09:22.447132+0000","last_peered":"2024-09-15T22:09:22.447132+0000","last_clean":"2024-09-15T22:09:22.447132+0000","last_became_active":"2024-09-15T22:09:16.409532+0000","last_became_peered":"2024-09-15T22:09:16.409532+0000","last_unstale":"2024-09-15T22:09:22.447132+0000","last_undegraded":"2024-09-15T22:09:22.447132+0000","last_fullsized":"2024-09-15T22:09:22.447132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:05.940474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857020+0000","last_change":"2024-09-15T22:09:21.458201+0000","last_active":"2024-09-15T22:09:22.857020+0000","last_peered":"2024-09-15T22:09:22.857020+0000","last_clean":"2024-09-15T22:09:22.857020+0000","last_became_active":"2024-09-15T22:09:21.457818+0000","last_became_peered":"2024-09-15T22:09:21.457818+0000","last_unstale":"2024-09-15T22:09:22.857020+0000","last_undegraded":"2024-09-15T22:09:22.857020+0000","last_fullsized":"2024-09-15T22:09:22.857020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:16.163530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857554+0000","last_change":"2024-09-15T22:09:17.399405+0000","last_active":"2024-09-15T22:09:22.857554+0000","last_peered":"2024-09-15T22:09:22.857554+0000","last_clean":"2024-09-15T22:09:22.857554+0000","last_became_active":"2024-09-15T22:09:17.399148+0000","last_became_peered":"2024-09-15T22:09:17.399148+0000","last_unstale":"2024-09-15T22:09:22.857554+0000","last_undegraded":"2024-09-15T22:09:22.857554+0000","last_fullsized":"2024-09-15T22:09:22.857554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:29.126156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856466+0000","last_change":"2024-09-15T22:09:16.402885+0000","last_active":"2024-09-15T22:09:22.856466+0000","last_peered":"2024-09-15T22:09:22.856466+0000","last_clean":"2024-09-15T22:09:22.856466+0000","last_became_active":"2024-09-15T22:09:16.402575+0000","last_became_peered":"2024-09-15T22:09:16.402575+0000","last_unstale":"2024-09-15T22:09:22.856466+0000","last_undegraded":"2024-09-15T22:09:22.856466+0000","last_fullsized":"2024-09-15T22:09:22.856466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857231+0000","last_change":"2024-09-15T22:09:21.457254+0000","last_active":"2024-09-15T22:09:22.857231+0000","last_peered":"2024-09-15T22:09:22.857231+0000","last_clean":"2024-09-15T22:09:22.857231+0000","last_became_active":"2024-09-15T22:09:21.456858+0000","last_became_peered":"2024-09-15T22:09:21.456858+0000","last_unstale":"2024-09-15T22:09:22.857231+0000","last_undegraded":"2024-09-15T22:09:22.857231+0000","last_fullsized":"2024-09-15T22:09:22.857231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:52.339264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856356+0000","last_change":"2024-09-15T22:09:17.411196+0000","last_active":"2024-09-15T22:09:22.856356+0000","last_peered":"2024-09-15T22:09:22.856356+0000","last_clean":"2024-09-15T22:09:22.856356+0000","last_became_active":"2024-09-15T22:09:17.409905+0000","last_became_peered":"2024-09-15T22:09:17.409905+0000","last_unstale":"2024-09-15T22:09:22.856356+0000","last_undegraded":"2024-09-15T22:09:22.856356+0000","last_fullsized":"2024-09-15T22:09:22.856356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:10.299704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432708+0000","last_change":"2024-09-15T22:09:16.409152+0000","last_active":"2024-09-15T22:09:22.432708+0000","last_peered":"2024-09-15T22:09:22.432708+0000","last_clean":"2024-09-15T22:09:22.432708+0000","last_became_active":"2024-09-15T22:09:16.408793+0000","last_became_peered":"2024-09-15T22:09:16.408793+0000","last_unstale":"2024-09-15T22:09:22.432708+0000","last_undegraded":"2024-09-15T22:09:22.432708+0000","last_fullsized":"2024-09-15T22:09:22.432708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:09.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857950+0000","last_change":"2024-09-15T22:09:21.456804+0000","last_active":"2024-09-15T22:09:22.857950+0000","last_peered":"2024-09-15T22:09:22.857950+0000","last_clean":"2024-09-15T22:09:22.857950+0000","last_became_active":"2024-09-15T22:09:21.456416+0000","last_became_peered":"2024-09-15T22:09:21.456416+0000","last_unstale":"2024-09-15T22:09:22.857950+0000","last_undegraded":"2024-09-15T22:09:22.857950+0000","last_fullsized":"2024-09-15T22:09:22.857950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:28.462550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432088+0000","last_change":"2024-09-15T22:09:17.415024+0000","last_active":"2024-09-15T22:09:22.432088+0000","last_peered":"2024-09-15T22:09:22.432088+0000","last_clean":"2024-09-15T22:09:22.432088+0000","last_became_active":"2024-09-15T22:09:17.414773+0000","last_became_peered":"2024-09-15T22:09:17.414773+0000","last_unstale":"2024-09-15T22:09:22.432088+0000","last_undegraded":"2024-09-15T22:09:22.432088+0000","last_fullsized":"2024-09-15T22:09:22.432088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446804+0000","last_change":"2024-09-15T22:09:16.401625+0000","last_active":"2024-09-15T22:09:22.446804+0000","last_peered":"2024-09-15T22:09:22.446804+0000","last_clean":"2024-09-15T22:09:22.446804+0000","last_became_active":"2024-09-15T22:09:16.401328+0000","last_became_peered":"2024-09-15T22:09:16.401328+0000","last_unstale":"2024-09-15T22:09:22.446804+0000","last_undegraded":"2024-09-15T22:09:22.446804+0000","last_fullsized":"2024-09-15T22:09:22.446804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432814+0000","last_change":"2024-09-15T22:09:07.243631+0000","last_active":"2024-09-15T22:09:22.432814+0000","last_peered":"2024-09-15T22:09:22.432814+0000","last_clean":"2024-09-15T22:09:22.432814+0000","last_became_active":"2024-09-15T22:09:07.243223+0000","last_became_peered":"2024-09-15T22:09:07.243223+0000","last_unstale":"2024-09-15T22:09:22.432814+0000","last_undegraded":"2024-09-15T22:09:22.432814+0000","last_fullsized":"2024-09-15T22:09:22.432814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_clean_scrub_stamp":"2024-09-15T22:09:06.009777+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:17:18.429315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856944+0000","last_change":"2024-09-15T22:09:21.453536+0000","last_active":"2024-09-15T22:09:22.856944+0000","last_peered":"2024-09-15T22:09:22.856944+0000","last_clean":"2024-09-15T22:09:22.856944+0000","last_became_active":"2024-09-15T22:09:21.453022+0000","last_became_peered":"2024-09-15T22:09:21.453022+0000","last_unstale":"2024-09-15T22:09:22.856944+0000","last_undegraded":"2024-09-15T22:09:22.856944+0000","last_fullsized":"2024-09-15T22:09:22.856944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:26.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433676+0000","last_change":"2024-09-15T22:09:17.421914+0000","last_active":"2024-09-15T22:09:22.433676+0000","last_peered":"2024-09-15T22:09:22.433676+0000","last_clean":"2024-09-15T22:09:22.433676+0000","last_became_active":"2024-09-15T22:09:17.420783+0000","last_became_peered":"2024-09-15T22:09:17.420783+0000","last_unstale":"2024-09-15T22:09:22.433676+0000","last_undegraded":"2024-09-15T22:09:22.433676+0000","last_fullsized":"2024-09-15T22:09:22.433676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:24.426671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856694+0000","last_change":"2024-09-15T22:09:16.404982+0000","last_active":"2024-09-15T22:09:22.856694+0000","last_peered":"2024-09-15T22:09:22.856694+0000","last_clean":"2024-09-15T22:09:22.856694+0000","last_became_active":"2024-09-15T22:09:16.404639+0000","last_became_peered":"2024-09-15T22:09:16.404639+0000","last_unstale":"2024-09-15T22:09:22.856694+0000","last_undegraded":"2024-09-15T22:09:22.856694+0000","last_fullsized":"2024-09-15T22:09:22.856694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856609+0000","last_change":"2024-09-15T22:09:21.457352+0000","last_active":"2024-09-15T22:09:22.856609+0000","last_peered":"2024-09-15T22:09:22.856609+0000","last_clean":"2024-09-15T22:09:22.856609+0000","last_became_active":"2024-09-15T22:09:21.456906+0000","last_became_peered":"2024-09-15T22:09:21.456906+0000","last_unstale":"2024-09-15T22:09:22.856609+0000","last_undegraded":"2024-09-15T22:09:22.856609+0000","last_fullsized":"2024-09-15T22:09:22.856609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:28.271273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447025+0000","last_change":"2024-09-15T22:09:17.416652+0000","last_active":"2024-09-15T22:09:22.447025+0000","last_peered":"2024-09-15T22:09:22.447025+0000","last_clean":"2024-09-15T22:09:22.447025+0000","last_became_active":"2024-09-15T22:09:17.415597+0000","last_became_peered":"2024-09-15T22:09:17.415597+0000","last_unstale":"2024-09-15T22:09:22.447025+0000","last_undegraded":"2024-09-15T22:09:22.447025+0000","last_fullsized":"2024-09-15T22:09:22.447025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:36.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856534+0000","last_change":"2024-09-15T22:09:16.405689+0000","last_active":"2024-09-15T22:09:22.856534+0000","last_peered":"2024-09-15T22:09:22.856534+0000","last_clean":"2024-09-15T22:09:22.856534+0000","last_became_active":"2024-09-15T22:09:16.405433+0000","last_became_peered":"2024-09-15T22:09:16.405433+0000","last_unstale":"2024-09-15T22:09:22.856534+0000","last_undegraded":"2024-09-15T22:09:22.856534+0000","last_fullsized":"2024-09-15T22:09:22.856534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.332999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857836+0000","last_change":"2024-09-15T22:09:21.448031+0000","last_active":"2024-09-15T22:09:22.857836+0000","last_peered":"2024-09-15T22:09:22.857836+0000","last_clean":"2024-09-15T22:09:22.857836+0000","last_became_active":"2024-09-15T22:09:21.447464+0000","last_became_peered":"2024-09-15T22:09:21.447464+0000","last_unstale":"2024-09-15T22:09:22.857836+0000","last_undegraded":"2024-09-15T22:09:22.857836+0000","last_fullsized":"2024-09-15T22:09:22.857836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:26.039358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434380+0000","last_change":"2024-09-15T22:09:17.412910+0000","last_active":"2024-09-15T22:09:22.434380+0000","last_peered":"2024-09-15T22:09:22.434380+0000","last_clean":"2024-09-15T22:09:22.434380+0000","last_became_active":"2024-09-15T22:09:17.412079+0000","last_became_peered":"2024-09-15T22:09:17.412079+0000","last_unstale":"2024-09-15T22:09:22.434380+0000","last_undegraded":"2024-09-15T22:09:22.434380+0000","last_fullsized":"2024-09-15T22:09:22.434380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:04.536343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856351+0000","last_change":"2024-09-15T22:09:16.405941+0000","last_active":"2024-09-15T22:09:22.856351+0000","last_peered":"2024-09-15T22:09:22.856351+0000","last_clean":"2024-09-15T22:09:22.856351+0000","last_became_active":"2024-09-15T22:09:16.405621+0000","last_became_peered":"2024-09-15T22:09:16.405621+0000","last_unstale":"2024-09-15T22:09:22.856351+0000","last_undegraded":"2024-09-15T22:09:22.856351+0000","last_fullsized":"2024-09-15T22:09:22.856351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446643+0000","last_change":"2024-09-15T22:09:21.449669+0000","last_active":"2024-09-15T22:09:22.446643+0000","last_peered":"2024-09-15T22:09:22.446643+0000","last_clean":"2024-09-15T22:09:22.446643+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:09:22.446643+0000","last_undegraded":"2024-09-15T22:09:22.446643+0000","last_fullsized":"2024-09-15T22:09:22.446643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:45.457068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433550+0000","last_change":"2024-09-15T22:09:17.410475+0000","last_active":"2024-09-15T22:09:22.433550+0000","last_peered":"2024-09-15T22:09:22.433550+0000","last_clean":"2024-09-15T22:09:22.433550+0000","last_became_active":"2024-09-15T22:09:17.410176+0000","last_became_peered":"2024-09-15T22:09:17.410176+0000","last_unstale":"2024-09-15T22:09:22.433550+0000","last_undegraded":"2024-09-15T22:09:22.433550+0000","last_fullsized":"2024-09-15T22:09:22.433550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434085+0000","last_change":"2024-09-15T22:09:16.399090+0000","last_active":"2024-09-15T22:09:22.434085+0000","last_peered":"2024-09-15T22:09:22.434085+0000","last_clean":"2024-09-15T22:09:22.434085+0000","last_became_active":"2024-09-15T22:09:16.398789+0000","last_became_peered":"2024-09-15T22:09:16.398789+0000","last_unstale":"2024-09-15T22:09:22.434085+0000","last_undegraded":"2024-09-15T22:09:22.434085+0000","last_fullsized":"2024-09-15T22:09:22.434085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:14.477432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433128+0000","last_change":"2024-09-15T22:09:21.448270+0000","last_active":"2024-09-15T22:09:22.433128+0000","last_peered":"2024-09-15T22:09:22.433128+0000","last_clean":"2024-09-15T22:09:22.433128+0000","last_became_active":"2024-09-15T22:09:21.447541+0000","last_became_peered":"2024-09-15T22:09:21.447541+0000","last_unstale":"2024-09-15T22:09:22.433128+0000","last_undegraded":"2024-09-15T22:09:22.433128+0000","last_fullsized":"2024-09-15T22:09:22.433128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:51.175728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433007+0000","last_change":"2024-09-15T22:09:17.410762+0000","last_active":"2024-09-15T22:09:22.433007+0000","last_peered":"2024-09-15T22:09:22.433007+0000","last_clean":"2024-09-15T22:09:22.433007+0000","last_became_active":"2024-09-15T22:09:17.410431+0000","last_became_peered":"2024-09-15T22:09:17.410431+0000","last_unstale":"2024-09-15T22:09:22.433007+0000","last_undegraded":"2024-09-15T22:09:22.433007+0000","last_fullsized":"2024-09-15T22:09:22.433007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:15.123863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.855905+0000","last_change":"2024-09-15T22:09:16.409298+0000","last_active":"2024-09-15T22:09:22.855905+0000","last_peered":"2024-09-15T22:09:22.855905+0000","last_clean":"2024-09-15T22:09:22.855905+0000","last_became_active":"2024-09-15T22:09:16.408991+0000","last_became_peered":"2024-09-15T22:09:16.408991+0000","last_unstale":"2024-09-15T22:09:22.855905+0000","last_undegraded":"2024-09-15T22:09:22.855905+0000","last_fullsized":"2024-09-15T22:09:22.855905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.799831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857935+0000","last_change":"2024-09-15T22:09:21.453936+0000","last_active":"2024-09-15T22:09:22.857935+0000","last_peered":"2024-09-15T22:09:22.857935+0000","last_clean":"2024-09-15T22:09:22.857935+0000","last_became_active":"2024-09-15T22:09:21.453526+0000","last_became_peered":"2024-09-15T22:09:21.453526+0000","last_unstale":"2024-09-15T22:09:22.857935+0000","last_undegraded":"2024-09-15T22:09:22.857935+0000","last_fullsized":"2024-09-15T22:09:22.857935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:19.159742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856612+0000","last_change":"2024-09-15T22:09:17.404617+0000","last_active":"2024-09-15T22:09:22.856612+0000","last_peered":"2024-09-15T22:09:22.856612+0000","last_clean":"2024-09-15T22:09:22.856612+0000","last_became_active":"2024-09-15T22:09:17.404310+0000","last_became_peered":"2024-09-15T22:09:17.404310+0000","last_unstale":"2024-09-15T22:09:22.856612+0000","last_undegraded":"2024-09-15T22:09:22.856612+0000","last_fullsized":"2024-09-15T22:09:22.856612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:17.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856611+0000","last_change":"2024-09-15T22:09:16.403439+0000","last_active":"2024-09-15T22:09:22.856611+0000","last_peered":"2024-09-15T22:09:22.856611+0000","last_clean":"2024-09-15T22:09:22.856611+0000","last_became_active":"2024-09-15T22:09:16.403137+0000","last_became_peered":"2024-09-15T22:09:16.403137+0000","last_unstale":"2024-09-15T22:09:22.856611+0000","last_undegraded":"2024-09-15T22:09:22.856611+0000","last_fullsized":"2024-09-15T22:09:22.856611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:05.940474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432504+0000","last_change":"2024-09-15T22:09:21.451370+0000","last_active":"2024-09-15T22:09:22.432504+0000","last_peered":"2024-09-15T22:09:22.432504+0000","last_clean":"2024-09-15T22:09:22.432504+0000","last_became_active":"2024-09-15T22:09:21.451016+0000","last_became_peered":"2024-09-15T22:09:21.451016+0000","last_unstale":"2024-09-15T22:09:22.432504+0000","last_undegraded":"2024-09-15T22:09:22.432504+0000","last_fullsized":"2024-09-15T22:09:22.432504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:54.480340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433466+0000","last_change":"2024-09-15T22:09:17.412953+0000","last_active":"2024-09-15T22:09:22.433466+0000","last_peered":"2024-09-15T22:09:22.433466+0000","last_clean":"2024-09-15T22:09:22.433466+0000","last_became_active":"2024-09-15T22:09:17.412680+0000","last_became_peered":"2024-09-15T22:09:17.412680+0000","last_unstale":"2024-09-15T22:09:22.433466+0000","last_undegraded":"2024-09-15T22:09:22.433466+0000","last_fullsized":"2024-09-15T22:09:22.433466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:36.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446965+0000","last_change":"2024-09-15T22:09:16.406833+0000","last_active":"2024-09-15T22:09:22.446965+0000","last_peered":"2024-09-15T22:09:22.446965+0000","last_clean":"2024-09-15T22:09:22.446965+0000","last_became_active":"2024-09-15T22:09:16.406550+0000","last_became_peered":"2024-09-15T22:09:16.406550+0000","last_unstale":"2024-09-15T22:09:22.446965+0000","last_undegraded":"2024-09-15T22:09:22.446965+0000","last_fullsized":"2024-09-15T22:09:22.446965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432709+0000","last_change":"2024-09-15T22:09:21.450825+0000","last_active":"2024-09-15T22:09:22.432709+0000","last_peered":"2024-09-15T22:09:22.432709+0000","last_clean":"2024-09-15T22:09:22.432709+0000","last_became_active":"2024-09-15T22:09:21.450200+0000","last_became_peered":"2024-09-15T22:09:21.450200+0000","last_unstale":"2024-09-15T22:09:22.432709+0000","last_undegraded":"2024-09-15T22:09:22.432709+0000","last_fullsized":"2024-09-15T22:09:22.432709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:10.812526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857874+0000","last_change":"2024-09-15T22:09:17.421088+0000","last_active":"2024-09-15T22:09:22.857874+0000","last_peered":"2024-09-15T22:09:22.857874+0000","last_clean":"2024-09-15T22:09:22.857874+0000","last_became_active":"2024-09-15T22:09:17.420802+0000","last_became_peered":"2024-09-15T22:09:17.420802+0000","last_unstale":"2024-09-15T22:09:22.857874+0000","last_undegraded":"2024-09-15T22:09:22.857874+0000","last_fullsized":"2024-09-15T22:09:22.857874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:57.079300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857630+0000","last_change":"2024-09-15T22:09:16.395676+0000","last_active":"2024-09-15T22:09:22.857630+0000","last_peered":"2024-09-15T22:09:22.857630+0000","last_clean":"2024-09-15T22:09:22.857630+0000","last_became_active":"2024-09-15T22:09:16.394355+0000","last_became_peered":"2024-09-15T22:09:16.394355+0000","last_unstale":"2024-09-15T22:09:22.857630+0000","last_undegraded":"2024-09-15T22:09:22.857630+0000","last_fullsized":"2024-09-15T22:09:22.857630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:53.845610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447248+0000","last_change":"2024-09-15T22:09:21.454458+0000","last_active":"2024-09-15T22:09:22.447248+0000","last_peered":"2024-09-15T22:09:22.447248+0000","last_clean":"2024-09-15T22:09:22.447248+0000","last_became_active":"2024-09-15T22:09:21.453992+0000","last_became_peered":"2024-09-15T22:09:21.453992+0000","last_unstale":"2024-09-15T22:09:22.447248+0000","last_undegraded":"2024-09-15T22:09:22.447248+0000","last_fullsized":"2024-09-15T22:09:22.447248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:08.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433584+0000","last_change":"2024-09-15T22:09:17.404161+0000","last_active":"2024-09-15T22:09:22.433584+0000","last_peered":"2024-09-15T22:09:22.433584+0000","last_clean":"2024-09-15T22:09:22.433584+0000","last_became_active":"2024-09-15T22:09:17.403899+0000","last_became_peered":"2024-09-15T22:09:17.403899+0000","last_unstale":"2024-09-15T22:09:22.433584+0000","last_undegraded":"2024-09-15T22:09:22.433584+0000","last_fullsized":"2024-09-15T22:09:22.433584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:22.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:26.561882+0000","last_change":"2024-09-15T22:09:16.403905+0000","last_active":"2024-09-15T22:09:26.561882+0000","last_peered":"2024-09-15T22:09:26.561882+0000","last_clean":"2024-09-15T22:09:26.561882+0000","last_became_active":"2024-09-15T22:09:16.403624+0000","last_became_peered":"2024-09-15T22:09:16.403624+0000","last_unstale":"2024-09-15T22:09:26.561882+0000","last_undegraded":"2024-09-15T22:09:26.561882+0000","last_fullsized":"2024-09-15T22:09:26.561882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857547+0000","last_change":"2024-09-15T22:09:21.452045+0000","last_active":"2024-09-15T22:09:22.857547+0000","last_peered":"2024-09-15T22:09:22.857547+0000","last_clean":"2024-09-15T22:09:22.857547+0000","last_became_active":"2024-09-15T22:09:21.451617+0000","last_became_peered":"2024-09-15T22:09:21.451617+0000","last_unstale":"2024-09-15T22:09:22.857547+0000","last_undegraded":"2024-09-15T22:09:22.857547+0000","last_fullsized":"2024-09-15T22:09:22.857547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:32.189930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434073+0000","last_change":"2024-09-15T22:09:17.399198+0000","last_active":"2024-09-15T22:09:22.434073+0000","last_peered":"2024-09-15T22:09:22.434073+0000","last_clean":"2024-09-15T22:09:22.434073+0000","last_became_active":"2024-09-15T22:09:17.398881+0000","last_became_peered":"2024-09-15T22:09:17.398881+0000","last_unstale":"2024-09-15T22:09:22.434073+0000","last_undegraded":"2024-09-15T22:09:22.434073+0000","last_fullsized":"2024-09-15T22:09:22.434073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:44.868956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856437+0000","last_change":"2024-09-15T22:09:16.408365+0000","last_active":"2024-09-15T22:09:22.856437+0000","last_peered":"2024-09-15T22:09:22.856437+0000","last_clean":"2024-09-15T22:09:22.856437+0000","last_became_active":"2024-09-15T22:09:16.408064+0000","last_became_peered":"2024-09-15T22:09:16.408064+0000","last_unstale":"2024-09-15T22:09:22.856437+0000","last_undegraded":"2024-09-15T22:09:22.856437+0000","last_fullsized":"2024-09-15T22:09:22.856437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:01.032313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434291+0000","last_change":"2024-09-15T22:09:21.455334+0000","last_active":"2024-09-15T22:09:22.434291+0000","last_peered":"2024-09-15T22:09:22.434291+0000","last_clean":"2024-09-15T22:09:22.434291+0000","last_became_active":"2024-09-15T22:09:21.454907+0000","last_became_peered":"2024-09-15T22:09:21.454907+0000","last_unstale":"2024-09-15T22:09:22.434291+0000","last_undegraded":"2024-09-15T22:09:22.434291+0000","last_fullsized":"2024-09-15T22:09:22.434291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:26.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856952+0000","last_change":"2024-09-15T22:09:17.415215+0000","last_active":"2024-09-15T22:09:22.856952+0000","last_peered":"2024-09-15T22:09:22.856952+0000","last_clean":"2024-09-15T22:09:22.856952+0000","last_became_active":"2024-09-15T22:09:17.414951+0000","last_became_peered":"2024-09-15T22:09:17.414951+0000","last_unstale":"2024-09-15T22:09:22.856952+0000","last_undegraded":"2024-09-15T22:09:22.856952+0000","last_fullsized":"2024-09-15T22:09:22.856952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447106+0000","last_change":"2024-09-15T22:09:16.405521+0000","last_active":"2024-09-15T22:09:22.447106+0000","last_peered":"2024-09-15T22:09:22.447106+0000","last_clean":"2024-09-15T22:09:22.447106+0000","last_became_active":"2024-09-15T22:09:16.405230+0000","last_became_peered":"2024-09-15T22:09:16.405230+0000","last_unstale":"2024-09-15T22:09:22.447106+0000","last_undegraded":"2024-09-15T22:09:22.447106+0000","last_fullsized":"2024-09-15T22:09:22.447106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:03.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432020+0000","last_change":"2024-09-15T22:09:21.450431+0000","last_active":"2024-09-15T22:09:22.432020+0000","last_peered":"2024-09-15T22:09:22.432020+0000","last_clean":"2024-09-15T22:09:22.432020+0000","last_became_active":"2024-09-15T22:09:21.449896+0000","last_became_peered":"2024-09-15T22:09:21.449896+0000","last_unstale":"2024-09-15T22:09:22.432020+0000","last_undegraded":"2024-09-15T22:09:22.432020+0000","last_fullsized":"2024-09-15T22:09:22.432020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:18.430595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447073+0000","last_change":"2024-09-15T22:09:17.422669+0000","last_active":"2024-09-15T22:09:22.447073+0000","last_peered":"2024-09-15T22:09:22.447073+0000","last_clean":"2024-09-15T22:09:22.447073+0000","last_became_active":"2024-09-15T22:09:17.422401+0000","last_became_peered":"2024-09-15T22:09:17.422401+0000","last_unstale":"2024-09-15T22:09:22.447073+0000","last_undegraded":"2024-09-15T22:09:22.447073+0000","last_fullsized":"2024-09-15T22:09:22.447073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857139+0000","last_change":"2024-09-15T22:09:16.405552+0000","last_active":"2024-09-15T22:09:22.857139+0000","last_peered":"2024-09-15T22:09:22.857139+0000","last_clean":"2024-09-15T22:09:22.857139+0000","last_became_active":"2024-09-15T22:09:16.405208+0000","last_became_peered":"2024-09-15T22:09:16.405208+0000","last_unstale":"2024-09-15T22:09:22.857139+0000","last_undegraded":"2024-09-15T22:09:22.857139+0000","last_fullsized":"2024-09-15T22:09:22.857139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432030+0000","last_change":"2024-09-15T22:09:21.448849+0000","last_active":"2024-09-15T22:09:22.432030+0000","last_peered":"2024-09-15T22:09:22.432030+0000","last_clean":"2024-09-15T22:09:22.432030+0000","last_became_active":"2024-09-15T22:09:21.448356+0000","last_became_peered":"2024-09-15T22:09:21.448356+0000","last_unstale":"2024-09-15T22:09:22.432030+0000","last_undegraded":"2024-09-15T22:09:22.432030+0000","last_fullsized":"2024-09-15T22:09:22.432030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:08.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857853+0000","last_change":"2024-09-15T22:09:21.458815+0000","last_active":"2024-09-15T22:09:22.857853+0000","last_peered":"2024-09-15T22:09:22.857853+0000","last_clean":"2024-09-15T22:09:22.857853+0000","last_became_active":"2024-09-15T22:09:21.458418+0000","last_became_peered":"2024-09-15T22:09:21.458418+0000","last_unstale":"2024-09-15T22:09:22.857853+0000","last_undegraded":"2024-09-15T22:09:22.857853+0000","last_fullsized":"2024-09-15T22:09:22.857853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:26.187414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857180+0000","last_change":"2024-09-15T22:09:17.401001+0000","last_active":"2024-09-15T22:09:22.857180+0000","last_peered":"2024-09-15T22:09:22.857180+0000","last_clean":"2024-09-15T22:09:22.857180+0000","last_became_active":"2024-09-15T22:09:17.400754+0000","last_became_peered":"2024-09-15T22:09:17.400754+0000","last_unstale":"2024-09-15T22:09:22.857180+0000","last_undegraded":"2024-09-15T22:09:22.857180+0000","last_fullsized":"2024-09-15T22:09:22.857180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:33.878828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446850+0000","last_change":"2024-09-15T22:09:16.404987+0000","last_active":"2024-09-15T22:09:22.446850+0000","last_peered":"2024-09-15T22:09:22.446850+0000","last_clean":"2024-09-15T22:09:22.446850+0000","last_became_active":"2024-09-15T22:09:16.404694+0000","last_became_peered":"2024-09-15T22:09:16.404694+0000","last_unstale":"2024-09-15T22:09:22.446850+0000","last_undegraded":"2024-09-15T22:09:22.446850+0000","last_fullsized":"2024-09-15T22:09:22.446850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857090+0000","last_change":"2024-09-15T22:09:21.457334+0000","last_active":"2024-09-15T22:09:22.857090+0000","last_peered":"2024-09-15T22:09:22.857090+0000","last_clean":"2024-09-15T22:09:22.857090+0000","last_became_active":"2024-09-15T22:09:21.456871+0000","last_became_peered":"2024-09-15T22:09:21.456871+0000","last_unstale":"2024-09-15T22:09:22.857090+0000","last_undegraded":"2024-09-15T22:09:22.857090+0000","last_fullsized":"2024-09-15T22:09:22.857090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:08.904123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432074+0000","last_change":"2024-09-15T22:09:17.402872+0000","last_active":"2024-09-15T22:09:22.432074+0000","last_peered":"2024-09-15T22:09:22.432074+0000","last_clean":"2024-09-15T22:09:22.432074+0000","last_became_active":"2024-09-15T22:09:17.402625+0000","last_became_peered":"2024-09-15T22:09:17.402625+0000","last_unstale":"2024-09-15T22:09:22.432074+0000","last_undegraded":"2024-09-15T22:09:22.432074+0000","last_fullsized":"2024-09-15T22:09:22.432074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432270+0000","last_change":"2024-09-15T22:09:16.405821+0000","last_active":"2024-09-15T22:09:22.432270+0000","last_peered":"2024-09-15T22:09:22.432270+0000","last_clean":"2024-09-15T22:09:22.432270+0000","last_became_active":"2024-09-15T22:09:16.405561+0000","last_became_peered":"2024-09-15T22:09:16.405561+0000","last_unstale":"2024-09-15T22:09:22.432270+0000","last_undegraded":"2024-09-15T22:09:22.432270+0000","last_fullsized":"2024-09-15T22:09:22.432270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856909+0000","last_change":"2024-09-15T22:09:16.403455+0000","last_active":"2024-09-15T22:09:22.856909+0000","last_peered":"2024-09-15T22:09:22.856909+0000","last_clean":"2024-09-15T22:09:22.856909+0000","last_became_active":"2024-09-15T22:09:16.403172+0000","last_became_peered":"2024-09-15T22:09:16.403172+0000","last_unstale":"2024-09-15T22:09:22.856909+0000","last_undegraded":"2024-09-15T22:09:22.856909+0000","last_fullsized":"2024-09-15T22:09:22.856909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:03.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857480+0000","last_change":"2024-09-15T22:09:17.416335+0000","last_active":"2024-09-15T22:09:22.857480+0000","last_peered":"2024-09-15T22:09:22.857480+0000","last_clean":"2024-09-15T22:09:22.857480+0000","last_became_active":"2024-09-15T22:09:17.416102+0000","last_became_peered":"2024-09-15T22:09:17.416102+0000","last_unstale":"2024-09-15T22:09:22.857480+0000","last_undegraded":"2024-09-15T22:09:22.857480+0000","last_fullsized":"2024-09-15T22:09:22.857480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856673+0000","last_change":"2024-09-15T22:09:21.448449+0000","last_active":"2024-09-15T22:09:22.856673+0000","last_peered":"2024-09-15T22:09:22.856673+0000","last_clean":"2024-09-15T22:09:22.856673+0000","last_became_active":"2024-09-15T22:09:21.448020+0000","last_became_peered":"2024-09-15T22:09:21.448020+0000","last_unstale":"2024-09-15T22:09:22.856673+0000","last_undegraded":"2024-09-15T22:09:22.856673+0000","last_fullsized":"2024-09-15T22:09:22.856673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:05.244676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432514+0000","last_change":"2024-09-15T22:09:16.401331+0000","last_active":"2024-09-15T22:09:22.432514+0000","last_peered":"2024-09-15T22:09:22.432514+0000","last_clean":"2024-09-15T22:09:22.432514+0000","last_became_active":"2024-09-15T22:09:16.401040+0000","last_became_peered":"2024-09-15T22:09:16.401040+0000","last_unstale":"2024-09-15T22:09:22.432514+0000","last_undegraded":"2024-09-15T22:09:22.432514+0000","last_fullsized":"2024-09-15T22:09:22.432514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.799831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433188+0000","last_change":"2024-09-15T22:09:17.405328+0000","last_active":"2024-09-15T22:09:22.433188+0000","last_peered":"2024-09-15T22:09:22.433188+0000","last_clean":"2024-09-15T22:09:22.433188+0000","last_became_active":"2024-09-15T22:09:17.404772+0000","last_became_peered":"2024-09-15T22:09:17.404772+0000","last_unstale":"2024-09-15T22:09:22.433188+0000","last_undegraded":"2024-09-15T22:09:22.433188+0000","last_fullsized":"2024-09-15T22:09:22.433188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:33.377260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432644+0000","last_change":"2024-09-15T22:09:21.458359+0000","last_active":"2024-09-15T22:09:22.432644+0000","last_peered":"2024-09-15T22:09:22.432644+0000","last_clean":"2024-09-15T22:09:22.432644+0000","last_became_active":"2024-09-15T22:09:21.457977+0000","last_became_peered":"2024-09-15T22:09:21.457977+0000","last_unstale":"2024-09-15T22:09:22.432644+0000","last_undegraded":"2024-09-15T22:09:22.432644+0000","last_fullsized":"2024-09-15T22:09:22.432644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.055754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856459+0000","last_change":"2024-09-15T22:09:17.405556+0000","last_active":"2024-09-15T22:09:22.856459+0000","last_peered":"2024-09-15T22:09:22.856459+0000","last_clean":"2024-09-15T22:09:22.856459+0000","last_became_active":"2024-09-15T22:09:17.405129+0000","last_became_peered":"2024-09-15T22:09:17.405129+0000","last_unstale":"2024-09-15T22:09:22.856459+0000","last_undegraded":"2024-09-15T22:09:22.856459+0000","last_fullsized":"2024-09-15T22:09:22.856459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856332+0000","last_change":"2024-09-15T22:09:17.408189+0000","last_active":"2024-09-15T22:09:22.856332+0000","last_peered":"2024-09-15T22:09:22.856332+0000","last_clean":"2024-09-15T22:09:22.856332+0000","last_became_active":"2024-09-15T22:09:17.407877+0000","last_became_peered":"2024-09-15T22:09:17.407877+0000","last_unstale":"2024-09-15T22:09:22.856332+0000","last_undegraded":"2024-09-15T22:09:22.856332+0000","last_fullsized":"2024-09-15T22:09:22.856332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:02.290840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446878+0000","last_change":"2024-09-15T22:09:17.415666+0000","last_active":"2024-09-15T22:09:22.446878+0000","last_peered":"2024-09-15T22:09:22.446878+0000","last_clean":"2024-09-15T22:09:22.446878+0000","last_became_active":"2024-09-15T22:09:17.415399+0000","last_became_peered":"2024-09-15T22:09:17.415399+0000","last_unstale":"2024-09-15T22:09:22.446878+0000","last_undegraded":"2024-09-15T22:09:22.446878+0000","last_fullsized":"2024-09-15T22:09:22.446878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857393+0000","last_change":"2024-09-15T22:09:17.406140+0000","last_active":"2024-09-15T22:09:22.857393+0000","last_peered":"2024-09-15T22:09:22.857393+0000","last_clean":"2024-09-15T22:09:22.857393+0000","last_became_active":"2024-09-15T22:09:17.405142+0000","last_became_peered":"2024-09-15T22:09:17.405142+0000","last_unstale":"2024-09-15T22:09:22.857393+0000","last_undegraded":"2024-09-15T22:09:22.857393+0000","last_fullsized":"2024-09-15T22:09:22.857393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:17.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432765+0000","last_change":"2024-09-15T22:09:17.411027+0000","last_active":"2024-09-15T22:09:22.432765+0000","last_peered":"2024-09-15T22:09:22.432765+0000","last_clean":"2024-09-15T22:09:22.432765+0000","last_became_active":"2024-09-15T22:09:17.408913+0000","last_became_peered":"2024-09-15T22:09:17.408913+0000","last_unstale":"2024-09-15T22:09:22.432765+0000","last_undegraded":"2024-09-15T22:09:22.432765+0000","last_fullsized":"2024-09-15T22:09:22.432765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:34.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856265+0000","last_change":"2024-09-15T22:09:17.401385+0000","last_active":"2024-09-15T22:09:22.856265+0000","last_peered":"2024-09-15T22:09:22.856265+0000","last_clean":"2024-09-15T22:09:22.856265+0000","last_became_active":"2024-09-15T22:09:17.400916+0000","last_became_peered":"2024-09-15T22:09:17.400916+0000","last_unstale":"2024-09-15T22:09:22.856265+0000","last_undegraded":"2024-09-15T22:09:22.856265+0000","last_fullsized":"2024-09-15T22:09:22.856265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:31.994148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857149+0000","last_change":"2024-09-15T22:09:17.405622+0000","last_active":"2024-09-15T22:09:22.857149+0000","last_peered":"2024-09-15T22:09:22.857149+0000","last_clean":"2024-09-15T22:09:22.857149+0000","last_became_active":"2024-09-15T22:09:17.405319+0000","last_became_peered":"2024-09-15T22:09:17.405319+0000","last_unstale":"2024-09-15T22:09:22.857149+0000","last_undegraded":"2024-09-15T22:09:22.857149+0000","last_fullsized":"2024-09-15T22:09:22.857149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432397+0000","last_change":"2024-09-15T22:09:17.409317+0000","last_active":"2024-09-15T22:09:22.432397+0000","last_peered":"2024-09-15T22:09:22.432397+0000","last_clean":"2024-09-15T22:09:22.432397+0000","last_became_active":"2024-09-15T22:09:17.408949+0000","last_became_peered":"2024-09-15T22:09:17.408949+0000","last_unstale":"2024-09-15T22:09:22.432397+0000","last_undegraded":"2024-09-15T22:09:22.432397+0000","last_fullsized":"2024-09-15T22:09:22.432397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446723+0000","last_change":"2024-09-15T22:09:17.416439+0000","last_active":"2024-09-15T22:09:22.446723+0000","last_peered":"2024-09-15T22:09:22.446723+0000","last_clean":"2024-09-15T22:09:22.446723+0000","last_became_active":"2024-09-15T22:09:17.416170+0000","last_became_peered":"2024-09-15T22:09:17.416170+0000","last_unstale":"2024-09-15T22:09:22.446723+0000","last_undegraded":"2024-09-15T22:09:22.446723+0000","last_fullsized":"2024-09-15T22:09:22.446723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432211+0000","last_change":"2024-09-15T22:09:17.409471+0000","last_active":"2024-09-15T22:09:22.432211+0000","last_peered":"2024-09-15T22:09:22.432211+0000","last_clean":"2024-09-15T22:09:22.432211+0000","last_became_active":"2024-09-15T22:09:17.408969+0000","last_became_peered":"2024-09-15T22:09:17.408969+0000","last_unstale":"2024-09-15T22:09:22.432211+0000","last_undegraded":"2024-09-15T22:09:22.432211+0000","last_fullsized":"2024-09-15T22:09:22.432211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446844+0000","last_change":"2024-09-15T22:09:17.422118+0000","last_active":"2024-09-15T22:09:22.446844+0000","last_peered":"2024-09-15T22:09:22.446844+0000","last_clean":"2024-09-15T22:09:22.446844+0000","last_became_active":"2024-09-15T22:09:17.421846+0000","last_became_peered":"2024-09-15T22:09:17.421846+0000","last_unstale":"2024-09-15T22:09:22.446844+0000","last_undegraded":"2024-09-15T22:09:22.446844+0000","last_fullsized":"2024-09-15T22:09:22.446844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:34.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857299+0000","last_change":"2024-09-15T22:09:17.421168+0000","last_active":"2024-09-15T22:09:22.857299+0000","last_peered":"2024-09-15T22:09:22.857299+0000","last_clean":"2024-09-15T22:09:22.857299+0000","last_became_active":"2024-09-15T22:09:17.420849+0000","last_became_peered":"2024-09-15T22:09:17.420849+0000","last_unstale":"2024-09-15T22:09:22.857299+0000","last_undegraded":"2024-09-15T22:09:22.857299+0000","last_fullsized":"2024-09-15T22:09:22.857299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:25.108343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856803+0000","last_change":"2024-09-15T22:09:17.410112+0000","last_active":"2024-09-15T22:09:22.856803+0000","last_peered":"2024-09-15T22:09:22.856803+0000","last_clean":"2024-09-15T22:09:22.856803+0000","last_became_active":"2024-09-15T22:09:17.409837+0000","last_became_peered":"2024-09-15T22:09:17.409837+0000","last_unstale":"2024-09-15T22:09:22.856803+0000","last_undegraded":"2024-09-15T22:09:22.856803+0000","last_fullsized":"2024-09-15T22:09:22.856803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433979+0000","last_change":"2024-09-15T22:09:17.400115+0000","last_active":"2024-09-15T22:09:22.433979+0000","last_peered":"2024-09-15T22:09:22.433979+0000","last_clean":"2024-09-15T22:09:22.433979+0000","last_became_active":"2024-09-15T22:09:17.399835+0000","last_became_peered":"2024-09-15T22:09:17.399835+0000","last_unstale":"2024-09-15T22:09:22.433979+0000","last_undegraded":"2024-09-15T22:09:22.433979+0000","last_fullsized":"2024-09-15T22:09:22.433979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:13.972528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856270+0000","last_change":"2024-09-15T22:09:17.401680+0000","last_active":"2024-09-15T22:09:22.856270+0000","last_peered":"2024-09-15T22:09:22.856270+0000","last_clean":"2024-09-15T22:09:22.856270+0000","last_became_active":"2024-09-15T22:09:17.401413+0000","last_became_peered":"2024-09-15T22:09:17.401413+0000","last_unstale":"2024-09-15T22:09:22.856270+0000","last_undegraded":"2024-09-15T22:09:22.856270+0000","last_fullsized":"2024-09-15T22:09:22.856270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:04.007901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447310+0000","last_change":"2024-09-15T22:09:17.421910+0000","last_active":"2024-09-15T22:09:22.447310+0000","last_peered":"2024-09-15T22:09:22.447310+0000","last_clean":"2024-09-15T22:09:22.447310+0000","last_became_active":"2024-09-15T22:09:17.421469+0000","last_became_peered":"2024-09-15T22:09:17.421469+0000","last_unstale":"2024-09-15T22:09:22.447310+0000","last_undegraded":"2024-09-15T22:09:22.447310+0000","last_fullsized":"2024-09-15T22:09:22.447310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:15.123863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446601+0000","last_change":"2024-09-15T22:09:17.411524+0000","last_active":"2024-09-15T22:09:22.446601+0000","last_peered":"2024-09-15T22:09:22.446601+0000","last_clean":"2024-09-15T22:09:22.446601+0000","last_became_active":"2024-09-15T22:09:17.411244+0000","last_became_peered":"2024-09-15T22:09:17.411244+0000","last_unstale":"2024-09-15T22:09:22.446601+0000","last_undegraded":"2024-09-15T22:09:22.446601+0000","last_fullsized":"2024-09-15T22:09:22.446601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857274+0000","last_change":"2024-09-15T22:09:17.409933+0000","last_active":"2024-09-15T22:09:22.857274+0000","last_peered":"2024-09-15T22:09:22.857274+0000","last_clean":"2024-09-15T22:09:22.857274+0000","last_became_active":"2024-09-15T22:09:17.409681+0000","last_became_peered":"2024-09-15T22:09:17.409681+0000","last_unstale":"2024-09-15T22:09:22.857274+0000","last_undegraded":"2024-09-15T22:09:22.857274+0000","last_fullsized":"2024-09-15T22:09:22.857274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:37.130999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857870+0000","last_change":"2024-09-15T22:09:17.403522+0000","last_active":"2024-09-15T22:09:22.857870+0000","last_peered":"2024-09-15T22:09:22.857870+0000","last_clean":"2024-09-15T22:09:22.857870+0000","last_became_active":"2024-09-15T22:09:17.403220+0000","last_became_peered":"2024-09-15T22:09:17.403220+0000","last_unstale":"2024-09-15T22:09:22.857870+0000","last_undegraded":"2024-09-15T22:09:22.857870+0000","last_fullsized":"2024-09-15T22:09:22.857870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:01.208798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432332+0000","last_change":"2024-09-15T22:09:17.400537+0000","last_active":"2024-09-15T22:09:22.432332+0000","last_peered":"2024-09-15T22:09:22.432332+0000","last_clean":"2024-09-15T22:09:22.432332+0000","last_became_active":"2024-09-15T22:09:17.400288+0000","last_became_peered":"2024-09-15T22:09:17.400288+0000","last_unstale":"2024-09-15T22:09:22.432332+0000","last_undegraded":"2024-09-15T22:09:22.432332+0000","last_fullsized":"2024-09-15T22:09:22.432332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433969+0000","last_change":"2024-09-15T22:09:17.404318+0000","last_active":"2024-09-15T22:09:22.433969+0000","last_peered":"2024-09-15T22:09:22.433969+0000","last_clean":"2024-09-15T22:09:22.433969+0000","last_became_active":"2024-09-15T22:09:17.404038+0000","last_became_peered":"2024-09-15T22:09:17.404038+0000","last_unstale":"2024-09-15T22:09:22.433969+0000","last_undegraded":"2024-09-15T22:09:22.433969+0000","last_fullsized":"2024-09-15T22:09:22.433969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:04.314746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856907+0000","last_change":"2024-09-15T22:09:17.415645+0000","last_active":"2024-09-15T22:09:22.856907+0000","last_peered":"2024-09-15T22:09:22.856907+0000","last_clean":"2024-09-15T22:09:22.856907+0000","last_became_active":"2024-09-15T22:09:17.415354+0000","last_became_peered":"2024-09-15T22:09:17.415354+0000","last_unstale":"2024-09-15T22:09:22.856907+0000","last_undegraded":"2024-09-15T22:09:22.856907+0000","last_fullsized":"2024-09-15T22:09:22.856907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857144+0000","last_change":"2024-09-15T22:09:17.415171+0000","last_active":"2024-09-15T22:09:22.857144+0000","last_peered":"2024-09-15T22:09:22.857144+0000","last_clean":"2024-09-15T22:09:22.857144+0000","last_became_active":"2024-09-15T22:09:17.414875+0000","last_became_peered":"2024-09-15T22:09:17.414875+0000","last_unstale":"2024-09-15T22:09:22.857144+0000","last_undegraded":"2024-09-15T22:09:22.857144+0000","last_fullsized":"2024-09-15T22:09:22.857144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434378+0000","last_change":"2024-09-15T22:09:17.420121+0000","last_active":"2024-09-15T22:09:22.434378+0000","last_peered":"2024-09-15T22:09:22.434378+0000","last_clean":"2024-09-15T22:09:22.434378+0000","last_became_active":"2024-09-15T22:09:17.419854+0000","last_became_peered":"2024-09-15T22:09:17.419854+0000","last_unstale":"2024-09-15T22:09:22.434378+0000","last_undegraded":"2024-09-15T22:09:22.434378+0000","last_fullsized":"2024-09-15T22:09:22.434378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:41.421190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.431873+0000","last_change":"2024-09-15T22:09:17.414316+0000","last_active":"2024-09-15T22:09:22.431873+0000","last_peered":"2024-09-15T22:09:22.431873+0000","last_clean":"2024-09-15T22:09:22.431873+0000","last_became_active":"2024-09-15T22:09:17.414020+0000","last_became_peered":"2024-09-15T22:09:17.414020+0000","last_unstale":"2024-09-15T22:09:22.431873+0000","last_undegraded":"2024-09-15T22:09:22.431873+0000","last_fullsized":"2024-09-15T22:09:22.431873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432910+0000","last_change":"2024-09-15T22:09:17.404509+0000","last_active":"2024-09-15T22:09:22.432910+0000","last_peered":"2024-09-15T22:09:22.432910+0000","last_clean":"2024-09-15T22:09:22.432910+0000","last_became_active":"2024-09-15T22:09:17.404181+0000","last_became_peered":"2024-09-15T22:09:17.404181+0000","last_unstale":"2024-09-15T22:09:22.432910+0000","last_undegraded":"2024-09-15T22:09:22.432910+0000","last_fullsized":"2024-09-15T22:09:22.432910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:22.003479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446713+0000","last_change":"2024-09-15T22:09:17.414252+0000","last_active":"2024-09-15T22:09:22.446713+0000","last_peered":"2024-09-15T22:09:22.446713+0000","last_clean":"2024-09-15T22:09:22.446713+0000","last_became_active":"2024-09-15T22:09:17.413987+0000","last_became_peered":"2024-09-15T22:09:17.413987+0000","last_unstale":"2024-09-15T22:09:22.446713+0000","last_undegraded":"2024-09-15T22:09:22.446713+0000","last_fullsized":"2024-09-15T22:09:22.446713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433226+0000","last_change":"2024-09-15T22:09:17.399744+0000","last_active":"2024-09-15T22:09:22.433226+0000","last_peered":"2024-09-15T22:09:22.433226+0000","last_clean":"2024-09-15T22:09:22.433226+0000","last_became_active":"2024-09-15T22:09:17.399470+0000","last_became_peered":"2024-09-15T22:09:17.399470+0000","last_unstale":"2024-09-15T22:09:22.433226+0000","last_undegraded":"2024-09-15T22:09:22.433226+0000","last_fullsized":"2024-09-15T22:09:22.433226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:04.868244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446913+0000","last_change":"2024-09-15T22:09:17.416763+0000","last_active":"2024-09-15T22:09:22.446913+0000","last_peered":"2024-09-15T22:09:22.446913+0000","last_clean":"2024-09-15T22:09:22.446913+0000","last_became_active":"2024-09-15T22:09:17.415987+0000","last_became_peered":"2024-09-15T22:09:17.415987+0000","last_unstale":"2024-09-15T22:09:22.446913+0000","last_undegraded":"2024-09-15T22:09:22.446913+0000","last_fullsized":"2024-09-15T22:09:22.446913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:04.868244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856619+0000","last_change":"2024-09-15T22:09:17.404558+0000","last_active":"2024-09-15T22:09:22.856619+0000","last_peered":"2024-09-15T22:09:22.856619+0000","last_clean":"2024-09-15T22:09:22.856619+0000","last_became_active":"2024-09-15T22:09:17.404301+0000","last_became_peered":"2024-09-15T22:09:17.404301+0000","last_unstale":"2024-09-15T22:09:22.856619+0000","last_undegraded":"2024-09-15T22:09:22.856619+0000","last_fullsized":"2024-09-15T22:09:22.856619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856943+0000","last_change":"2024-09-15T22:09:17.402881+0000","last_active":"2024-09-15T22:09:22.856943+0000","last_peered":"2024-09-15T22:09:22.856943+0000","last_clean":"2024-09-15T22:09:22.856943+0000","last_became_active":"2024-09-15T22:09:17.402632+0000","last_became_peered":"2024-09-15T22:09:17.402632+0000","last_unstale":"2024-09-15T22:09:22.856943+0000","last_undegraded":"2024-09-15T22:09:22.856943+0000","last_fullsized":"2024-09-15T22:09:22.856943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:30.142651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434291+0000","last_change":"2024-09-15T22:09:17.403017+0000","last_active":"2024-09-15T22:09:22.434291+0000","last_peered":"2024-09-15T22:09:22.434291+0000","last_clean":"2024-09-15T22:09:22.434291+0000","last_became_active":"2024-09-15T22:09:17.402751+0000","last_became_peered":"2024-09-15T22:09:17.402751+0000","last_unstale":"2024-09-15T22:09:22.434291+0000","last_undegraded":"2024-09-15T22:09:22.434291+0000","last_fullsized":"2024-09-15T22:09:22.434291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:26.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":331776,"data_stored":694125,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":103265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":103301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":339968,"data_stored":694181,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":103335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:09:41.726 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:09:41.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.857+0000 7ff3148b7640 1 Processor -- start 2024-09-15T22:09:41.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.857+0000 7ff3148b7640 1 -- start start 2024-09-15T22:09:41.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.858+0000 7ff3148b7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff3100b2270 0x7ff310143f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.858+0000 7ff3148b7640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3100b3460 con 0x7ff3100b3b60 2024-09-15T22:09:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.858+0000 7ff3148b7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff31006d270 con 0x7ff31006ce90 2024-09-15T22:09:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.858+0000 7ff3148b7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff310144490 con 0x7ff3100b2270 2024-09-15T22:09:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.858+0000 7ff30dd9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff3100b3b60 0x7ff31014c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54790/0 (socket says 172.21.15.78:54790) 2024-09-15T22:09:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.858+0000 7ff30dd9b640 1 -- 172.21.15.78:0/9210901 learned_addr learned my addr 172.21.15.78:0/9210901 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.858+0000 7ff30ed9d640 1 --2- 172.21.15.78:0/9210901 >> v2:172.21.15.175:3300/0 conn(0x7ff3100b2270 0x7ff310143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.858+0000 7ff30d59a640 1 -- 172.21.15.78:0/9210901 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755294195 0 0) 0x7ff3100b3460 con 0x7ff3100b3b60 2024-09-15T22:09:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.858+0000 7ff30d59a640 1 -- 172.21.15.78:0/9210901 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2f8003520 con 0x7ff3100b3b60 2024-09-15T22:09:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.858+0000 7ff30d59a640 1 -- 172.21.15.78:0/9210901 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4079362607 0 0) 0x7ff2f8003520 con 0x7ff3100b3b60 2024-09-15T22:09:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.858+0000 7ff30d59a640 1 -- 172.21.15.78:0/9210901 >> v2:172.21.15.175:3300/0 conn(0x7ff3100b2270 msgr2=0x7ff310143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.858+0000 7ff30d59a640 1 --2- 172.21.15.78:0/9210901 >> v2:172.21.15.175:3300/0 conn(0x7ff3100b2270 0x7ff310143f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.858+0000 7ff30d59a640 1 -- 172.21.15.78:0/9210901 >> v1:172.21.15.175:6789/0 conn(0x7ff31006ce90 legacy=0x7ff310072d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.858+0000 7ff30d59a640 1 -- 172.21.15.78:0/9210901 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3100b1760 con 0x7ff3100b3b60 2024-09-15T22:09:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.858+0000 7ff30d59a640 1 -- 172.21.15.78:0/9210901 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3961011974 0 0) 0x7ff3040017f0 con 0x7ff3100b3b60 2024-09-15T22:09:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.859+0000 7ff30d59a640 1 -- 172.21.15.78:0/9210901 >> v1:172.21.15.78:6789/0 conn(0x7ff3100b3b60 legacy=0x7ff31014c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.859+0000 7ff30d59a640 1 --2- 172.21.15.78:0/9210901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2f80039b0 0x7ff2f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.859+0000 7ff30d59a640 1 --2- 172.21.15.78:0/9210901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2f8004800 0x7ff2f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.859+0000 7ff30d59a640 1 --2- 172.21.15.78:0/9210901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f80051c0 0x7ff2f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.859+0000 7ff30d59a640 1 -- 172.21.15.78:0/9210901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f800c130 con 0x7ff2f80051c0 2024-09-15T22:09:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.859+0000 7ff30d59a640 1 -- 172.21.15.78:0/9210901 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f800c2e0 con 0x7ff2f80039b0 2024-09-15T22:09:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.859+0000 7ff30d59a640 1 -- 172.21.15.78:0/9210901 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f800c4e0 con 0x7ff2f8004800 2024-09-15T22:09:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.859+0000 7ff30ed9d640 1 --2- 172.21.15.78:0/9210901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f80051c0 0x7ff2f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.859+0000 7ff30dd9b640 1 --2- 172.21.15.78:0/9210901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2f8004800 0x7ff2f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.859+0000 7ff30e59c640 1 --2- 172.21.15.78:0/9210901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2f80039b0 0x7ff2f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.859+0000 7ff30ed9d640 1 -- 172.21.15.78:0/9210901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2f8004800 msgr2=0x7ff2f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.859+0000 7ff30ed9d640 1 --2- 172.21.15.78:0/9210901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2f8004800 0x7ff2f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.859+0000 7ff30ed9d640 1 -- 172.21.15.78:0/9210901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2f80039b0 msgr2=0x7ff2f8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.859+0000 7ff30ed9d640 1 --2- 172.21.15.78:0/9210901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2f80039b0 0x7ff2f8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.859+0000 7ff30ed9d640 1 -- 172.21.15.78:0/9210901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f8003520 con 0x7ff2f80051c0 2024-09-15T22:09:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.860+0000 7ff30ed9d640 1 -- 172.21.15.78:0/9210901 reap_dead start 2024-09-15T22:09:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.860+0000 7ff30ed9d640 1 --2- 172.21.15.78:0/9210901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f80051c0 0x7ff2f800b9c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff30800a250 tx=0x7ff2f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77fc82cae62518c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.860+0000 7ff30d59a640 1 -- 172.21.15.78:0/9210901 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30800adf0 con 0x7ff2f80051c0 2024-09-15T22:09:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.860+0000 7ff30d59a640 1 -- 172.21.15.78:0/9210901 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff308003990 con 0x7ff2f80051c0 2024-09-15T22:09:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.860+0000 7ff30d59a640 1 -- 172.21.15.78:0/9210901 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff308003da0 con 0x7ff2f80051c0 2024-09-15T22:09:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.860+0000 7ff3148b7640 1 -- 172.21.15.78:0/9210901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f80051c0 msgr2=0x7ff2f800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.860+0000 7ff3148b7640 1 --2- 172.21.15.78:0/9210901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f80051c0 0x7ff2f800b9c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff30800a250 tx=0x7ff2f8005830 comp rx=0 tx=0).stop 2024-09-15T22:09:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.860+0000 7ff3148b7640 1 -- 172.21.15.78:0/9210901 shutdown_connections 2024-09-15T22:09:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.860+0000 7ff3148b7640 1 --2- 172.21.15.78:0/9210901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f80051c0 0x7ff2f800b9c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.860+0000 7ff3148b7640 1 -- 172.21.15.78:0/9210901 >> 172.21.15.78:0/9210901 conn(0x7ff3100b6470 msgr2=0x7ff3100b6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.860+0000 7ff3148b7640 1 -- 172.21.15.78:0/9210901 shutdown_connections 2024-09-15T22:09:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.860+0000 7ff3148b7640 1 -- 172.21.15.78:0/9210901 wait complete. 2024-09-15T22:09:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.862+0000 7ff3148b7640 1 Processor -- start 2024-09-15T22:09:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.862+0000 7ff3148b7640 1 -- start start 2024-09-15T22:09:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.862+0000 7ff3148b7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f80051c0 0x7ff310140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.862+0000 7ff3148b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff310145790 0x7ff310071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.862+0000 7ff3148b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff310071760 0x7ff3101dbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.862+0000 7ff3148b7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff3100b6130 con 0x7ff2f80051c0 2024-09-15T22:09:41.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.862+0000 7ff3148b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff3100b1d50 con 0x7ff310145790 2024-09-15T22:09:41.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.862+0000 7ff3148b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff3100b1330 con 0x7ff310071760 2024-09-15T22:09:41.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.862+0000 7ff30e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f80051c0 0x7ff310140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.862+0000 7ff30e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f80051c0 0x7ff310140770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37268/0 (socket says 172.21.15.78:37268) 2024-09-15T22:09:41.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.862+0000 7ff30e59c640 1 -- 172.21.15.78:0/658420441 learned_addr learned my addr 172.21.15.78:0/658420441 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:41.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.862+0000 7ff30dd9b640 1 --2- 172.21.15.78:0/658420441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff310145790 0x7ff310071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.862+0000 7ff30ed9d640 1 --2- 172.21.15.78:0/658420441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff310071760 0x7ff3101dbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.863+0000 7ff30e59c640 1 -- 172.21.15.78:0/658420441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff310071760 msgr2=0x7ff3101dbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.863+0000 7ff30e59c640 1 --2- 172.21.15.78:0/658420441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff310071760 0x7ff3101dbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.863+0000 7ff30e59c640 1 -- 172.21.15.78:0/658420441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff310145790 msgr2=0x7ff310071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:41.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.863+0000 7ff30e59c640 1 --2- 172.21.15.78:0/658420441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff310145790 0x7ff310071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:41.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.863+0000 7ff30e59c640 1 -- 172.21.15.78:0/658420441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff310145c10 con 0x7ff2f80051c0 2024-09-15T22:09:41.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.863+0000 7ff30e59c640 1 --2- 172.21.15.78:0/658420441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f80051c0 0x7ff310140770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff30000f5f0 tx=0x7ff30000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:41.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.863+0000 7ff2feffd640 1 -- 172.21.15.78:0/658420441 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3000052e0 con 0x7ff2f80051c0 2024-09-15T22:09:41.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.863+0000 7ff2feffd640 1 -- 172.21.15.78:0/658420441 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff300018070 con 0x7ff2f80051c0 2024-09-15T22:09:41.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.863+0000 7ff3148b7640 1 -- 172.21.15.78:0/658420441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff310071be0 con 0x7ff2f80051c0 2024-09-15T22:09:41.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.863+0000 7ff2feffd640 1 -- 172.21.15.78:0/658420441 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff300003810 con 0x7ff2f80051c0 2024-09-15T22:09:41.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.863+0000 7ff3148b7640 1 -- 172.21.15.78:0/658420441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3101413b0 con 0x7ff2f80051c0 2024-09-15T22:09:41.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.864+0000 7ff3148b7640 1 -- 172.21.15.78:0/658420441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff310143f50 con 0x7ff2f80051c0 2024-09-15T22:09:41.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.865+0000 7ff2feffd640 1 -- 172.21.15.78:0/658420441 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff3000039b0 con 0x7ff2f80051c0 2024-09-15T22:09:41.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.865+0000 7ff2feffd640 1 --2- 172.21.15.78:0/658420441 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7ff2f006c2e0 0x7ff2f006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:41.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.865+0000 7ff2feffd640 1 -- 172.21.15.78:0/658420441 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff30008b3e0 con 0x7ff2f80051c0 2024-09-15T22:09:41.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.865+0000 7ff30dd9b640 1 --2- 172.21.15.78:0/658420441 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7ff2f006c2e0 0x7ff2f006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:41.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.865+0000 7ff30dd9b640 1 --2- 172.21.15.78:0/658420441 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7ff2f006c2e0 0x7ff2f006e7a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff310141740 tx=0x7ff304009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:41.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:41.869+0000 7ff2feffd640 1 -- 172.21.15.78:0/658420441 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff310071be0 con 0x7ff2f80051c0 2024-09-15T22:09:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.032+0000 7ff3148b7640 1 -- 172.21.15.78:0/658420441 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff3100691d0 con 0x7ff2f006c2e0 2024-09-15T22:09:42.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.039+0000 7ff2feffd640 1 -- 172.21.15.78:0/658420441 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332611 (secure 0 0 0) 0x7ff3100691d0 con 0x7ff2f006c2e0 2024-09-15T22:09:42.047 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:42.049 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-15T22:09:42.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.043+0000 7ff3148b7640 1 -- 172.21.15.78:0/658420441 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7ff2f006c2e0 msgr2=0x7ff2f006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.043+0000 7ff3148b7640 1 --2- 172.21.15.78:0/658420441 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7ff2f006c2e0 0x7ff2f006e7a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff310141740 tx=0x7ff304009040 comp rx=0 tx=0).stop 2024-09-15T22:09:42.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.043+0000 7ff3148b7640 1 -- 172.21.15.78:0/658420441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f80051c0 msgr2=0x7ff310140770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.043+0000 7ff3148b7640 1 --2- 172.21.15.78:0/658420441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f80051c0 0x7ff310140770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff30000f5f0 tx=0x7ff30000fab0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.043+0000 7ff3148b7640 1 -- 172.21.15.78:0/658420441 shutdown_connections 2024-09-15T22:09:42.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.043+0000 7ff3148b7640 1 --2- 172.21.15.78:0/658420441 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7ff2f006c2e0 0x7ff2f006e7a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.043+0000 7ff3148b7640 1 --2- 172.21.15.78:0/658420441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff310071760 0x7ff3101dbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.043+0000 7ff3148b7640 1 --2- 172.21.15.78:0/658420441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff310145790 0x7ff310071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.043+0000 7ff3148b7640 1 --2- 172.21.15.78:0/658420441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f80051c0 0x7ff310140770 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.043+0000 7ff3148b7640 1 -- 172.21.15.78:0/658420441 >> 172.21.15.78:0/658420441 conn(0x7ff3100b6470 msgr2=0x7ff310141ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:42.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.043+0000 7ff3148b7640 1 -- 172.21.15.78:0/658420441 shutdown_connections 2024-09-15T22:09:42.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.043+0000 7ff3148b7640 1 -- 172.21.15.78:0/658420441 wait complete. 2024-09-15T22:09:42.055 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-15T22:09:41.975976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218476,"kb_used_data":2240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756244,"statfs":{"total":773094113280,"available":772870393856,"internally_reserved":0,"allocated":2293760,"data_stored":2015420,"data_compressed":65044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003005"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857105+0000","last_change":"2024-09-15T22:09:16.403008+0000","last_active":"2024-09-15T22:09:22.857105+0000","last_peered":"2024-09-15T22:09:22.857105+0000","last_clean":"2024-09-15T22:09:22.857105+0000","last_became_active":"2024-09-15T22:09:16.402725+0000","last_became_peered":"2024-09-15T22:09:16.402725+0000","last_unstale":"2024-09-15T22:09:22.857105+0000","last_undegraded":"2024-09-15T22:09:22.857105+0000","last_fullsized":"2024-09-15T22:09:22.857105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:32.659951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432405+0000","last_change":"2024-09-15T22:09:17.400698+0000","last_active":"2024-09-15T22:09:22.432405+0000","last_peered":"2024-09-15T22:09:22.432405+0000","last_clean":"2024-09-15T22:09:22.432405+0000","last_became_active":"2024-09-15T22:09:17.400428+0000","last_became_peered":"2024-09-15T22:09:17.400428+0000","last_unstale":"2024-09-15T22:09:22.432405+0000","last_undegraded":"2024-09-15T22:09:22.432405+0000","last_fullsized":"2024-09-15T22:09:22.432405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:15.431072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432024+0000","last_change":"2024-09-15T22:09:21.449737+0000","last_active":"2024-09-15T22:09:22.432024+0000","last_peered":"2024-09-15T22:09:22.432024+0000","last_clean":"2024-09-15T22:09:22.432024+0000","last_became_active":"2024-09-15T22:09:21.449376+0000","last_became_peered":"2024-09-15T22:09:21.449376+0000","last_unstale":"2024-09-15T22:09:22.432024+0000","last_undegraded":"2024-09-15T22:09:22.432024+0000","last_fullsized":"2024-09-15T22:09:22.432024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:13.943283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432590+0000","last_change":"2024-09-15T22:09:16.407728+0000","last_active":"2024-09-15T22:09:22.432590+0000","last_peered":"2024-09-15T22:09:22.432590+0000","last_clean":"2024-09-15T22:09:22.432590+0000","last_became_active":"2024-09-15T22:09:16.407458+0000","last_became_peered":"2024-09-15T22:09:16.407458+0000","last_unstale":"2024-09-15T22:09:22.432590+0000","last_undegraded":"2024-09-15T22:09:22.432590+0000","last_fullsized":"2024-09-15T22:09:22.432590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856796+0000","last_change":"2024-09-15T22:09:17.415311+0000","last_active":"2024-09-15T22:09:22.856796+0000","last_peered":"2024-09-15T22:09:22.856796+0000","last_clean":"2024-09-15T22:09:22.856796+0000","last_became_active":"2024-09-15T22:09:17.414966+0000","last_became_peered":"2024-09-15T22:09:17.414966+0000","last_unstale":"2024-09-15T22:09:22.856796+0000","last_undegraded":"2024-09-15T22:09:22.856796+0000","last_fullsized":"2024-09-15T22:09:22.856796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432860+0000","last_change":"2024-09-15T22:09:21.454087+0000","last_active":"2024-09-15T22:09:22.432860+0000","last_peered":"2024-09-15T22:09:22.432860+0000","last_clean":"2024-09-15T22:09:22.432860+0000","last_became_active":"2024-09-15T22:09:21.453701+0000","last_became_peered":"2024-09-15T22:09:21.453701+0000","last_unstale":"2024-09-15T22:09:22.432860+0000","last_undegraded":"2024-09-15T22:09:22.432860+0000","last_fullsized":"2024-09-15T22:09:22.432860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:29.697947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433861+0000","last_change":"2024-09-15T22:09:16.405902+0000","last_active":"2024-09-15T22:09:22.433861+0000","last_peered":"2024-09-15T22:09:22.433861+0000","last_clean":"2024-09-15T22:09:22.433861+0000","last_became_active":"2024-09-15T22:09:16.405626+0000","last_became_peered":"2024-09-15T22:09:16.405626+0000","last_unstale":"2024-09-15T22:09:22.433861+0000","last_undegraded":"2024-09-15T22:09:22.433861+0000","last_fullsized":"2024-09-15T22:09:22.433861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:03.001838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446948+0000","last_change":"2024-09-15T22:09:17.416894+0000","last_active":"2024-09-15T22:09:22.446948+0000","last_peered":"2024-09-15T22:09:22.446948+0000","last_clean":"2024-09-15T22:09:22.446948+0000","last_became_active":"2024-09-15T22:09:17.416367+0000","last_became_peered":"2024-09-15T22:09:17.416367+0000","last_unstale":"2024-09-15T22:09:22.446948+0000","last_undegraded":"2024-09-15T22:09:22.446948+0000","last_fullsized":"2024-09-15T22:09:22.446948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:15.431072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434492+0000","last_change":"2024-09-15T22:09:21.455260+0000","last_active":"2024-09-15T22:09:22.434492+0000","last_peered":"2024-09-15T22:09:22.434492+0000","last_clean":"2024-09-15T22:09:22.434492+0000","last_became_active":"2024-09-15T22:09:21.454850+0000","last_became_peered":"2024-09-15T22:09:21.454850+0000","last_unstale":"2024-09-15T22:09:22.434492+0000","last_undegraded":"2024-09-15T22:09:22.434492+0000","last_fullsized":"2024-09-15T22:09:22.434492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:08.904123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434195+0000","last_change":"2024-09-15T22:09:16.407670+0000","last_active":"2024-09-15T22:09:22.434195+0000","last_peered":"2024-09-15T22:09:22.434195+0000","last_clean":"2024-09-15T22:09:22.434195+0000","last_became_active":"2024-09-15T22:09:16.407364+0000","last_became_peered":"2024-09-15T22:09:16.407364+0000","last_unstale":"2024-09-15T22:09:22.434195+0000","last_undegraded":"2024-09-15T22:09:22.434195+0000","last_fullsized":"2024-09-15T22:09:22.434195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:01.284777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447188+0000","last_change":"2024-09-15T22:09:17.408224+0000","last_active":"2024-09-15T22:09:22.447188+0000","last_peered":"2024-09-15T22:09:22.447188+0000","last_clean":"2024-09-15T22:09:22.447188+0000","last_became_active":"2024-09-15T22:09:17.407881+0000","last_became_peered":"2024-09-15T22:09:17.407881+0000","last_unstale":"2024-09-15T22:09:22.447188+0000","last_undegraded":"2024-09-15T22:09:22.447188+0000","last_fullsized":"2024-09-15T22:09:22.447188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:22.003479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432971+0000","last_change":"2024-09-15T22:09:21.450705+0000","last_active":"2024-09-15T22:09:22.432971+0000","last_peered":"2024-09-15T22:09:22.432971+0000","last_clean":"2024-09-15T22:09:22.432971+0000","last_became_active":"2024-09-15T22:09:21.450265+0000","last_became_peered":"2024-09-15T22:09:21.450265+0000","last_unstale":"2024-09-15T22:09:22.432971+0000","last_undegraded":"2024-09-15T22:09:22.432971+0000","last_fullsized":"2024-09-15T22:09:22.432971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:21.477522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856481+0000","last_change":"2024-09-15T22:09:17.410686+0000","last_active":"2024-09-15T22:09:22.856481+0000","last_peered":"2024-09-15T22:09:22.856481+0000","last_clean":"2024-09-15T22:09:22.856481+0000","last_became_active":"2024-09-15T22:09:17.410383+0000","last_became_peered":"2024-09-15T22:09:17.410383+0000","last_unstale":"2024-09-15T22:09:22.856481+0000","last_undegraded":"2024-09-15T22:09:22.856481+0000","last_fullsized":"2024-09-15T22:09:22.856481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433896+0000","last_change":"2024-09-15T22:09:16.405335+0000","last_active":"2024-09-15T22:09:22.433896+0000","last_peered":"2024-09-15T22:09:22.433896+0000","last_clean":"2024-09-15T22:09:22.433896+0000","last_became_active":"2024-09-15T22:09:16.405010+0000","last_became_peered":"2024-09-15T22:09:16.405010+0000","last_unstale":"2024-09-15T22:09:22.433896+0000","last_undegraded":"2024-09-15T22:09:22.433896+0000","last_fullsized":"2024-09-15T22:09:22.433896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:00.202736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433953+0000","last_change":"2024-09-15T22:09:21.453670+0000","last_active":"2024-09-15T22:09:22.433953+0000","last_peered":"2024-09-15T22:09:22.433953+0000","last_clean":"2024-09-15T22:09:22.433953+0000","last_became_active":"2024-09-15T22:09:21.453219+0000","last_became_peered":"2024-09-15T22:09:21.453219+0000","last_unstale":"2024-09-15T22:09:22.433953+0000","last_undegraded":"2024-09-15T22:09:22.433953+0000","last_fullsized":"2024-09-15T22:09:22.433953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:28.271273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432427+0000","last_change":"2024-09-15T22:09:17.405327+0000","last_active":"2024-09-15T22:09:22.432427+0000","last_peered":"2024-09-15T22:09:22.432427+0000","last_clean":"2024-09-15T22:09:22.432427+0000","last_became_active":"2024-09-15T22:09:17.405065+0000","last_became_peered":"2024-09-15T22:09:17.405065+0000","last_unstale":"2024-09-15T22:09:22.432427+0000","last_undegraded":"2024-09-15T22:09:22.432427+0000","last_fullsized":"2024-09-15T22:09:22.432427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857701+0000","last_change":"2024-09-15T22:09:16.406705+0000","last_active":"2024-09-15T22:09:22.857701+0000","last_peered":"2024-09-15T22:09:22.857701+0000","last_clean":"2024-09-15T22:09:22.857701+0000","last_became_active":"2024-09-15T22:09:16.406454+0000","last_became_peered":"2024-09-15T22:09:16.406454+0000","last_unstale":"2024-09-15T22:09:22.857701+0000","last_undegraded":"2024-09-15T22:09:22.857701+0000","last_fullsized":"2024-09-15T22:09:22.857701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:02.444245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433842+0000","last_change":"2024-09-15T22:09:21.456243+0000","last_active":"2024-09-15T22:09:22.433842+0000","last_peered":"2024-09-15T22:09:22.433842+0000","last_clean":"2024-09-15T22:09:22.433842+0000","last_became_active":"2024-09-15T22:09:21.455819+0000","last_became_peered":"2024-09-15T22:09:21.455819+0000","last_unstale":"2024-09-15T22:09:22.433842+0000","last_undegraded":"2024-09-15T22:09:22.433842+0000","last_fullsized":"2024-09-15T22:09:22.433842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:02.526090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432175+0000","last_change":"2024-09-15T22:09:17.399551+0000","last_active":"2024-09-15T22:09:22.432175+0000","last_peered":"2024-09-15T22:09:22.432175+0000","last_clean":"2024-09-15T22:09:22.432175+0000","last_became_active":"2024-09-15T22:09:17.399290+0000","last_became_peered":"2024-09-15T22:09:17.399290+0000","last_unstale":"2024-09-15T22:09:22.432175+0000","last_undegraded":"2024-09-15T22:09:22.432175+0000","last_fullsized":"2024-09-15T22:09:22.432175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857365+0000","last_change":"2024-09-15T22:09:16.408974+0000","last_active":"2024-09-15T22:09:22.857365+0000","last_peered":"2024-09-15T22:09:22.857365+0000","last_clean":"2024-09-15T22:09:22.857365+0000","last_became_active":"2024-09-15T22:09:16.408691+0000","last_became_peered":"2024-09-15T22:09:16.408691+0000","last_unstale":"2024-09-15T22:09:22.857365+0000","last_undegraded":"2024-09-15T22:09:22.857365+0000","last_fullsized":"2024-09-15T22:09:22.857365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:26:32.412274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857068+0000","last_change":"2024-09-15T22:09:21.458893+0000","last_active":"2024-09-15T22:09:22.857068+0000","last_peered":"2024-09-15T22:09:22.857068+0000","last_clean":"2024-09-15T22:09:22.857068+0000","last_became_active":"2024-09-15T22:09:21.458548+0000","last_became_peered":"2024-09-15T22:09:21.458548+0000","last_unstale":"2024-09-15T22:09:22.857068+0000","last_undegraded":"2024-09-15T22:09:22.857068+0000","last_fullsized":"2024-09-15T22:09:22.857068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:29.163692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434430+0000","last_change":"2024-09-15T22:09:17.400823+0000","last_active":"2024-09-15T22:09:22.434430+0000","last_peered":"2024-09-15T22:09:22.434430+0000","last_clean":"2024-09-15T22:09:22.434430+0000","last_became_active":"2024-09-15T22:09:17.400494+0000","last_became_peered":"2024-09-15T22:09:17.400494+0000","last_unstale":"2024-09-15T22:09:22.434430+0000","last_undegraded":"2024-09-15T22:09:22.434430+0000","last_fullsized":"2024-09-15T22:09:22.434430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:02.290840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432593+0000","last_change":"2024-09-15T22:09:16.409156+0000","last_active":"2024-09-15T22:09:22.432593+0000","last_peered":"2024-09-15T22:09:22.432593+0000","last_clean":"2024-09-15T22:09:22.432593+0000","last_became_active":"2024-09-15T22:09:16.408603+0000","last_became_peered":"2024-09-15T22:09:16.408603+0000","last_unstale":"2024-09-15T22:09:22.432593+0000","last_undegraded":"2024-09-15T22:09:22.432593+0000","last_fullsized":"2024-09-15T22:09:22.432593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:12.245902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433463+0000","last_change":"2024-09-15T22:09:21.447940+0000","last_active":"2024-09-15T22:09:22.433463+0000","last_peered":"2024-09-15T22:09:22.433463+0000","last_clean":"2024-09-15T22:09:22.433463+0000","last_became_active":"2024-09-15T22:09:21.447348+0000","last_became_peered":"2024-09-15T22:09:21.447348+0000","last_unstale":"2024-09-15T22:09:22.433463+0000","last_undegraded":"2024-09-15T22:09:22.433463+0000","last_fullsized":"2024-09-15T22:09:22.433463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:19.466950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.858001+0000","last_change":"2024-09-15T22:09:17.402826+0000","last_active":"2024-09-15T22:09:22.858001+0000","last_peered":"2024-09-15T22:09:22.858001+0000","last_clean":"2024-09-15T22:09:22.858001+0000","last_became_active":"2024-09-15T22:09:17.402585+0000","last_became_peered":"2024-09-15T22:09:17.402585+0000","last_unstale":"2024-09-15T22:09:22.858001+0000","last_undegraded":"2024-09-15T22:09:22.858001+0000","last_fullsized":"2024-09-15T22:09:22.858001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857204+0000","last_change":"2024-09-15T22:09:16.408097+0000","last_active":"2024-09-15T22:09:22.857204+0000","last_peered":"2024-09-15T22:09:22.857204+0000","last_clean":"2024-09-15T22:09:22.857204+0000","last_became_active":"2024-09-15T22:09:16.407657+0000","last_became_peered":"2024-09-15T22:09:16.407657+0000","last_unstale":"2024-09-15T22:09:22.857204+0000","last_undegraded":"2024-09-15T22:09:22.857204+0000","last_fullsized":"2024-09-15T22:09:22.857204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433301+0000","last_change":"2024-09-15T22:09:21.451205+0000","last_active":"2024-09-15T22:09:22.433301+0000","last_peered":"2024-09-15T22:09:22.433301+0000","last_clean":"2024-09-15T22:09:22.433301+0000","last_became_active":"2024-09-15T22:09:21.450731+0000","last_became_peered":"2024-09-15T22:09:21.450731+0000","last_unstale":"2024-09-15T22:09:22.433301+0000","last_undegraded":"2024-09-15T22:09:22.433301+0000","last_fullsized":"2024-09-15T22:09:22.433301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:38.650786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432489+0000","last_change":"2024-09-15T22:09:17.421690+0000","last_active":"2024-09-15T22:09:22.432489+0000","last_peered":"2024-09-15T22:09:22.432489+0000","last_clean":"2024-09-15T22:09:22.432489+0000","last_became_active":"2024-09-15T22:09:17.421379+0000","last_became_peered":"2024-09-15T22:09:17.421379+0000","last_unstale":"2024-09-15T22:09:22.432489+0000","last_undegraded":"2024-09-15T22:09:22.432489+0000","last_fullsized":"2024-09-15T22:09:22.432489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857039+0000","last_change":"2024-09-15T22:09:16.408662+0000","last_active":"2024-09-15T22:09:22.857039+0000","last_peered":"2024-09-15T22:09:22.857039+0000","last_clean":"2024-09-15T22:09:22.857039+0000","last_became_active":"2024-09-15T22:09:16.408068+0000","last_became_peered":"2024-09-15T22:09:16.408068+0000","last_unstale":"2024-09-15T22:09:22.857039+0000","last_undegraded":"2024-09-15T22:09:22.857039+0000","last_fullsized":"2024-09-15T22:09:22.857039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:29.217773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.431852+0000","last_change":"2024-09-15T22:09:21.457447+0000","last_active":"2024-09-15T22:09:22.431852+0000","last_peered":"2024-09-15T22:09:22.431852+0000","last_clean":"2024-09-15T22:09:22.431852+0000","last_became_active":"2024-09-15T22:09:21.457031+0000","last_became_peered":"2024-09-15T22:09:21.457031+0000","last_unstale":"2024-09-15T22:09:22.431852+0000","last_undegraded":"2024-09-15T22:09:22.431852+0000","last_fullsized":"2024-09-15T22:09:22.431852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:45.457068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856945+0000","last_change":"2024-09-15T22:09:17.400043+0000","last_active":"2024-09-15T22:09:22.856945+0000","last_peered":"2024-09-15T22:09:22.856945+0000","last_clean":"2024-09-15T22:09:22.856945+0000","last_became_active":"2024-09-15T22:09:17.399815+0000","last_became_peered":"2024-09-15T22:09:17.399815+0000","last_unstale":"2024-09-15T22:09:22.856945+0000","last_undegraded":"2024-09-15T22:09:22.856945+0000","last_fullsized":"2024-09-15T22:09:22.856945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:38.779044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434071+0000","last_change":"2024-09-15T22:09:16.407483+0000","last_active":"2024-09-15T22:09:22.434071+0000","last_peered":"2024-09-15T22:09:22.434071+0000","last_clean":"2024-09-15T22:09:22.434071+0000","last_became_active":"2024-09-15T22:09:16.407199+0000","last_became_peered":"2024-09-15T22:09:16.407199+0000","last_unstale":"2024-09-15T22:09:22.434071+0000","last_undegraded":"2024-09-15T22:09:22.434071+0000","last_fullsized":"2024-09-15T22:09:22.434071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:24.102281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857257+0000","last_change":"2024-09-15T22:09:21.449620+0000","last_active":"2024-09-15T22:09:22.857257+0000","last_peered":"2024-09-15T22:09:22.857257+0000","last_clean":"2024-09-15T22:09:22.857257+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:09:22.857257+0000","last_undegraded":"2024-09-15T22:09:22.857257+0000","last_fullsized":"2024-09-15T22:09:22.857257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:40.690811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447282+0000","last_change":"2024-09-15T22:09:17.414930+0000","last_active":"2024-09-15T22:09:22.447282+0000","last_peered":"2024-09-15T22:09:22.447282+0000","last_clean":"2024-09-15T22:09:22.447282+0000","last_became_active":"2024-09-15T22:09:17.414645+0000","last_became_peered":"2024-09-15T22:09:17.414645+0000","last_unstale":"2024-09-15T22:09:22.447282+0000","last_undegraded":"2024-09-15T22:09:22.447282+0000","last_fullsized":"2024-09-15T22:09:22.447282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:22.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857058+0000","last_change":"2024-09-15T22:09:16.408794+0000","last_active":"2024-09-15T22:09:22.857058+0000","last_peered":"2024-09-15T22:09:22.857058+0000","last_clean":"2024-09-15T22:09:22.857058+0000","last_became_active":"2024-09-15T22:09:16.408530+0000","last_became_peered":"2024-09-15T22:09:16.408530+0000","last_unstale":"2024-09-15T22:09:22.857058+0000","last_undegraded":"2024-09-15T22:09:22.857058+0000","last_fullsized":"2024-09-15T22:09:22.857058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:45.460989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857342+0000","last_change":"2024-09-15T22:09:21.451875+0000","last_active":"2024-09-15T22:09:22.857342+0000","last_peered":"2024-09-15T22:09:22.857342+0000","last_clean":"2024-09-15T22:09:22.857342+0000","last_became_active":"2024-09-15T22:09:21.451491+0000","last_became_peered":"2024-09-15T22:09:21.451491+0000","last_unstale":"2024-09-15T22:09:22.857342+0000","last_undegraded":"2024-09-15T22:09:22.857342+0000","last_fullsized":"2024-09-15T22:09:22.857342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:11.279572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434545+0000","last_change":"2024-09-15T22:09:17.409336+0000","last_active":"2024-09-15T22:09:22.434545+0000","last_peered":"2024-09-15T22:09:22.434545+0000","last_clean":"2024-09-15T22:09:22.434545+0000","last_became_active":"2024-09-15T22:09:17.409038+0000","last_became_peered":"2024-09-15T22:09:17.409038+0000","last_unstale":"2024-09-15T22:09:22.434545+0000","last_undegraded":"2024-09-15T22:09:22.434545+0000","last_fullsized":"2024-09-15T22:09:22.434545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:06.946537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447132+0000","last_change":"2024-09-15T22:09:16.409869+0000","last_active":"2024-09-15T22:09:22.447132+0000","last_peered":"2024-09-15T22:09:22.447132+0000","last_clean":"2024-09-15T22:09:22.447132+0000","last_became_active":"2024-09-15T22:09:16.409532+0000","last_became_peered":"2024-09-15T22:09:16.409532+0000","last_unstale":"2024-09-15T22:09:22.447132+0000","last_undegraded":"2024-09-15T22:09:22.447132+0000","last_fullsized":"2024-09-15T22:09:22.447132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:05.940474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857020+0000","last_change":"2024-09-15T22:09:21.458201+0000","last_active":"2024-09-15T22:09:22.857020+0000","last_peered":"2024-09-15T22:09:22.857020+0000","last_clean":"2024-09-15T22:09:22.857020+0000","last_became_active":"2024-09-15T22:09:21.457818+0000","last_became_peered":"2024-09-15T22:09:21.457818+0000","last_unstale":"2024-09-15T22:09:22.857020+0000","last_undegraded":"2024-09-15T22:09:22.857020+0000","last_fullsized":"2024-09-15T22:09:22.857020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:16.163530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857554+0000","last_change":"2024-09-15T22:09:17.399405+0000","last_active":"2024-09-15T22:09:22.857554+0000","last_peered":"2024-09-15T22:09:22.857554+0000","last_clean":"2024-09-15T22:09:22.857554+0000","last_became_active":"2024-09-15T22:09:17.399148+0000","last_became_peered":"2024-09-15T22:09:17.399148+0000","last_unstale":"2024-09-15T22:09:22.857554+0000","last_undegraded":"2024-09-15T22:09:22.857554+0000","last_fullsized":"2024-09-15T22:09:22.857554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:29.126156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856466+0000","last_change":"2024-09-15T22:09:16.402885+0000","last_active":"2024-09-15T22:09:22.856466+0000","last_peered":"2024-09-15T22:09:22.856466+0000","last_clean":"2024-09-15T22:09:22.856466+0000","last_became_active":"2024-09-15T22:09:16.402575+0000","last_became_peered":"2024-09-15T22:09:16.402575+0000","last_unstale":"2024-09-15T22:09:22.856466+0000","last_undegraded":"2024-09-15T22:09:22.856466+0000","last_fullsized":"2024-09-15T22:09:22.856466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857231+0000","last_change":"2024-09-15T22:09:21.457254+0000","last_active":"2024-09-15T22:09:22.857231+0000","last_peered":"2024-09-15T22:09:22.857231+0000","last_clean":"2024-09-15T22:09:22.857231+0000","last_became_active":"2024-09-15T22:09:21.456858+0000","last_became_peered":"2024-09-15T22:09:21.456858+0000","last_unstale":"2024-09-15T22:09:22.857231+0000","last_undegraded":"2024-09-15T22:09:22.857231+0000","last_fullsized":"2024-09-15T22:09:22.857231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:52.339264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856356+0000","last_change":"2024-09-15T22:09:17.411196+0000","last_active":"2024-09-15T22:09:22.856356+0000","last_peered":"2024-09-15T22:09:22.856356+0000","last_clean":"2024-09-15T22:09:22.856356+0000","last_became_active":"2024-09-15T22:09:17.409905+0000","last_became_peered":"2024-09-15T22:09:17.409905+0000","last_unstale":"2024-09-15T22:09:22.856356+0000","last_undegraded":"2024-09-15T22:09:22.856356+0000","last_fullsized":"2024-09-15T22:09:22.856356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:10.299704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432708+0000","last_change":"2024-09-15T22:09:16.409152+0000","last_active":"2024-09-15T22:09:22.432708+0000","last_peered":"2024-09-15T22:09:22.432708+0000","last_clean":"2024-09-15T22:09:22.432708+0000","last_became_active":"2024-09-15T22:09:16.408793+0000","last_became_peered":"2024-09-15T22:09:16.408793+0000","last_unstale":"2024-09-15T22:09:22.432708+0000","last_undegraded":"2024-09-15T22:09:22.432708+0000","last_fullsized":"2024-09-15T22:09:22.432708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:09.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857950+0000","last_change":"2024-09-15T22:09:21.456804+0000","last_active":"2024-09-15T22:09:22.857950+0000","last_peered":"2024-09-15T22:09:22.857950+0000","last_clean":"2024-09-15T22:09:22.857950+0000","last_became_active":"2024-09-15T22:09:21.456416+0000","last_became_peered":"2024-09-15T22:09:21.456416+0000","last_unstale":"2024-09-15T22:09:22.857950+0000","last_undegraded":"2024-09-15T22:09:22.857950+0000","last_fullsized":"2024-09-15T22:09:22.857950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:28.462550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432088+0000","last_change":"2024-09-15T22:09:17.415024+0000","last_active":"2024-09-15T22:09:22.432088+0000","last_peered":"2024-09-15T22:09:22.432088+0000","last_clean":"2024-09-15T22:09:22.432088+0000","last_became_active":"2024-09-15T22:09:17.414773+0000","last_became_peered":"2024-09-15T22:09:17.414773+0000","last_unstale":"2024-09-15T22:09:22.432088+0000","last_undegraded":"2024-09-15T22:09:22.432088+0000","last_fullsized":"2024-09-15T22:09:22.432088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446804+0000","last_change":"2024-09-15T22:09:16.401625+0000","last_active":"2024-09-15T22:09:22.446804+0000","last_peered":"2024-09-15T22:09:22.446804+0000","last_clean":"2024-09-15T22:09:22.446804+0000","last_became_active":"2024-09-15T22:09:16.401328+0000","last_became_peered":"2024-09-15T22:09:16.401328+0000","last_unstale":"2024-09-15T22:09:22.446804+0000","last_undegraded":"2024-09-15T22:09:22.446804+0000","last_fullsized":"2024-09-15T22:09:22.446804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432814+0000","last_change":"2024-09-15T22:09:07.243631+0000","last_active":"2024-09-15T22:09:22.432814+0000","last_peered":"2024-09-15T22:09:22.432814+0000","last_clean":"2024-09-15T22:09:22.432814+0000","last_became_active":"2024-09-15T22:09:07.243223+0000","last_became_peered":"2024-09-15T22:09:07.243223+0000","last_unstale":"2024-09-15T22:09:22.432814+0000","last_undegraded":"2024-09-15T22:09:22.432814+0000","last_fullsized":"2024-09-15T22:09:22.432814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_clean_scrub_stamp":"2024-09-15T22:09:06.009777+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:17:18.429315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856944+0000","last_change":"2024-09-15T22:09:21.453536+0000","last_active":"2024-09-15T22:09:22.856944+0000","last_peered":"2024-09-15T22:09:22.856944+0000","last_clean":"2024-09-15T22:09:22.856944+0000","last_became_active":"2024-09-15T22:09:21.453022+0000","last_became_peered":"2024-09-15T22:09:21.453022+0000","last_unstale":"2024-09-15T22:09:22.856944+0000","last_undegraded":"2024-09-15T22:09:22.856944+0000","last_fullsized":"2024-09-15T22:09:22.856944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:26.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433676+0000","last_change":"2024-09-15T22:09:17.421914+0000","last_active":"2024-09-15T22:09:22.433676+0000","last_peered":"2024-09-15T22:09:22.433676+0000","last_clean":"2024-09-15T22:09:22.433676+0000","last_became_active":"2024-09-15T22:09:17.420783+0000","last_became_peered":"2024-09-15T22:09:17.420783+0000","last_unstale":"2024-09-15T22:09:22.433676+0000","last_undegraded":"2024-09-15T22:09:22.433676+0000","last_fullsized":"2024-09-15T22:09:22.433676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:24.426671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856694+0000","last_change":"2024-09-15T22:09:16.404982+0000","last_active":"2024-09-15T22:09:22.856694+0000","last_peered":"2024-09-15T22:09:22.856694+0000","last_clean":"2024-09-15T22:09:22.856694+0000","last_became_active":"2024-09-15T22:09:16.404639+0000","last_became_peered":"2024-09-15T22:09:16.404639+0000","last_unstale":"2024-09-15T22:09:22.856694+0000","last_undegraded":"2024-09-15T22:09:22.856694+0000","last_fullsized":"2024-09-15T22:09:22.856694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856609+0000","last_change":"2024-09-15T22:09:21.457352+0000","last_active":"2024-09-15T22:09:22.856609+0000","last_peered":"2024-09-15T22:09:22.856609+0000","last_clean":"2024-09-15T22:09:22.856609+0000","last_became_active":"2024-09-15T22:09:21.456906+0000","last_became_peered":"2024-09-15T22:09:21.456906+0000","last_unstale":"2024-09-15T22:09:22.856609+0000","last_undegraded":"2024-09-15T22:09:22.856609+0000","last_fullsized":"2024-09-15T22:09:22.856609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:28.271273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447025+0000","last_change":"2024-09-15T22:09:17.416652+0000","last_active":"2024-09-15T22:09:22.447025+0000","last_peered":"2024-09-15T22:09:22.447025+0000","last_clean":"2024-09-15T22:09:22.447025+0000","last_became_active":"2024-09-15T22:09:17.415597+0000","last_became_peered":"2024-09-15T22:09:17.415597+0000","last_unstale":"2024-09-15T22:09:22.447025+0000","last_undegraded":"2024-09-15T22:09:22.447025+0000","last_fullsized":"2024-09-15T22:09:22.447025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:36.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856534+0000","last_change":"2024-09-15T22:09:16.405689+0000","last_active":"2024-09-15T22:09:22.856534+0000","last_peered":"2024-09-15T22:09:22.856534+0000","last_clean":"2024-09-15T22:09:22.856534+0000","last_became_active":"2024-09-15T22:09:16.405433+0000","last_became_peered":"2024-09-15T22:09:16.405433+0000","last_unstale":"2024-09-15T22:09:22.856534+0000","last_undegraded":"2024-09-15T22:09:22.856534+0000","last_fullsized":"2024-09-15T22:09:22.856534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.332999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857836+0000","last_change":"2024-09-15T22:09:21.448031+0000","last_active":"2024-09-15T22:09:22.857836+0000","last_peered":"2024-09-15T22:09:22.857836+0000","last_clean":"2024-09-15T22:09:22.857836+0000","last_became_active":"2024-09-15T22:09:21.447464+0000","last_became_peered":"2024-09-15T22:09:21.447464+0000","last_unstale":"2024-09-15T22:09:22.857836+0000","last_undegraded":"2024-09-15T22:09:22.857836+0000","last_fullsized":"2024-09-15T22:09:22.857836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:26.039358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434380+0000","last_change":"2024-09-15T22:09:17.412910+0000","last_active":"2024-09-15T22:09:22.434380+0000","last_peered":"2024-09-15T22:09:22.434380+0000","last_clean":"2024-09-15T22:09:22.434380+0000","last_became_active":"2024-09-15T22:09:17.412079+0000","last_became_peered":"2024-09-15T22:09:17.412079+0000","last_unstale":"2024-09-15T22:09:22.434380+0000","last_undegraded":"2024-09-15T22:09:22.434380+0000","last_fullsized":"2024-09-15T22:09:22.434380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:04.536343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856351+0000","last_change":"2024-09-15T22:09:16.405941+0000","last_active":"2024-09-15T22:09:22.856351+0000","last_peered":"2024-09-15T22:09:22.856351+0000","last_clean":"2024-09-15T22:09:22.856351+0000","last_became_active":"2024-09-15T22:09:16.405621+0000","last_became_peered":"2024-09-15T22:09:16.405621+0000","last_unstale":"2024-09-15T22:09:22.856351+0000","last_undegraded":"2024-09-15T22:09:22.856351+0000","last_fullsized":"2024-09-15T22:09:22.856351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446643+0000","last_change":"2024-09-15T22:09:21.449669+0000","last_active":"2024-09-15T22:09:22.446643+0000","last_peered":"2024-09-15T22:09:22.446643+0000","last_clean":"2024-09-15T22:09:22.446643+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:09:22.446643+0000","last_undegraded":"2024-09-15T22:09:22.446643+0000","last_fullsized":"2024-09-15T22:09:22.446643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:45.457068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433550+0000","last_change":"2024-09-15T22:09:17.410475+0000","last_active":"2024-09-15T22:09:22.433550+0000","last_peered":"2024-09-15T22:09:22.433550+0000","last_clean":"2024-09-15T22:09:22.433550+0000","last_became_active":"2024-09-15T22:09:17.410176+0000","last_became_peered":"2024-09-15T22:09:17.410176+0000","last_unstale":"2024-09-15T22:09:22.433550+0000","last_undegraded":"2024-09-15T22:09:22.433550+0000","last_fullsized":"2024-09-15T22:09:22.433550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434085+0000","last_change":"2024-09-15T22:09:16.399090+0000","last_active":"2024-09-15T22:09:22.434085+0000","last_peered":"2024-09-15T22:09:22.434085+0000","last_clean":"2024-09-15T22:09:22.434085+0000","last_became_active":"2024-09-15T22:09:16.398789+0000","last_became_peered":"2024-09-15T22:09:16.398789+0000","last_unstale":"2024-09-15T22:09:22.434085+0000","last_undegraded":"2024-09-15T22:09:22.434085+0000","last_fullsized":"2024-09-15T22:09:22.434085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:14.477432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433128+0000","last_change":"2024-09-15T22:09:21.448270+0000","last_active":"2024-09-15T22:09:22.433128+0000","last_peered":"2024-09-15T22:09:22.433128+0000","last_clean":"2024-09-15T22:09:22.433128+0000","last_became_active":"2024-09-15T22:09:21.447541+0000","last_became_peered":"2024-09-15T22:09:21.447541+0000","last_unstale":"2024-09-15T22:09:22.433128+0000","last_undegraded":"2024-09-15T22:09:22.433128+0000","last_fullsized":"2024-09-15T22:09:22.433128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:51.175728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433007+0000","last_change":"2024-09-15T22:09:17.410762+0000","last_active":"2024-09-15T22:09:22.433007+0000","last_peered":"2024-09-15T22:09:22.433007+0000","last_clean":"2024-09-15T22:09:22.433007+0000","last_became_active":"2024-09-15T22:09:17.410431+0000","last_became_peered":"2024-09-15T22:09:17.410431+0000","last_unstale":"2024-09-15T22:09:22.433007+0000","last_undegraded":"2024-09-15T22:09:22.433007+0000","last_fullsized":"2024-09-15T22:09:22.433007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:15.123863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.855905+0000","last_change":"2024-09-15T22:09:16.409298+0000","last_active":"2024-09-15T22:09:22.855905+0000","last_peered":"2024-09-15T22:09:22.855905+0000","last_clean":"2024-09-15T22:09:22.855905+0000","last_became_active":"2024-09-15T22:09:16.408991+0000","last_became_peered":"2024-09-15T22:09:16.408991+0000","last_unstale":"2024-09-15T22:09:22.855905+0000","last_undegraded":"2024-09-15T22:09:22.855905+0000","last_fullsized":"2024-09-15T22:09:22.855905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.799831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857935+0000","last_change":"2024-09-15T22:09:21.453936+0000","last_active":"2024-09-15T22:09:22.857935+0000","last_peered":"2024-09-15T22:09:22.857935+0000","last_clean":"2024-09-15T22:09:22.857935+0000","last_became_active":"2024-09-15T22:09:21.453526+0000","last_became_peered":"2024-09-15T22:09:21.453526+0000","last_unstale":"2024-09-15T22:09:22.857935+0000","last_undegraded":"2024-09-15T22:09:22.857935+0000","last_fullsized":"2024-09-15T22:09:22.857935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:19.159742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856612+0000","last_change":"2024-09-15T22:09:17.404617+0000","last_active":"2024-09-15T22:09:22.856612+0000","last_peered":"2024-09-15T22:09:22.856612+0000","last_clean":"2024-09-15T22:09:22.856612+0000","last_became_active":"2024-09-15T22:09:17.404310+0000","last_became_peered":"2024-09-15T22:09:17.404310+0000","last_unstale":"2024-09-15T22:09:22.856612+0000","last_undegraded":"2024-09-15T22:09:22.856612+0000","last_fullsized":"2024-09-15T22:09:22.856612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:17.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856611+0000","last_change":"2024-09-15T22:09:16.403439+0000","last_active":"2024-09-15T22:09:22.856611+0000","last_peered":"2024-09-15T22:09:22.856611+0000","last_clean":"2024-09-15T22:09:22.856611+0000","last_became_active":"2024-09-15T22:09:16.403137+0000","last_became_peered":"2024-09-15T22:09:16.403137+0000","last_unstale":"2024-09-15T22:09:22.856611+0000","last_undegraded":"2024-09-15T22:09:22.856611+0000","last_fullsized":"2024-09-15T22:09:22.856611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:05.940474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432504+0000","last_change":"2024-09-15T22:09:21.451370+0000","last_active":"2024-09-15T22:09:22.432504+0000","last_peered":"2024-09-15T22:09:22.432504+0000","last_clean":"2024-09-15T22:09:22.432504+0000","last_became_active":"2024-09-15T22:09:21.451016+0000","last_became_peered":"2024-09-15T22:09:21.451016+0000","last_unstale":"2024-09-15T22:09:22.432504+0000","last_undegraded":"2024-09-15T22:09:22.432504+0000","last_fullsized":"2024-09-15T22:09:22.432504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:54.480340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433466+0000","last_change":"2024-09-15T22:09:17.412953+0000","last_active":"2024-09-15T22:09:22.433466+0000","last_peered":"2024-09-15T22:09:22.433466+0000","last_clean":"2024-09-15T22:09:22.433466+0000","last_became_active":"2024-09-15T22:09:17.412680+0000","last_became_peered":"2024-09-15T22:09:17.412680+0000","last_unstale":"2024-09-15T22:09:22.433466+0000","last_undegraded":"2024-09-15T22:09:22.433466+0000","last_fullsized":"2024-09-15T22:09:22.433466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:36.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446965+0000","last_change":"2024-09-15T22:09:16.406833+0000","last_active":"2024-09-15T22:09:22.446965+0000","last_peered":"2024-09-15T22:09:22.446965+0000","last_clean":"2024-09-15T22:09:22.446965+0000","last_became_active":"2024-09-15T22:09:16.406550+0000","last_became_peered":"2024-09-15T22:09:16.406550+0000","last_unstale":"2024-09-15T22:09:22.446965+0000","last_undegraded":"2024-09-15T22:09:22.446965+0000","last_fullsized":"2024-09-15T22:09:22.446965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432709+0000","last_change":"2024-09-15T22:09:21.450825+0000","last_active":"2024-09-15T22:09:22.432709+0000","last_peered":"2024-09-15T22:09:22.432709+0000","last_clean":"2024-09-15T22:09:22.432709+0000","last_became_active":"2024-09-15T22:09:21.450200+0000","last_became_peered":"2024-09-15T22:09:21.450200+0000","last_unstale":"2024-09-15T22:09:22.432709+0000","last_undegraded":"2024-09-15T22:09:22.432709+0000","last_fullsized":"2024-09-15T22:09:22.432709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:10.812526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857874+0000","last_change":"2024-09-15T22:09:17.421088+0000","last_active":"2024-09-15T22:09:22.857874+0000","last_peered":"2024-09-15T22:09:22.857874+0000","last_clean":"2024-09-15T22:09:22.857874+0000","last_became_active":"2024-09-15T22:09:17.420802+0000","last_became_peered":"2024-09-15T22:09:17.420802+0000","last_unstale":"2024-09-15T22:09:22.857874+0000","last_undegraded":"2024-09-15T22:09:22.857874+0000","last_fullsized":"2024-09-15T22:09:22.857874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:57.079300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857630+0000","last_change":"2024-09-15T22:09:16.395676+0000","last_active":"2024-09-15T22:09:22.857630+0000","last_peered":"2024-09-15T22:09:22.857630+0000","last_clean":"2024-09-15T22:09:22.857630+0000","last_became_active":"2024-09-15T22:09:16.394355+0000","last_became_peered":"2024-09-15T22:09:16.394355+0000","last_unstale":"2024-09-15T22:09:22.857630+0000","last_undegraded":"2024-09-15T22:09:22.857630+0000","last_fullsized":"2024-09-15T22:09:22.857630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:53.845610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447248+0000","last_change":"2024-09-15T22:09:21.454458+0000","last_active":"2024-09-15T22:09:22.447248+0000","last_peered":"2024-09-15T22:09:22.447248+0000","last_clean":"2024-09-15T22:09:22.447248+0000","last_became_active":"2024-09-15T22:09:21.453992+0000","last_became_peered":"2024-09-15T22:09:21.453992+0000","last_unstale":"2024-09-15T22:09:22.447248+0000","last_undegraded":"2024-09-15T22:09:22.447248+0000","last_fullsized":"2024-09-15T22:09:22.447248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:08.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433584+0000","last_change":"2024-09-15T22:09:17.404161+0000","last_active":"2024-09-15T22:09:22.433584+0000","last_peered":"2024-09-15T22:09:22.433584+0000","last_clean":"2024-09-15T22:09:22.433584+0000","last_became_active":"2024-09-15T22:09:17.403899+0000","last_became_peered":"2024-09-15T22:09:17.403899+0000","last_unstale":"2024-09-15T22:09:22.433584+0000","last_undegraded":"2024-09-15T22:09:22.433584+0000","last_fullsized":"2024-09-15T22:09:22.433584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:22.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:26.561882+0000","last_change":"2024-09-15T22:09:16.403905+0000","last_active":"2024-09-15T22:09:26.561882+0000","last_peered":"2024-09-15T22:09:26.561882+0000","last_clean":"2024-09-15T22:09:26.561882+0000","last_became_active":"2024-09-15T22:09:16.403624+0000","last_became_peered":"2024-09-15T22:09:16.403624+0000","last_unstale":"2024-09-15T22:09:26.561882+0000","last_undegraded":"2024-09-15T22:09:26.561882+0000","last_fullsized":"2024-09-15T22:09:26.561882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857547+0000","last_change":"2024-09-15T22:09:21.452045+0000","last_active":"2024-09-15T22:09:22.857547+0000","last_peered":"2024-09-15T22:09:22.857547+0000","last_clean":"2024-09-15T22:09:22.857547+0000","last_became_active":"2024-09-15T22:09:21.451617+0000","last_became_peered":"2024-09-15T22:09:21.451617+0000","last_unstale":"2024-09-15T22:09:22.857547+0000","last_undegraded":"2024-09-15T22:09:22.857547+0000","last_fullsized":"2024-09-15T22:09:22.857547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:32.189930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434073+0000","last_change":"2024-09-15T22:09:17.399198+0000","last_active":"2024-09-15T22:09:22.434073+0000","last_peered":"2024-09-15T22:09:22.434073+0000","last_clean":"2024-09-15T22:09:22.434073+0000","last_became_active":"2024-09-15T22:09:17.398881+0000","last_became_peered":"2024-09-15T22:09:17.398881+0000","last_unstale":"2024-09-15T22:09:22.434073+0000","last_undegraded":"2024-09-15T22:09:22.434073+0000","last_fullsized":"2024-09-15T22:09:22.434073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:44.868956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856437+0000","last_change":"2024-09-15T22:09:16.408365+0000","last_active":"2024-09-15T22:09:22.856437+0000","last_peered":"2024-09-15T22:09:22.856437+0000","last_clean":"2024-09-15T22:09:22.856437+0000","last_became_active":"2024-09-15T22:09:16.408064+0000","last_became_peered":"2024-09-15T22:09:16.408064+0000","last_unstale":"2024-09-15T22:09:22.856437+0000","last_undegraded":"2024-09-15T22:09:22.856437+0000","last_fullsized":"2024-09-15T22:09:22.856437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:01.032313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434291+0000","last_change":"2024-09-15T22:09:21.455334+0000","last_active":"2024-09-15T22:09:22.434291+0000","last_peered":"2024-09-15T22:09:22.434291+0000","last_clean":"2024-09-15T22:09:22.434291+0000","last_became_active":"2024-09-15T22:09:21.454907+0000","last_became_peered":"2024-09-15T22:09:21.454907+0000","last_unstale":"2024-09-15T22:09:22.434291+0000","last_undegraded":"2024-09-15T22:09:22.434291+0000","last_fullsized":"2024-09-15T22:09:22.434291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:26.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856952+0000","last_change":"2024-09-15T22:09:17.415215+0000","last_active":"2024-09-15T22:09:22.856952+0000","last_peered":"2024-09-15T22:09:22.856952+0000","last_clean":"2024-09-15T22:09:22.856952+0000","last_became_active":"2024-09-15T22:09:17.414951+0000","last_became_peered":"2024-09-15T22:09:17.414951+0000","last_unstale":"2024-09-15T22:09:22.856952+0000","last_undegraded":"2024-09-15T22:09:22.856952+0000","last_fullsized":"2024-09-15T22:09:22.856952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447106+0000","last_change":"2024-09-15T22:09:16.405521+0000","last_active":"2024-09-15T22:09:22.447106+0000","last_peered":"2024-09-15T22:09:22.447106+0000","last_clean":"2024-09-15T22:09:22.447106+0000","last_became_active":"2024-09-15T22:09:16.405230+0000","last_became_peered":"2024-09-15T22:09:16.405230+0000","last_unstale":"2024-09-15T22:09:22.447106+0000","last_undegraded":"2024-09-15T22:09:22.447106+0000","last_fullsized":"2024-09-15T22:09:22.447106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:03.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432020+0000","last_change":"2024-09-15T22:09:21.450431+0000","last_active":"2024-09-15T22:09:22.432020+0000","last_peered":"2024-09-15T22:09:22.432020+0000","last_clean":"2024-09-15T22:09:22.432020+0000","last_became_active":"2024-09-15T22:09:21.449896+0000","last_became_peered":"2024-09-15T22:09:21.449896+0000","last_unstale":"2024-09-15T22:09:22.432020+0000","last_undegraded":"2024-09-15T22:09:22.432020+0000","last_fullsized":"2024-09-15T22:09:22.432020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:18.430595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447073+0000","last_change":"2024-09-15T22:09:17.422669+0000","last_active":"2024-09-15T22:09:22.447073+0000","last_peered":"2024-09-15T22:09:22.447073+0000","last_clean":"2024-09-15T22:09:22.447073+0000","last_became_active":"2024-09-15T22:09:17.422401+0000","last_became_peered":"2024-09-15T22:09:17.422401+0000","last_unstale":"2024-09-15T22:09:22.447073+0000","last_undegraded":"2024-09-15T22:09:22.447073+0000","last_fullsized":"2024-09-15T22:09:22.447073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857139+0000","last_change":"2024-09-15T22:09:16.405552+0000","last_active":"2024-09-15T22:09:22.857139+0000","last_peered":"2024-09-15T22:09:22.857139+0000","last_clean":"2024-09-15T22:09:22.857139+0000","last_became_active":"2024-09-15T22:09:16.405208+0000","last_became_peered":"2024-09-15T22:09:16.405208+0000","last_unstale":"2024-09-15T22:09:22.857139+0000","last_undegraded":"2024-09-15T22:09:22.857139+0000","last_fullsized":"2024-09-15T22:09:22.857139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432030+0000","last_change":"2024-09-15T22:09:21.448849+0000","last_active":"2024-09-15T22:09:22.432030+0000","last_peered":"2024-09-15T22:09:22.432030+0000","last_clean":"2024-09-15T22:09:22.432030+0000","last_became_active":"2024-09-15T22:09:21.448356+0000","last_became_peered":"2024-09-15T22:09:21.448356+0000","last_unstale":"2024-09-15T22:09:22.432030+0000","last_undegraded":"2024-09-15T22:09:22.432030+0000","last_fullsized":"2024-09-15T22:09:22.432030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:08.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857853+0000","last_change":"2024-09-15T22:09:21.458815+0000","last_active":"2024-09-15T22:09:22.857853+0000","last_peered":"2024-09-15T22:09:22.857853+0000","last_clean":"2024-09-15T22:09:22.857853+0000","last_became_active":"2024-09-15T22:09:21.458418+0000","last_became_peered":"2024-09-15T22:09:21.458418+0000","last_unstale":"2024-09-15T22:09:22.857853+0000","last_undegraded":"2024-09-15T22:09:22.857853+0000","last_fullsized":"2024-09-15T22:09:22.857853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:26.187414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857180+0000","last_change":"2024-09-15T22:09:17.401001+0000","last_active":"2024-09-15T22:09:22.857180+0000","last_peered":"2024-09-15T22:09:22.857180+0000","last_clean":"2024-09-15T22:09:22.857180+0000","last_became_active":"2024-09-15T22:09:17.400754+0000","last_became_peered":"2024-09-15T22:09:17.400754+0000","last_unstale":"2024-09-15T22:09:22.857180+0000","last_undegraded":"2024-09-15T22:09:22.857180+0000","last_fullsized":"2024-09-15T22:09:22.857180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:33.878828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446850+0000","last_change":"2024-09-15T22:09:16.404987+0000","last_active":"2024-09-15T22:09:22.446850+0000","last_peered":"2024-09-15T22:09:22.446850+0000","last_clean":"2024-09-15T22:09:22.446850+0000","last_became_active":"2024-09-15T22:09:16.404694+0000","last_became_peered":"2024-09-15T22:09:16.404694+0000","last_unstale":"2024-09-15T22:09:22.446850+0000","last_undegraded":"2024-09-15T22:09:22.446850+0000","last_fullsized":"2024-09-15T22:09:22.446850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857090+0000","last_change":"2024-09-15T22:09:21.457334+0000","last_active":"2024-09-15T22:09:22.857090+0000","last_peered":"2024-09-15T22:09:22.857090+0000","last_clean":"2024-09-15T22:09:22.857090+0000","last_became_active":"2024-09-15T22:09:21.456871+0000","last_became_peered":"2024-09-15T22:09:21.456871+0000","last_unstale":"2024-09-15T22:09:22.857090+0000","last_undegraded":"2024-09-15T22:09:22.857090+0000","last_fullsized":"2024-09-15T22:09:22.857090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:08.904123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432074+0000","last_change":"2024-09-15T22:09:17.402872+0000","last_active":"2024-09-15T22:09:22.432074+0000","last_peered":"2024-09-15T22:09:22.432074+0000","last_clean":"2024-09-15T22:09:22.432074+0000","last_became_active":"2024-09-15T22:09:17.402625+0000","last_became_peered":"2024-09-15T22:09:17.402625+0000","last_unstale":"2024-09-15T22:09:22.432074+0000","last_undegraded":"2024-09-15T22:09:22.432074+0000","last_fullsized":"2024-09-15T22:09:22.432074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432270+0000","last_change":"2024-09-15T22:09:16.405821+0000","last_active":"2024-09-15T22:09:22.432270+0000","last_peered":"2024-09-15T22:09:22.432270+0000","last_clean":"2024-09-15T22:09:22.432270+0000","last_became_active":"2024-09-15T22:09:16.405561+0000","last_became_peered":"2024-09-15T22:09:16.405561+0000","last_unstale":"2024-09-15T22:09:22.432270+0000","last_undegraded":"2024-09-15T22:09:22.432270+0000","last_fullsized":"2024-09-15T22:09:22.432270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856909+0000","last_change":"2024-09-15T22:09:16.403455+0000","last_active":"2024-09-15T22:09:22.856909+0000","last_peered":"2024-09-15T22:09:22.856909+0000","last_clean":"2024-09-15T22:09:22.856909+0000","last_became_active":"2024-09-15T22:09:16.403172+0000","last_became_peered":"2024-09-15T22:09:16.403172+0000","last_unstale":"2024-09-15T22:09:22.856909+0000","last_undegraded":"2024-09-15T22:09:22.856909+0000","last_fullsized":"2024-09-15T22:09:22.856909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:03.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857480+0000","last_change":"2024-09-15T22:09:17.416335+0000","last_active":"2024-09-15T22:09:22.857480+0000","last_peered":"2024-09-15T22:09:22.857480+0000","last_clean":"2024-09-15T22:09:22.857480+0000","last_became_active":"2024-09-15T22:09:17.416102+0000","last_became_peered":"2024-09-15T22:09:17.416102+0000","last_unstale":"2024-09-15T22:09:22.857480+0000","last_undegraded":"2024-09-15T22:09:22.857480+0000","last_fullsized":"2024-09-15T22:09:22.857480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856673+0000","last_change":"2024-09-15T22:09:21.448449+0000","last_active":"2024-09-15T22:09:22.856673+0000","last_peered":"2024-09-15T22:09:22.856673+0000","last_clean":"2024-09-15T22:09:22.856673+0000","last_became_active":"2024-09-15T22:09:21.448020+0000","last_became_peered":"2024-09-15T22:09:21.448020+0000","last_unstale":"2024-09-15T22:09:22.856673+0000","last_undegraded":"2024-09-15T22:09:22.856673+0000","last_fullsized":"2024-09-15T22:09:22.856673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:05.244676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432514+0000","last_change":"2024-09-15T22:09:16.401331+0000","last_active":"2024-09-15T22:09:22.432514+0000","last_peered":"2024-09-15T22:09:22.432514+0000","last_clean":"2024-09-15T22:09:22.432514+0000","last_became_active":"2024-09-15T22:09:16.401040+0000","last_became_peered":"2024-09-15T22:09:16.401040+0000","last_unstale":"2024-09-15T22:09:22.432514+0000","last_undegraded":"2024-09-15T22:09:22.432514+0000","last_fullsized":"2024-09-15T22:09:22.432514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.799831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433188+0000","last_change":"2024-09-15T22:09:17.405328+0000","last_active":"2024-09-15T22:09:22.433188+0000","last_peered":"2024-09-15T22:09:22.433188+0000","last_clean":"2024-09-15T22:09:22.433188+0000","last_became_active":"2024-09-15T22:09:17.404772+0000","last_became_peered":"2024-09-15T22:09:17.404772+0000","last_unstale":"2024-09-15T22:09:22.433188+0000","last_undegraded":"2024-09-15T22:09:22.433188+0000","last_fullsized":"2024-09-15T22:09:22.433188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:33.377260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432644+0000","last_change":"2024-09-15T22:09:21.458359+0000","last_active":"2024-09-15T22:09:22.432644+0000","last_peered":"2024-09-15T22:09:22.432644+0000","last_clean":"2024-09-15T22:09:22.432644+0000","last_became_active":"2024-09-15T22:09:21.457977+0000","last_became_peered":"2024-09-15T22:09:21.457977+0000","last_unstale":"2024-09-15T22:09:22.432644+0000","last_undegraded":"2024-09-15T22:09:22.432644+0000","last_fullsized":"2024-09-15T22:09:22.432644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.055754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856459+0000","last_change":"2024-09-15T22:09:17.405556+0000","last_active":"2024-09-15T22:09:22.856459+0000","last_peered":"2024-09-15T22:09:22.856459+0000","last_clean":"2024-09-15T22:09:22.856459+0000","last_became_active":"2024-09-15T22:09:17.405129+0000","last_became_peered":"2024-09-15T22:09:17.405129+0000","last_unstale":"2024-09-15T22:09:22.856459+0000","last_undegraded":"2024-09-15T22:09:22.856459+0000","last_fullsized":"2024-09-15T22:09:22.856459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856332+0000","last_change":"2024-09-15T22:09:17.408189+0000","last_active":"2024-09-15T22:09:22.856332+0000","last_peered":"2024-09-15T22:09:22.856332+0000","last_clean":"2024-09-15T22:09:22.856332+0000","last_became_active":"2024-09-15T22:09:17.407877+0000","last_became_peered":"2024-09-15T22:09:17.407877+0000","last_unstale":"2024-09-15T22:09:22.856332+0000","last_undegraded":"2024-09-15T22:09:22.856332+0000","last_fullsized":"2024-09-15T22:09:22.856332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:02.290840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446878+0000","last_change":"2024-09-15T22:09:17.415666+0000","last_active":"2024-09-15T22:09:22.446878+0000","last_peered":"2024-09-15T22:09:22.446878+0000","last_clean":"2024-09-15T22:09:22.446878+0000","last_became_active":"2024-09-15T22:09:17.415399+0000","last_became_peered":"2024-09-15T22:09:17.415399+0000","last_unstale":"2024-09-15T22:09:22.446878+0000","last_undegraded":"2024-09-15T22:09:22.446878+0000","last_fullsized":"2024-09-15T22:09:22.446878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857393+0000","last_change":"2024-09-15T22:09:17.406140+0000","last_active":"2024-09-15T22:09:22.857393+0000","last_peered":"2024-09-15T22:09:22.857393+0000","last_clean":"2024-09-15T22:09:22.857393+0000","last_became_active":"2024-09-15T22:09:17.405142+0000","last_became_peered":"2024-09-15T22:09:17.405142+0000","last_unstale":"2024-09-15T22:09:22.857393+0000","last_undegraded":"2024-09-15T22:09:22.857393+0000","last_fullsized":"2024-09-15T22:09:22.857393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:17.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432765+0000","last_change":"2024-09-15T22:09:17.411027+0000","last_active":"2024-09-15T22:09:22.432765+0000","last_peered":"2024-09-15T22:09:22.432765+0000","last_clean":"2024-09-15T22:09:22.432765+0000","last_became_active":"2024-09-15T22:09:17.408913+0000","last_became_peered":"2024-09-15T22:09:17.408913+0000","last_unstale":"2024-09-15T22:09:22.432765+0000","last_undegraded":"2024-09-15T22:09:22.432765+0000","last_fullsized":"2024-09-15T22:09:22.432765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:34.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856265+0000","last_change":"2024-09-15T22:09:17.401385+0000","last_active":"2024-09-15T22:09:22.856265+0000","last_peered":"2024-09-15T22:09:22.856265+0000","last_clean":"2024-09-15T22:09:22.856265+0000","last_became_active":"2024-09-15T22:09:17.400916+0000","last_became_peered":"2024-09-15T22:09:17.400916+0000","last_unstale":"2024-09-15T22:09:22.856265+0000","last_undegraded":"2024-09-15T22:09:22.856265+0000","last_fullsized":"2024-09-15T22:09:22.856265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:31.994148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857149+0000","last_change":"2024-09-15T22:09:17.405622+0000","last_active":"2024-09-15T22:09:22.857149+0000","last_peered":"2024-09-15T22:09:22.857149+0000","last_clean":"2024-09-15T22:09:22.857149+0000","last_became_active":"2024-09-15T22:09:17.405319+0000","last_became_peered":"2024-09-15T22:09:17.405319+0000","last_unstale":"2024-09-15T22:09:22.857149+0000","last_undegraded":"2024-09-15T22:09:22.857149+0000","last_fullsized":"2024-09-15T22:09:22.857149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432397+0000","last_change":"2024-09-15T22:09:17.409317+0000","last_active":"2024-09-15T22:09:22.432397+0000","last_peered":"2024-09-15T22:09:22.432397+0000","last_clean":"2024-09-15T22:09:22.432397+0000","last_became_active":"2024-09-15T22:09:17.408949+0000","last_became_peered":"2024-09-15T22:09:17.408949+0000","last_unstale":"2024-09-15T22:09:22.432397+0000","last_undegraded":"2024-09-15T22:09:22.432397+0000","last_fullsized":"2024-09-15T22:09:22.432397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446723+0000","last_change":"2024-09-15T22:09:17.416439+0000","last_active":"2024-09-15T22:09:22.446723+0000","last_peered":"2024-09-15T22:09:22.446723+0000","last_clean":"2024-09-15T22:09:22.446723+0000","last_became_active":"2024-09-15T22:09:17.416170+0000","last_became_peered":"2024-09-15T22:09:17.416170+0000","last_unstale":"2024-09-15T22:09:22.446723+0000","last_undegraded":"2024-09-15T22:09:22.446723+0000","last_fullsized":"2024-09-15T22:09:22.446723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432211+0000","last_change":"2024-09-15T22:09:17.409471+0000","last_active":"2024-09-15T22:09:22.432211+0000","last_peered":"2024-09-15T22:09:22.432211+0000","last_clean":"2024-09-15T22:09:22.432211+0000","last_became_active":"2024-09-15T22:09:17.408969+0000","last_became_peered":"2024-09-15T22:09:17.408969+0000","last_unstale":"2024-09-15T22:09:22.432211+0000","last_undegraded":"2024-09-15T22:09:22.432211+0000","last_fullsized":"2024-09-15T22:09:22.432211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446844+0000","last_change":"2024-09-15T22:09:17.422118+0000","last_active":"2024-09-15T22:09:22.446844+0000","last_peered":"2024-09-15T22:09:22.446844+0000","last_clean":"2024-09-15T22:09:22.446844+0000","last_became_active":"2024-09-15T22:09:17.421846+0000","last_became_peered":"2024-09-15T22:09:17.421846+0000","last_unstale":"2024-09-15T22:09:22.446844+0000","last_undegraded":"2024-09-15T22:09:22.446844+0000","last_fullsized":"2024-09-15T22:09:22.446844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:34.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857299+0000","last_change":"2024-09-15T22:09:17.421168+0000","last_active":"2024-09-15T22:09:22.857299+0000","last_peered":"2024-09-15T22:09:22.857299+0000","last_clean":"2024-09-15T22:09:22.857299+0000","last_became_active":"2024-09-15T22:09:17.420849+0000","last_became_peered":"2024-09-15T22:09:17.420849+0000","last_unstale":"2024-09-15T22:09:22.857299+0000","last_undegraded":"2024-09-15T22:09:22.857299+0000","last_fullsized":"2024-09-15T22:09:22.857299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:25.108343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856803+0000","last_change":"2024-09-15T22:09:17.410112+0000","last_active":"2024-09-15T22:09:22.856803+0000","last_peered":"2024-09-15T22:09:22.856803+0000","last_clean":"2024-09-15T22:09:22.856803+0000","last_became_active":"2024-09-15T22:09:17.409837+0000","last_became_peered":"2024-09-15T22:09:17.409837+0000","last_unstale":"2024-09-15T22:09:22.856803+0000","last_undegraded":"2024-09-15T22:09:22.856803+0000","last_fullsized":"2024-09-15T22:09:22.856803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433979+0000","last_change":"2024-09-15T22:09:17.400115+0000","last_active":"2024-09-15T22:09:22.433979+0000","last_peered":"2024-09-15T22:09:22.433979+0000","last_clean":"2024-09-15T22:09:22.433979+0000","last_became_active":"2024-09-15T22:09:17.399835+0000","last_became_peered":"2024-09-15T22:09:17.399835+0000","last_unstale":"2024-09-15T22:09:22.433979+0000","last_undegraded":"2024-09-15T22:09:22.433979+0000","last_fullsized":"2024-09-15T22:09:22.433979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:13.972528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856270+0000","last_change":"2024-09-15T22:09:17.401680+0000","last_active":"2024-09-15T22:09:22.856270+0000","last_peered":"2024-09-15T22:09:22.856270+0000","last_clean":"2024-09-15T22:09:22.856270+0000","last_became_active":"2024-09-15T22:09:17.401413+0000","last_became_peered":"2024-09-15T22:09:17.401413+0000","last_unstale":"2024-09-15T22:09:22.856270+0000","last_undegraded":"2024-09-15T22:09:22.856270+0000","last_fullsized":"2024-09-15T22:09:22.856270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:04.007901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.447310+0000","last_change":"2024-09-15T22:09:17.421910+0000","last_active":"2024-09-15T22:09:22.447310+0000","last_peered":"2024-09-15T22:09:22.447310+0000","last_clean":"2024-09-15T22:09:22.447310+0000","last_became_active":"2024-09-15T22:09:17.421469+0000","last_became_peered":"2024-09-15T22:09:17.421469+0000","last_unstale":"2024-09-15T22:09:22.447310+0000","last_undegraded":"2024-09-15T22:09:22.447310+0000","last_fullsized":"2024-09-15T22:09:22.447310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:15.123863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446601+0000","last_change":"2024-09-15T22:09:17.411524+0000","last_active":"2024-09-15T22:09:22.446601+0000","last_peered":"2024-09-15T22:09:22.446601+0000","last_clean":"2024-09-15T22:09:22.446601+0000","last_became_active":"2024-09-15T22:09:17.411244+0000","last_became_peered":"2024-09-15T22:09:17.411244+0000","last_unstale":"2024-09-15T22:09:22.446601+0000","last_undegraded":"2024-09-15T22:09:22.446601+0000","last_fullsized":"2024-09-15T22:09:22.446601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857274+0000","last_change":"2024-09-15T22:09:17.409933+0000","last_active":"2024-09-15T22:09:22.857274+0000","last_peered":"2024-09-15T22:09:22.857274+0000","last_clean":"2024-09-15T22:09:22.857274+0000","last_became_active":"2024-09-15T22:09:17.409681+0000","last_became_peered":"2024-09-15T22:09:17.409681+0000","last_unstale":"2024-09-15T22:09:22.857274+0000","last_undegraded":"2024-09-15T22:09:22.857274+0000","last_fullsized":"2024-09-15T22:09:22.857274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:37.130999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857870+0000","last_change":"2024-09-15T22:09:17.403522+0000","last_active":"2024-09-15T22:09:22.857870+0000","last_peered":"2024-09-15T22:09:22.857870+0000","last_clean":"2024-09-15T22:09:22.857870+0000","last_became_active":"2024-09-15T22:09:17.403220+0000","last_became_peered":"2024-09-15T22:09:17.403220+0000","last_unstale":"2024-09-15T22:09:22.857870+0000","last_undegraded":"2024-09-15T22:09:22.857870+0000","last_fullsized":"2024-09-15T22:09:22.857870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:01.208798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432332+0000","last_change":"2024-09-15T22:09:17.400537+0000","last_active":"2024-09-15T22:09:22.432332+0000","last_peered":"2024-09-15T22:09:22.432332+0000","last_clean":"2024-09-15T22:09:22.432332+0000","last_became_active":"2024-09-15T22:09:17.400288+0000","last_became_peered":"2024-09-15T22:09:17.400288+0000","last_unstale":"2024-09-15T22:09:22.432332+0000","last_undegraded":"2024-09-15T22:09:22.432332+0000","last_fullsized":"2024-09-15T22:09:22.432332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433969+0000","last_change":"2024-09-15T22:09:17.404318+0000","last_active":"2024-09-15T22:09:22.433969+0000","last_peered":"2024-09-15T22:09:22.433969+0000","last_clean":"2024-09-15T22:09:22.433969+0000","last_became_active":"2024-09-15T22:09:17.404038+0000","last_became_peered":"2024-09-15T22:09:17.404038+0000","last_unstale":"2024-09-15T22:09:22.433969+0000","last_undegraded":"2024-09-15T22:09:22.433969+0000","last_fullsized":"2024-09-15T22:09:22.433969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:04.314746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856907+0000","last_change":"2024-09-15T22:09:17.415645+0000","last_active":"2024-09-15T22:09:22.856907+0000","last_peered":"2024-09-15T22:09:22.856907+0000","last_clean":"2024-09-15T22:09:22.856907+0000","last_became_active":"2024-09-15T22:09:17.415354+0000","last_became_peered":"2024-09-15T22:09:17.415354+0000","last_unstale":"2024-09-15T22:09:22.856907+0000","last_undegraded":"2024-09-15T22:09:22.856907+0000","last_fullsized":"2024-09-15T22:09:22.856907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.857144+0000","last_change":"2024-09-15T22:09:17.415171+0000","last_active":"2024-09-15T22:09:22.857144+0000","last_peered":"2024-09-15T22:09:22.857144+0000","last_clean":"2024-09-15T22:09:22.857144+0000","last_became_active":"2024-09-15T22:09:17.414875+0000","last_became_peered":"2024-09-15T22:09:17.414875+0000","last_unstale":"2024-09-15T22:09:22.857144+0000","last_undegraded":"2024-09-15T22:09:22.857144+0000","last_fullsized":"2024-09-15T22:09:22.857144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434378+0000","last_change":"2024-09-15T22:09:17.420121+0000","last_active":"2024-09-15T22:09:22.434378+0000","last_peered":"2024-09-15T22:09:22.434378+0000","last_clean":"2024-09-15T22:09:22.434378+0000","last_became_active":"2024-09-15T22:09:17.419854+0000","last_became_peered":"2024-09-15T22:09:17.419854+0000","last_unstale":"2024-09-15T22:09:22.434378+0000","last_undegraded":"2024-09-15T22:09:22.434378+0000","last_fullsized":"2024-09-15T22:09:22.434378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:41.421190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.431873+0000","last_change":"2024-09-15T22:09:17.414316+0000","last_active":"2024-09-15T22:09:22.431873+0000","last_peered":"2024-09-15T22:09:22.431873+0000","last_clean":"2024-09-15T22:09:22.431873+0000","last_became_active":"2024-09-15T22:09:17.414020+0000","last_became_peered":"2024-09-15T22:09:17.414020+0000","last_unstale":"2024-09-15T22:09:22.431873+0000","last_undegraded":"2024-09-15T22:09:22.431873+0000","last_fullsized":"2024-09-15T22:09:22.431873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.432910+0000","last_change":"2024-09-15T22:09:17.404509+0000","last_active":"2024-09-15T22:09:22.432910+0000","last_peered":"2024-09-15T22:09:22.432910+0000","last_clean":"2024-09-15T22:09:22.432910+0000","last_became_active":"2024-09-15T22:09:17.404181+0000","last_became_peered":"2024-09-15T22:09:17.404181+0000","last_unstale":"2024-09-15T22:09:22.432910+0000","last_undegraded":"2024-09-15T22:09:22.432910+0000","last_fullsized":"2024-09-15T22:09:22.432910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:22.003479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446713+0000","last_change":"2024-09-15T22:09:17.414252+0000","last_active":"2024-09-15T22:09:22.446713+0000","last_peered":"2024-09-15T22:09:22.446713+0000","last_clean":"2024-09-15T22:09:22.446713+0000","last_became_active":"2024-09-15T22:09:17.413987+0000","last_became_peered":"2024-09-15T22:09:17.413987+0000","last_unstale":"2024-09-15T22:09:22.446713+0000","last_undegraded":"2024-09-15T22:09:22.446713+0000","last_fullsized":"2024-09-15T22:09:22.446713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.433226+0000","last_change":"2024-09-15T22:09:17.399744+0000","last_active":"2024-09-15T22:09:22.433226+0000","last_peered":"2024-09-15T22:09:22.433226+0000","last_clean":"2024-09-15T22:09:22.433226+0000","last_became_active":"2024-09-15T22:09:17.399470+0000","last_became_peered":"2024-09-15T22:09:17.399470+0000","last_unstale":"2024-09-15T22:09:22.433226+0000","last_undegraded":"2024-09-15T22:09:22.433226+0000","last_fullsized":"2024-09-15T22:09:22.433226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:04.868244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.446913+0000","last_change":"2024-09-15T22:09:17.416763+0000","last_active":"2024-09-15T22:09:22.446913+0000","last_peered":"2024-09-15T22:09:22.446913+0000","last_clean":"2024-09-15T22:09:22.446913+0000","last_became_active":"2024-09-15T22:09:17.415987+0000","last_became_peered":"2024-09-15T22:09:17.415987+0000","last_unstale":"2024-09-15T22:09:22.446913+0000","last_undegraded":"2024-09-15T22:09:22.446913+0000","last_fullsized":"2024-09-15T22:09:22.446913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:04.868244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856619+0000","last_change":"2024-09-15T22:09:17.404558+0000","last_active":"2024-09-15T22:09:22.856619+0000","last_peered":"2024-09-15T22:09:22.856619+0000","last_clean":"2024-09-15T22:09:22.856619+0000","last_became_active":"2024-09-15T22:09:17.404301+0000","last_became_peered":"2024-09-15T22:09:17.404301+0000","last_unstale":"2024-09-15T22:09:22.856619+0000","last_undegraded":"2024-09-15T22:09:22.856619+0000","last_fullsized":"2024-09-15T22:09:22.856619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.856943+0000","last_change":"2024-09-15T22:09:17.402881+0000","last_active":"2024-09-15T22:09:22.856943+0000","last_peered":"2024-09-15T22:09:22.856943+0000","last_clean":"2024-09-15T22:09:22.856943+0000","last_became_active":"2024-09-15T22:09:17.402632+0000","last_became_peered":"2024-09-15T22:09:17.402632+0000","last_unstale":"2024-09-15T22:09:22.856943+0000","last_undegraded":"2024-09-15T22:09:22.856943+0000","last_fullsized":"2024-09-15T22:09:22.856943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:30.142651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:09:22.434291+0000","last_change":"2024-09-15T22:09:17.403017+0000","last_active":"2024-09-15T22:09:22.434291+0000","last_peered":"2024-09-15T22:09:22.434291+0000","last_clean":"2024-09-15T22:09:22.434291+0000","last_became_active":"2024-09-15T22:09:17.402751+0000","last_became_peered":"2024-09-15T22:09:17.402751+0000","last_unstale":"2024-09-15T22:09:22.434291+0000","last_undegraded":"2024-09-15T22:09:22.434291+0000","last_fullsized":"2024-09-15T22:09:22.434291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:26.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":331776,"data_stored":694125,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":103265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":103301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":339968,"data_stored":694181,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":103335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:09:42.060 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:09:42.060 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T22:09:42.060 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-15T22:09:42.060 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-15T22:09:42.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.191+0000 7f23e49b7640 1 Processor -- start 2024-09-15T22:09:42.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.191+0000 7f23e49b7640 1 -- start start 2024-09-15T22:09:42.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.192+0000 7f23e49b7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23e0072c90 0x7f23e0147b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.192+0000 7f23e49b7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f23e006f0b0 0x7f23e01523e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.192+0000 7f23e49b7640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e0073070 con 0x7f23e00b7b30 2024-09-15T22:09:42.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.192+0000 7f23e49b7640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f23e00b76a0 con 0x7f23e0072c90 2024-09-15T22:09:42.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.192+0000 7f23e49b7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f23e00b7f90 con 0x7f23e006f0b0 2024-09-15T22:09:42.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.192+0000 7f23de59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23e0072c90 0x7f23e0147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.192+0000 7f23ddd9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f23e00b7b30 0x7f23e0141b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54798/0 (socket says 172.21.15.78:54798) 2024-09-15T22:09:42.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.192+0000 7f23ddd9b640 1 -- 172.21.15.78:0/4260688687 learned_addr learned my addr 172.21.15.78:0/4260688687 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:42.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.192+0000 7f23ded9d640 1 --2- 172.21.15.78:0/4260688687 >> v2:172.21.15.175:3300/0 conn(0x7f23e006f0b0 0x7f23e01523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.192+0000 7f23de59c640 1 -- 172.21.15.78:0/4260688687 >> v2:172.21.15.175:3300/0 conn(0x7f23e006f0b0 msgr2=0x7f23e01523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:42.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.192+0000 7f23de59c640 1 --2- 172.21.15.78:0/4260688687 >> v2:172.21.15.175:3300/0 conn(0x7f23e006f0b0 0x7f23e01523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.192+0000 7f23de59c640 1 -- 172.21.15.78:0/4260688687 >> v1:172.21.15.78:6789/0 conn(0x7f23e00b7b30 legacy=0x7f23e0141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.192+0000 7f23de59c640 1 -- 172.21.15.78:0/4260688687 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e01422a0 con 0x7f23e0072c90 2024-09-15T22:09:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.193+0000 7f23de59c640 1 --2- 172.21.15.78:0/4260688687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e0072c90 0x7f23e0147b40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f23e0074180 tx=0x7f23d002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495b27e559c50909 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.193+0000 7f23dd59a640 1 -- 172.21.15.78:0/4260688687 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0037070 con 0x7f23e0072c90 2024-09-15T22:09:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.193+0000 7f23dd59a640 1 -- 172.21.15.78:0/4260688687 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d0032440 con 0x7f23e0072c90 2024-09-15T22:09:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.193+0000 7f23dd59a640 1 -- 172.21.15.78:0/4260688687 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d002ae60 con 0x7f23e0072c90 2024-09-15T22:09:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.194+0000 7f23e49b7640 1 -- 172.21.15.78:0/4260688687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e0072c90 msgr2=0x7f23e0147b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.194+0000 7f23e49b7640 1 --2- 172.21.15.78:0/4260688687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e0072c90 0x7f23e0147b40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f23e0074180 tx=0x7f23d002a110 comp rx=0 tx=0).stop 2024-09-15T22:09:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.194+0000 7f23e49b7640 1 -- 172.21.15.78:0/4260688687 shutdown_connections 2024-09-15T22:09:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.194+0000 7f23e49b7640 1 --2- 172.21.15.78:0/4260688687 >> v2:172.21.15.175:3300/0 conn(0x7f23e006f0b0 0x7f23e01523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.194+0000 7f23e49b7640 1 --2- 172.21.15.78:0/4260688687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e0072c90 0x7f23e0147b40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.194+0000 7f23e49b7640 1 -- 172.21.15.78:0/4260688687 >> 172.21.15.78:0/4260688687 conn(0x7f23e00b81e0 msgr2=0x7f23e00b85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:42.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.194+0000 7f23e49b7640 1 -- 172.21.15.78:0/4260688687 shutdown_connections 2024-09-15T22:09:42.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.194+0000 7f23e49b7640 1 -- 172.21.15.78:0/4260688687 wait complete. 2024-09-15T22:09:42.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.195+0000 7f23e49b7640 1 Processor -- start 2024-09-15T22:09:42.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.195+0000 7f23e49b7640 1 -- start start 2024-09-15T22:09:42.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23e49b7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e006f0b0 0x7f23e013cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23e49b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23e0072c90 0x7f23e01dd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23e49b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e00b7b30 0x7f23e01d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23e49b7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f23e006f7d0 con 0x7f23e006f0b0 2024-09-15T22:09:42.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23e49b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f23e006f500 con 0x7f23e00b7b30 2024-09-15T22:09:42.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23e49b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f23e006bf90 con 0x7f23e0072c90 2024-09-15T22:09:42.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23de59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e006f0b0 0x7f23e013cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23de59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e006f0b0 0x7f23e013cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37296/0 (socket says 172.21.15.78:37296) 2024-09-15T22:09:42.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23de59c640 1 -- 172.21.15.78:0/1831944659 learned_addr learned my addr 172.21.15.78:0/1831944659 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:42.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23ddd9b640 1 --2- 172.21.15.78:0/1831944659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23e0072c90 0x7f23e01dd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23ded9d640 1 --2- 172.21.15.78:0/1831944659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e00b7b30 0x7f23e01d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23de59c640 1 -- 172.21.15.78:0/1831944659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23e0072c90 msgr2=0x7f23e01dd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23de59c640 1 --2- 172.21.15.78:0/1831944659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23e0072c90 0x7f23e01dd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23de59c640 1 -- 172.21.15.78:0/1831944659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e00b7b30 msgr2=0x7f23e01d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23de59c640 1 --2- 172.21.15.78:0/1831944659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e00b7b30 0x7f23e01d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23de59c640 1 -- 172.21.15.78:0/1831944659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e00b55d0 con 0x7f23e006f0b0 2024-09-15T22:09:42.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23ded9d640 1 --2- 172.21.15.78:0/1831944659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e00b7b30 0x7f23e01d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:42.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23de59c640 1 --2- 172.21.15.78:0/1831944659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e006f0b0 0x7f23e013cef0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f23d0000c00 tx=0x7f23d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:42.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23ceffd640 1 -- 172.21.15.78:0/1831944659 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0037040 con 0x7f23e006f0b0 2024-09-15T22:09:42.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23ceffd640 1 -- 172.21.15.78:0/1831944659 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d0042070 con 0x7f23e006f0b0 2024-09-15T22:09:42.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23e49b7640 1 -- 172.21.15.78:0/1831944659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e01de230 con 0x7f23e006f0b0 2024-09-15T22:09:42.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23ceffd640 1 -- 172.21.15.78:0/1831944659 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0030bd0 con 0x7f23e006f0b0 2024-09-15T22:09:42.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.196+0000 7f23e49b7640 1 -- 172.21.15.78:0/1831944659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e00b5260 con 0x7f23e006f0b0 2024-09-15T22:09:42.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.197+0000 7f23e49b7640 1 -- 172.21.15.78:0/1831944659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e006ebd0 con 0x7f23e006f0b0 2024-09-15T22:09:42.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.198+0000 7f23ceffd640 1 -- 172.21.15.78:0/1831944659 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f23d0047460 con 0x7f23e006f0b0 2024-09-15T22:09:42.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.198+0000 7f23ceffd640 1 --2- 172.21.15.78:0/1831944659 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f23c006c2e0 0x7f23c006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.198+0000 7f23ddd9b640 1 --2- 172.21.15.78:0/1831944659 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f23c006c2e0 0x7f23c006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.198+0000 7f23ceffd640 1 -- 172.21.15.78:0/1831944659 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f23d00ac2a0 con 0x7f23e006f0b0 2024-09-15T22:09:42.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.199+0000 7f23ddd9b640 1 --2- 172.21.15.78:0/1831944659 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f23c006c2e0 0x7f23c006e7a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f23e013fc70 tx=0x7f23d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:42.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.203+0000 7f23ceffd640 1 -- 172.21.15.78:0/1831944659 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23d0032e20 con 0x7f23e006f0b0 2024-09-15T22:09:42.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.405+0000 7f23e49b7640 1 -- 172.21.15.78:0/1831944659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f23e00b28c0 con 0x7f23e006f0b0 2024-09-15T22:09:42.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.405+0000 7f23ceffd640 1 -- 172.21.15.78:0/1831944659 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f23d007a760 con 0x7f23e006f0b0 2024-09-15T22:09:42.407 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:42.407 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T22:09:42.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.407+0000 7f23e49b7640 1 -- 172.21.15.78:0/1831944659 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f23c006c2e0 msgr2=0x7f23c006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.407+0000 7f23e49b7640 1 --2- 172.21.15.78:0/1831944659 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f23c006c2e0 0x7f23c006e7a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f23e013fc70 tx=0x7f23d4009040 comp rx=0 tx=0).stop 2024-09-15T22:09:42.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.407+0000 7f23e49b7640 1 -- 172.21.15.78:0/1831944659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e006f0b0 msgr2=0x7f23e013cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.407+0000 7f23e49b7640 1 --2- 172.21.15.78:0/1831944659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e006f0b0 0x7f23e013cef0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f23d0000c00 tx=0x7f23d00046c0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.407+0000 7f23e49b7640 1 -- 172.21.15.78:0/1831944659 shutdown_connections 2024-09-15T22:09:42.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.407+0000 7f23e49b7640 1 --2- 172.21.15.78:0/1831944659 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f23c006c2e0 0x7f23c006e7a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.407+0000 7f23e49b7640 1 --2- 172.21.15.78:0/1831944659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e00b7b30 0x7f23e01d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.407+0000 7f23e49b7640 1 --2- 172.21.15.78:0/1831944659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23e0072c90 0x7f23e01dd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.407+0000 7f23e49b7640 1 --2- 172.21.15.78:0/1831944659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e006f0b0 0x7f23e013cef0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.407+0000 7f23e49b7640 1 -- 172.21.15.78:0/1831944659 >> 172.21.15.78:0/1831944659 conn(0x7f23e00b81e0 msgr2=0x7f23e013e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:42.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.407+0000 7f23e49b7640 1 -- 172.21.15.78:0/1831944659 shutdown_connections 2024-09-15T22:09:42.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.407+0000 7f23e49b7640 1 -- 172.21.15.78:0/1831944659 wait complete. 2024-09-15T22:09:42.419 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-15T22:09:42.420 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:09:42.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.517+0000 7fb4ca0f1640 1 Processor -- start 2024-09-15T22:09:42.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.517+0000 7fb4ca0f1640 1 -- start start 2024-09-15T22:09:42.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.517+0000 7fb4ca0f1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4c4149720 0x7fb4c40b9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.517+0000 7fb4ca0f1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4c40b7620 0x7fb4c4150110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.517+0000 7fb4ca0f1640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4c40b9790 con 0x7fb4c40baf20 2024-09-15T22:09:42.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.517+0000 7fb4ca0f1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fb4c40b9a40 con 0x7fb4c4149720 2024-09-15T22:09:42.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.517+0000 7fb4ca0f1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb4c40b9d20 con 0x7fb4c40b7620 2024-09-15T22:09:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.517+0000 7fb4c37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4c4149720 0x7fb4c40b9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.517+0000 7fb4c2ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb4c40baf20 0x7fb4c40ba080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54802/0 (socket says 172.21.15.78:54802) 2024-09-15T22:09:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.517+0000 7fb4c2ffd640 1 -- 172.21.15.78:0/1701644533 learned_addr learned my addr 172.21.15.78:0/1701644533 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.518+0000 7fb4c37fe640 1 -- 172.21.15.78:0/1701644533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4c40b7620 msgr2=0x7fb4c4150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.518+0000 7fb4c37fe640 1 --2- 172.21.15.78:0/1701644533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4c40b7620 0x7fb4c4150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.518+0000 7fb4c37fe640 1 -- 172.21.15.78:0/1701644533 >> v1:172.21.15.78:6789/0 conn(0x7fb4c40baf20 legacy=0x7fb4c40ba080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.518+0000 7fb4c37fe640 1 -- 172.21.15.78:0/1701644533 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c4148d80 con 0x7fb4c4149720 2024-09-15T22:09:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.518+0000 7fb4c27fc640 1 -- 172.21.15.78:0/1701644533 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2428131378 0 0) 0x7fb4c40b9790 con 0x7fb4c40baf20 2024-09-15T22:09:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.518+0000 7fb4c37fe640 1 --2- 172.21.15.78:0/1701644533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c4149720 0x7fb4c40b9250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40097a0 tx=0x7fb4b402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0f07f3f96ae762 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.519+0000 7fb4c27fc640 1 -- 172.21.15.78:0/1701644533 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4037070 con 0x7fb4c4149720 2024-09-15T22:09:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.519+0000 7fb4c27fc640 1 -- 172.21.15.78:0/1701644533 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4b402adb0 con 0x7fb4c4149720 2024-09-15T22:09:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.519+0000 7fb4c27fc640 1 -- 172.21.15.78:0/1701644533 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4032660 con 0x7fb4c4149720 2024-09-15T22:09:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.519+0000 7fb4ca0f1640 1 -- 172.21.15.78:0/1701644533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c4149720 msgr2=0x7fb4c40b9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.519+0000 7fb4ca0f1640 1 --2- 172.21.15.78:0/1701644533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c4149720 0x7fb4c40b9250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40097a0 tx=0x7fb4b402a060 comp rx=0 tx=0).stop 2024-09-15T22:09:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.519+0000 7fb4ca0f1640 1 -- 172.21.15.78:0/1701644533 shutdown_connections 2024-09-15T22:09:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.519+0000 7fb4ca0f1640 1 --2- 172.21.15.78:0/1701644533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4c40b7620 0x7fb4c4150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.519+0000 7fb4ca0f1640 1 --2- 172.21.15.78:0/1701644533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c4149720 0x7fb4c40b9250 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.519+0000 7fb4ca0f1640 1 -- 172.21.15.78:0/1701644533 >> 172.21.15.78:0/1701644533 conn(0x7fb4c409d200 msgr2=0x7fb4c409d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.519+0000 7fb4ca0f1640 1 -- 172.21.15.78:0/1701644533 shutdown_connections 2024-09-15T22:09:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.519+0000 7fb4ca0f1640 1 -- 172.21.15.78:0/1701644533 wait complete. 2024-09-15T22:09:42.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.520+0000 7fb4ca0f1640 1 Processor -- start 2024-09-15T22:09:42.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.520+0000 7fb4ca0f1640 1 -- start start 2024-09-15T22:09:42.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4ca0f1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4c40b7620 0x7fb4c4143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4ca0f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c40baf20 0x7fb4c41dbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4ca0f1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c4149720 0x7fb4c41dc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4ca0f1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c4149c80 con 0x7fb4c40baf20 2024-09-15T22:09:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4ca0f1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c4149b00 con 0x7fb4c4149720 2024-09-15T22:09:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4ca0f1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb4c40b7a90 con 0x7fb4c40b7620 2024-09-15T22:09:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4c2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c40baf20 0x7fb4c41dbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4c2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c40baf20 0x7fb4c41dbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37318/0 (socket says 172.21.15.78:37318) 2024-09-15T22:09:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4c2ffd640 1 -- 172.21.15.78:0/707906392 learned_addr learned my addr 172.21.15.78:0/707906392 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4c37fe640 1 --2- 172.21.15.78:0/707906392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4c40b7620 0x7fb4c4143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4c3fff640 1 --2- 172.21.15.78:0/707906392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c4149720 0x7fb4c41dc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4c2ffd640 1 -- 172.21.15.78:0/707906392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4c40b7620 msgr2=0x7fb4c4143f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4c2ffd640 1 --2- 172.21.15.78:0/707906392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4c40b7620 0x7fb4c4143f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4c2ffd640 1 -- 172.21.15.78:0/707906392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c4149720 msgr2=0x7fb4c41dc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4c2ffd640 1 --2- 172.21.15.78:0/707906392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c4149720 0x7fb4c41dc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4c2ffd640 1 -- 172.21.15.78:0/707906392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c41456b0 con 0x7fb4c40baf20 2024-09-15T22:09:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.521+0000 7fb4c2ffd640 1 --2- 172.21.15.78:0/707906392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c40baf20 0x7fb4c41dbd50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800c4b0 tx=0x7fb4b800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.522+0000 7fb4abfff640 1 -- 172.21.15.78:0/707906392 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8018070 con 0x7fb4c40baf20 2024-09-15T22:09:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.522+0000 7fb4abfff640 1 -- 172.21.15.78:0/707906392 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4b8007500 con 0x7fb4c40baf20 2024-09-15T22:09:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.522+0000 7fb4ca0f1640 1 -- 172.21.15.78:0/707906392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4c41db830 con 0x7fb4c40baf20 2024-09-15T22:09:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.522+0000 7fb4abfff640 1 -- 172.21.15.78:0/707906392 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8004a20 con 0x7fb4c40baf20 2024-09-15T22:09:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.522+0000 7fb4ca0f1640 1 -- 172.21.15.78:0/707906392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4c4144bd0 con 0x7fb4c40baf20 2024-09-15T22:09:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.523+0000 7fb4ca0f1640 1 -- 172.21.15.78:0/707906392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4c4147db0 con 0x7fb4c40baf20 2024-09-15T22:09:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.523+0000 7fb4abfff640 1 -- 172.21.15.78:0/707906392 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb4b801b070 con 0x7fb4c40baf20 2024-09-15T22:09:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.524+0000 7fb4abfff640 1 --2- 172.21.15.78:0/707906392 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb4b006c2e0 0x7fb4b006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.524+0000 7fb4abfff640 1 -- 172.21.15.78:0/707906392 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb4b808a990 con 0x7fb4c40baf20 2024-09-15T22:09:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.524+0000 7fb4c37fe640 1 --2- 172.21.15.78:0/707906392 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb4b006c2e0 0x7fb4b006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.524+0000 7fb4c37fe640 1 --2- 172.21.15.78:0/707906392 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb4b006c2e0 0x7fb4b006e7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4034000 tx=0x7fb4b402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:42.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.528+0000 7fb4abfff640 1 -- 172.21.15.78:0/707906392 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4c4147db0 con 0x7fb4c40baf20 2024-09-15T22:09:42.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.727+0000 7fb4ca0f1640 1 -- 172.21.15.78:0/707906392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4c40b9250 con 0x7fb4c40baf20 2024-09-15T22:09:42.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.728+0000 7fb4abfff640 1 -- 172.21.15.78:0/707906392 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3574 (secure 0 0 0) 0x7fb4b8009e80 con 0x7fb4c40baf20 2024-09-15T22:09:42.730 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:42.730 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"btime":"2024-09-15T22:09:35:458988+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1036052633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1036052633},{"type":"v1","addr":"172.21.15.78:6835","nonce":1036052633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:09:16.727586+0000","modified":"2024-09-15T22:09:34.782979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6833/4038139714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":4038139714},{"type":"v1","addr":"172.21.15.175:6833","nonce":4038139714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-09-15T22:09:42.730 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2024-09-15T22:09:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.730+0000 7fb4ca0f1640 1 -- 172.21.15.78:0/707906392 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb4b006c2e0 msgr2=0x7fb4b006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.730+0000 7fb4ca0f1640 1 --2- 172.21.15.78:0/707906392 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb4b006c2e0 0x7fb4b006e7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4034000 tx=0x7fb4b402e000 comp rx=0 tx=0).stop 2024-09-15T22:09:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.730+0000 7fb4ca0f1640 1 -- 172.21.15.78:0/707906392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c40baf20 msgr2=0x7fb4c41dbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.730+0000 7fb4ca0f1640 1 --2- 172.21.15.78:0/707906392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c40baf20 0x7fb4c41dbd50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800c4b0 tx=0x7fb4b800c970 comp rx=0 tx=0).stop 2024-09-15T22:09:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.730+0000 7fb4ca0f1640 1 -- 172.21.15.78:0/707906392 shutdown_connections 2024-09-15T22:09:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.730+0000 7fb4ca0f1640 1 --2- 172.21.15.78:0/707906392 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fb4b006c2e0 0x7fb4b006e7a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.730+0000 7fb4ca0f1640 1 --2- 172.21.15.78:0/707906392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c4149720 0x7fb4c41dc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.730+0000 7fb4ca0f1640 1 --2- 172.21.15.78:0/707906392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c40baf20 0x7fb4c41dbd50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.730+0000 7fb4ca0f1640 1 --2- 172.21.15.78:0/707906392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4c40b7620 0x7fb4c4143f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.730+0000 7fb4ca0f1640 1 -- 172.21.15.78:0/707906392 >> 172.21.15.78:0/707906392 conn(0x7fb4c409d200 msgr2=0x7fb4c41476a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.730+0000 7fb4ca0f1640 1 -- 172.21.15.78:0/707906392 shutdown_connections 2024-09-15T22:09:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.730+0000 7fb4ca0f1640 1 -- 172.21.15.78:0/707906392 wait complete. 2024-09-15T22:09:42.743 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:09:42.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.838+0000 7f7a5c82e640 1 Processor -- start 2024-09-15T22:09:42.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.838+0000 7f7a5c82e640 1 -- start start 2024-09-15T22:09:42.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.839+0000 7f7a5c82e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a580ba270 0x7f7a580b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.839+0000 7f7a5c82e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a580b6c90 con 0x7f7a58141c30 2024-09-15T22:09:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.839+0000 7f7a5c82e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a580b7a80 con 0x7f7a581417f0 2024-09-15T22:09:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.839+0000 7f7a5c82e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7a581420e0 con 0x7f7a580ba270 2024-09-15T22:09:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.839+0000 7f7a56d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7a58141c30 0x7f7a580b8680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54814/0 (socket says 172.21.15.78:54814) 2024-09-15T22:09:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.839+0000 7f7a56d9d640 1 -- 172.21.15.78:0/1594313820 learned_addr learned my addr 172.21.15.78:0/1594313820 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5659c640 1 --2- 172.21.15.78:0/1594313820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a580ba270 0x7f7a580b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3821651704 0 0) 0x7f7a580b6c90 con 0x7f7a58141c30 2024-09-15T22:09:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a40003520 con 0x7f7a58141c30 2024-09-15T22:09:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3533944574 0 0) 0x7f7a4c001110 con 0x7f7a581417f0 2024-09-15T22:09:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a580b6c90 con 0x7f7a581417f0 2024-09-15T22:09:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2762062900 0 0) 0x7f7a40003520 con 0x7f7a58141c30 2024-09-15T22:09:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a580ba270 msgr2=0x7f7a580b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 --2- 172.21.15.78:0/1594313820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a580ba270 0x7f7a580b97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 >> v1:172.21.15.175:6789/0 conn(0x7f7a581417f0 legacy=0x7f7a580b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a580b8d90 con 0x7f7a58141c30 2024-09-15T22:09:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3961011974 0 0) 0x7f7a50001670 con 0x7f7a58141c30 2024-09-15T22:09:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 >> v1:172.21.15.78:6789/0 conn(0x7f7a58141c30 legacy=0x7f7a580b8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 --2- 172.21.15.78:0/1594313820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a40003b70 0x7f7a40003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 --2- 172.21.15.78:0/1594313820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a40004800 0x7f7a40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 --2- 172.21.15.78:0/1594313820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a580ba270 0x7f7a400052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7a581420e0 con 0x7f7a40003b70 2024-09-15T22:09:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4000bbc0 con 0x7f7a40004800 2024-09-15T22:09:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7a4000bdc0 con 0x7f7a580ba270 2024-09-15T22:09:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5659c640 1 --2- 172.21.15.78:0/1594313820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a40003b70 0x7f7a40003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a55d9b640 1 --2- 172.21.15.78:0/1594313820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a40004800 0x7f7a40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a56d9d640 1 --2- 172.21.15.78:0/1594313820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a580ba270 0x7f7a400052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5659c640 1 -- 172.21.15.78:0/1594313820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a580ba270 msgr2=0x7f7a400052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5659c640 1 --2- 172.21.15.78:0/1594313820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a580ba270 0x7f7a400052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5659c640 1 -- 172.21.15.78:0/1594313820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a40004800 msgr2=0x7f7a40004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5659c640 1 --2- 172.21.15.78:0/1594313820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a40004800 0x7f7a40004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.840+0000 7f7a5659c640 1 -- 172.21.15.78:0/1594313820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a40003520 con 0x7f7a40003b70 2024-09-15T22:09:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.841+0000 7f7a5659c640 1 --2- 172.21.15.78:0/1594313820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a40003b70 0x7f7a40003f70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009fc0 tx=0x7f7a40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bf4cfc0bb39d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.841+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48009c10 con 0x7f7a40003b70 2024-09-15T22:09:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.841+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a48036070 con 0x7f7a40003b70 2024-09-15T22:09:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.841+0000 7f7a5559a640 1 -- 172.21.15.78:0/1594313820 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48031880 con 0x7f7a40003b70 2024-09-15T22:09:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.842+0000 7f7a5c82e640 1 -- 172.21.15.78:0/1594313820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a40003b70 msgr2=0x7f7a40003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.842+0000 7f7a5c82e640 1 --2- 172.21.15.78:0/1594313820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a40003b70 0x7f7a40003f70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009fc0 tx=0x7f7a40005830 comp rx=0 tx=0).stop 2024-09-15T22:09:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.842+0000 7f7a56d9d640 1 -- 172.21.15.78:0/1594313820 reap_dead start 2024-09-15T22:09:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.842+0000 7f7a5c82e640 1 -- 172.21.15.78:0/1594313820 shutdown_connections 2024-09-15T22:09:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.842+0000 7f7a5c82e640 1 -- 172.21.15.78:0/1594313820 >> 172.21.15.78:0/1594313820 conn(0x7f7a58074ba0 msgr2=0x7f7a58074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.842+0000 7f7a5c82e640 1 -- 172.21.15.78:0/1594313820 shutdown_connections 2024-09-15T22:09:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.842+0000 7f7a5c82e640 1 -- 172.21.15.78:0/1594313820 wait complete. 2024-09-15T22:09:42.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.843+0000 7f7a5c82e640 1 Processor -- start 2024-09-15T22:09:42.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.843+0000 7f7a5c82e640 1 -- start start 2024-09-15T22:09:42.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a5c82e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a40003b70 0x7f7a580bc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a5c82e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a580bd220 0x7f7a58146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a5c82e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a581473d0 0x7f7a5813e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a5c82e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7a580b5190 con 0x7f7a581473d0 2024-09-15T22:09:42.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a5c82e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7a580b6f00 con 0x7f7a580bd220 2024-09-15T22:09:42.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a5c82e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7a580b74c0 con 0x7f7a40003b70 2024-09-15T22:09:42.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a56d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a581473d0 0x7f7a5813e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a56d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a581473d0 0x7f7a5813e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37336/0 (socket says 172.21.15.78:37336) 2024-09-15T22:09:42.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a56d9d640 1 -- 172.21.15.78:0/2330107779 learned_addr learned my addr 172.21.15.78:0/2330107779 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:42.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a55d9b640 1 --2- 172.21.15.78:0/2330107779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a580bd220 0x7f7a58146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a5659c640 1 --2- 172.21.15.78:0/2330107779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a40003b70 0x7f7a580bc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a56d9d640 1 -- 172.21.15.78:0/2330107779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a40003b70 msgr2=0x7f7a580bc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a56d9d640 1 --2- 172.21.15.78:0/2330107779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a40003b70 0x7f7a580bc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a56d9d640 1 -- 172.21.15.78:0/2330107779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a580bd220 msgr2=0x7f7a58146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a56d9d640 1 --2- 172.21.15.78:0/2330107779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a580bd220 0x7f7a58146e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a56d9d640 1 -- 172.21.15.78:0/2330107779 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a58147850 con 0x7f7a581473d0 2024-09-15T22:09:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a56d9d640 1 --2- 172.21.15.78:0/2330107779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a581473d0 0x7f7a5813e630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7a50001eb0 tx=0x7f7a50007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a46ffd640 1 -- 172.21.15.78:0/2330107779 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5001a070 con 0x7f7a581473d0 2024-09-15T22:09:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a46ffd640 1 -- 172.21.15.78:0/2330107779 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5000f630 con 0x7f7a581473d0 2024-09-15T22:09:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a5c82e640 1 -- 172.21.15.78:0/2330107779 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a580bd000 con 0x7f7a581473d0 2024-09-15T22:09:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a46ffd640 1 -- 172.21.15.78:0/2330107779 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5000fa00 con 0x7f7a581473d0 2024-09-15T22:09:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.844+0000 7f7a5c82e640 1 -- 172.21.15.78:0/2330107779 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a580bb440 con 0x7f7a581473d0 2024-09-15T22:09:42.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.845+0000 7f7a5c82e640 1 -- 172.21.15.78:0/2330107779 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a580b4a70 con 0x7f7a581473d0 2024-09-15T22:09:42.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.846+0000 7f7a46ffd640 1 -- 172.21.15.78:0/2330107779 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7a5001d070 con 0x7f7a581473d0 2024-09-15T22:09:42.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.846+0000 7f7a46ffd640 1 --2- 172.21.15.78:0/2330107779 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7a3806c2b0 0x7f7a3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:42.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.847+0000 7f7a5659c640 1 --2- 172.21.15.78:0/2330107779 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7a3806c2b0 0x7f7a3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:42.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.847+0000 7f7a46ffd640 1 -- 172.21.15.78:0/2330107779 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7a5008aba0 con 0x7f7a581473d0 2024-09-15T22:09:42.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.847+0000 7f7a5659c640 1 --2- 172.21.15.78:0/2330107779 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7a3806c2b0 0x7f7a3806e770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7a48035000 tx=0x7f7a4802f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:42.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:42.851+0000 7f7a46ffd640 1 -- 172.21.15.78:0/2330107779 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a58147850 con 0x7f7a581473d0 2024-09-15T22:09:43.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.050+0000 7f7a5c82e640 1 -- 172.21.15.78:0/2330107779 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a58145390 con 0x7f7a581473d0 2024-09-15T22:09:43.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.050+0000 7f7a46ffd640 1 -- 172.21.15.78:0/2330107779 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3574 (secure 0 0 0) 0x7f7a5008a070 con 0x7f7a581473d0 2024-09-15T22:09:43.052 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:43.052 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"btime":"2024-09-15T22:09:35:458988+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1036052633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1036052633},{"type":"v1","addr":"172.21.15.78:6835","nonce":1036052633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:09:16.727586+0000","modified":"2024-09-15T22:09:34.782979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6833/4038139714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":4038139714},{"type":"v1","addr":"172.21.15.175:6833","nonce":4038139714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-09-15T22:09:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2024-09-15T22:09:43.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.052+0000 7f7a5c82e640 1 -- 172.21.15.78:0/2330107779 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7a3806c2b0 msgr2=0x7f7a3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.052+0000 7f7a5c82e640 1 --2- 172.21.15.78:0/2330107779 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7a3806c2b0 0x7f7a3806e770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7a48035000 tx=0x7f7a4802f000 comp rx=0 tx=0).stop 2024-09-15T22:09:43.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.052+0000 7f7a5c82e640 1 -- 172.21.15.78:0/2330107779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a581473d0 msgr2=0x7f7a5813e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.052+0000 7f7a5c82e640 1 --2- 172.21.15.78:0/2330107779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a581473d0 0x7f7a5813e630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7a50001eb0 tx=0x7f7a50007430 comp rx=0 tx=0).stop 2024-09-15T22:09:43.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.052+0000 7f7a5c82e640 1 -- 172.21.15.78:0/2330107779 shutdown_connections 2024-09-15T22:09:43.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.052+0000 7f7a5c82e640 1 --2- 172.21.15.78:0/2330107779 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7a3806c2b0 0x7f7a3806e770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.052+0000 7f7a5c82e640 1 --2- 172.21.15.78:0/2330107779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a581473d0 0x7f7a5813e630 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.052+0000 7f7a5c82e640 1 --2- 172.21.15.78:0/2330107779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a580bd220 0x7f7a58146e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.052+0000 7f7a5c82e640 1 --2- 172.21.15.78:0/2330107779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a40003b70 0x7f7a580bc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.052+0000 7f7a5c82e640 1 -- 172.21.15.78:0/2330107779 >> 172.21.15.78:0/2330107779 conn(0x7f7a58074ba0 msgr2=0x7f7a58148e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:43.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.052+0000 7f7a5c82e640 1 -- 172.21.15.78:0/2330107779 shutdown_connections 2024-09-15T22:09:43.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.052+0000 7f7a5c82e640 1 -- 172.21.15.78:0/2330107779 wait complete. 2024-09-15T22:09:43.065 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:09:43.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.162+0000 7f459485e640 1 Processor -- start 2024-09-15T22:09:43.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.162+0000 7f459485e640 1 -- start start 2024-09-15T22:09:43.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.162+0000 7f459485e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f459009d1c0 0x7f4590148200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.162+0000 7f459485e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f45900b41c0 0x7f45900b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.162+0000 7f459485e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4590148740 con 0x7f459009c290 2024-09-15T22:09:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.162+0000 7f459485e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f459009e220 con 0x7f45900b41c0 2024-09-15T22:09:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.162+0000 7f459485e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4590148c90 con 0x7f459009d1c0 2024-09-15T22:09:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.162+0000 7f458ed9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f45900b41c0 0x7f45900b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.162+0000 7f458dd9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f459009c290 0x7f459013e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54828/0 (socket says 172.21.15.78:54828) 2024-09-15T22:09:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.163+0000 7f458dd9b640 1 -- 172.21.15.78:0/1016555567 learned_addr learned my addr 172.21.15.78:0/1016555567 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.163+0000 7f458e59c640 1 --2- 172.21.15.78:0/1016555567 >> v2:172.21.15.175:3300/0 conn(0x7f459009d1c0 0x7f4590148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.163+0000 7f458ed9d640 1 -- 172.21.15.78:0/1016555567 >> v2:172.21.15.175:3300/0 conn(0x7f459009d1c0 msgr2=0x7f4590148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.163+0000 7f458ed9d640 1 --2- 172.21.15.78:0/1016555567 >> v2:172.21.15.175:3300/0 conn(0x7f459009d1c0 0x7f4590148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.163+0000 7f458ed9d640 1 -- 172.21.15.78:0/1016555567 >> v1:172.21.15.78:6789/0 conn(0x7f459009c290 legacy=0x7f459013e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.163+0000 7f458ed9d640 1 -- 172.21.15.78:0/1016555567 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459013ef40 con 0x7f45900b41c0 2024-09-15T22:09:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.163+0000 7f458d59a640 1 -- 172.21.15.78:0/1016555567 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3469865012 0 0) 0x7f4590148740 con 0x7f459009c290 2024-09-15T22:09:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.163+0000 7f458ed9d640 1 --2- 172.21.15.78:0/1016555567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45900b41c0 0x7f45900b4650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f459006dc10 tx=0x7f458802c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157070f43c4e1bd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.164+0000 7f458d59a640 1 -- 172.21.15.78:0/1016555567 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588038070 con 0x7f45900b41c0 2024-09-15T22:09:43.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.164+0000 7f458d59a640 1 -- 172.21.15.78:0/1016555567 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4588009540 con 0x7f45900b41c0 2024-09-15T22:09:43.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.164+0000 7f458d59a640 1 -- 172.21.15.78:0/1016555567 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588009910 con 0x7f45900b41c0 2024-09-15T22:09:43.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.164+0000 7f459485e640 1 -- 172.21.15.78:0/1016555567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45900b41c0 msgr2=0x7f45900b4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.164+0000 7f459485e640 1 --2- 172.21.15.78:0/1016555567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45900b41c0 0x7f45900b4650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f459006dc10 tx=0x7f458802c760 comp rx=0 tx=0).stop 2024-09-15T22:09:43.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.164+0000 7f459485e640 1 -- 172.21.15.78:0/1016555567 shutdown_connections 2024-09-15T22:09:43.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.164+0000 7f459485e640 1 --2- 172.21.15.78:0/1016555567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45900b41c0 0x7f45900b4650 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.164+0000 7f459485e640 1 --2- 172.21.15.78:0/1016555567 >> v2:172.21.15.175:3300/0 conn(0x7f459009d1c0 0x7f4590148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.164+0000 7f459485e640 1 -- 172.21.15.78:0/1016555567 >> 172.21.15.78:0/1016555567 conn(0x7f459006c270 msgr2=0x7f459006c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:43.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.164+0000 7f459485e640 1 -- 172.21.15.78:0/1016555567 shutdown_connections 2024-09-15T22:09:43.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.164+0000 7f459485e640 1 -- 172.21.15.78:0/1016555567 wait complete. 2024-09-15T22:09:43.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.165+0000 7f459485e640 1 Processor -- start 2024-09-15T22:09:43.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.165+0000 7f459485e640 1 -- start start 2024-09-15T22:09:43.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f459485e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f459009c290 0x7f459006f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f459485e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f459009d1c0 0x7f4590141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f459485e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45900b41c0 0x7f45901d8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f459485e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f45900b3ca0 con 0x7f459009d1c0 2024-09-15T22:09:43.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f459485e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f45901489b0 con 0x7f45900b41c0 2024-09-15T22:09:43.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f459485e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4590074ba0 con 0x7f459009c290 2024-09-15T22:09:43.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f458dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f459009d1c0 0x7f4590141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f458dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f459009d1c0 0x7f4590141450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37350/0 (socket says 172.21.15.78:37350) 2024-09-15T22:09:43.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f458dd9b640 1 -- 172.21.15.78:0/2232885159 learned_addr learned my addr 172.21.15.78:0/2232885159 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:43.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f458ed9d640 1 --2- 172.21.15.78:0/2232885159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45900b41c0 0x7f45901d8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f458e59c640 1 --2- 172.21.15.78:0/2232885159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f459009c290 0x7f459006f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f458dd9b640 1 -- 172.21.15.78:0/2232885159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f459009c290 msgr2=0x7f459006f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f458dd9b640 1 --2- 172.21.15.78:0/2232885159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f459009c290 0x7f459006f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f458dd9b640 1 -- 172.21.15.78:0/2232885159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45900b41c0 msgr2=0x7f45901d8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f458dd9b640 1 --2- 172.21.15.78:0/2232885159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45900b41c0 0x7f45901d8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.166+0000 7f458dd9b640 1 -- 172.21.15.78:0/2232885159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4590070e30 con 0x7f459009d1c0 2024-09-15T22:09:43.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.167+0000 7f458dd9b640 1 --2- 172.21.15.78:0/2232885159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f459009d1c0 0x7f4590141450 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f457800c4b0 tx=0x7f457800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:43.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.167+0000 7f4586ffd640 1 -- 172.21.15.78:0/2232885159 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578018070 con 0x7f459009d1c0 2024-09-15T22:09:43.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.167+0000 7f4586ffd640 1 -- 172.21.15.78:0/2232885159 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4578007500 con 0x7f459009d1c0 2024-09-15T22:09:43.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.167+0000 7f459485e640 1 -- 172.21.15.78:0/2232885159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4590141d60 con 0x7f459009d1c0 2024-09-15T22:09:43.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.167+0000 7f4586ffd640 1 -- 172.21.15.78:0/2232885159 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578004a20 con 0x7f459009d1c0 2024-09-15T22:09:43.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.167+0000 7f459485e640 1 -- 172.21.15.78:0/2232885159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45900710a0 con 0x7f459009d1c0 2024-09-15T22:09:43.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.168+0000 7f459485e640 1 -- 172.21.15.78:0/2232885159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45900b4630 con 0x7f459009d1c0 2024-09-15T22:09:43.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.169+0000 7f4586ffd640 1 -- 172.21.15.78:0/2232885159 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f457801b070 con 0x7f459009d1c0 2024-09-15T22:09:43.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.169+0000 7f4586ffd640 1 --2- 172.21.15.78:0/2232885159 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f457006c2b0 0x7f457006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.169+0000 7f4586ffd640 1 -- 172.21.15.78:0/2232885159 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f457808a990 con 0x7f459009d1c0 2024-09-15T22:09:43.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.169+0000 7f458e59c640 1 --2- 172.21.15.78:0/2232885159 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f457006c2b0 0x7f457006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.169+0000 7f458e59c640 1 --2- 172.21.15.78:0/2232885159 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f457006c2b0 0x7f457006e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4580009b40 tx=0x7f4580009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:43.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.173+0000 7f4586ffd640 1 -- 172.21.15.78:0/2232885159 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f45780588c0 con 0x7f459009d1c0 2024-09-15T22:09:43.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.338+0000 7f459485e640 1 -- 172.21.15.78:0/2232885159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f459013c740 con 0x7f459009d1c0 2024-09-15T22:09:43.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.339+0000 7f4586ffd640 1 -- 172.21.15.78:0/2232885159 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7f457805cbc0 con 0x7f459009d1c0 2024-09-15T22:09:43.341 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:43.342 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"34e44e87-1d1a-416f-b208-c16e07980ff5","created":"2024-09-15T22:08:53.842443+0000","modified":"2024-09-15T22:09:21.780555+0000","last_up_change":"2024-09-15T22:09:04.830042+0000","last_in_change":"2024-09-15T22:08:55.864039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:05.999373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:14.532061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:15.710676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:09:19.437681+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"71eb9af6-bf66-4450-a5d1-d4a81f71f95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6817","nonce":3548923409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6819","nonce":3548923409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6823","nonce":3548923409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6821","nonce":3548923409}]},"public_addr":"172.21.15.78:6817/3548923409","cluster_addr":"172.21.15.78:6819/3548923409","heartbeat_back_addr":"172.21.15.78:6823/3548923409","heartbeat_front_addr":"172.21.15.78:6821/3548923409","state":["exists","up"]},{"osd":1,"uuid":"f0070f6d-7998-4ad3-b597-e5777e61d503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6809","nonce":1233827941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6811","nonce":1233827941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6815","nonce":1233827941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6813","nonce":1233827941}]},"public_addr":"172.21.15.78:6809/1233827941","cluster_addr":"172.21.15.78:6811/1233827941","heartbeat_back_addr":"172.21.15.78:6815/1233827941","heartbeat_front_addr":"172.21.15.78:6813/1233827941","state":["exists","up"]},{"osd":2,"uuid":"6d9c91c7-2c8a-48f9-9bef-67ea7320980e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6825","nonce":636523247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6827","nonce":636523247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6831","nonce":636523247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6829","nonce":636523247}]},"public_addr":"172.21.15.78:6825/636523247","cluster_addr":"172.21.15.78:6827/636523247","heartbeat_back_addr":"172.21.15.78:6831/636523247","heartbeat_front_addr":"172.21.15.78:6829/636523247","state":["exists","up"]},{"osd":3,"uuid":"943e38fb-b450-48c0-8f01-d381b0b8e313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6801","nonce":1841812488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6803","nonce":1841812488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6807","nonce":1841812488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6805","nonce":1841812488}]},"public_addr":"172.21.15.78:6801/1841812488","cluster_addr":"172.21.15.78:6803/1841812488","heartbeat_back_addr":"172.21.15.78:6807/1841812488","heartbeat_front_addr":"172.21.15.78:6805/1841812488","state":["exists","up"]},{"osd":4,"uuid":"259f50f8-3223-450d-8cd1-d0d333c278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6817","nonce":1803357070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6819","nonce":1803357070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6823","nonce":1803357070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6821","nonce":1803357070}]},"public_addr":"172.21.15.175:6817/1803357070","cluster_addr":"172.21.15.175:6819/1803357070","heartbeat_back_addr":"172.21.15.175:6823/1803357070","heartbeat_front_addr":"172.21.15.175:6821/1803357070","state":["exists","up"]},{"osd":5,"uuid":"d70426cd-a39b-4a20-8c7b-bedc8352e303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6825","nonce":2221415707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6827","nonce":2221415707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6831","nonce":2221415707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6829","nonce":2221415707}]},"public_addr":"172.21.15.175:6825/2221415707","cluster_addr":"172.21.15.175:6827/2221415707","heartbeat_back_addr":"172.21.15.175:6831/2221415707","heartbeat_front_addr":"172.21.15.175:6829/2221415707","state":["exists","up"]},{"osd":6,"uuid":"95b9ed3a-cbfc-45a5-8967-88db9da099ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6801","nonce":1974018373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6803","nonce":1974018373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6807","nonce":1974018373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6805","nonce":1974018373}]},"public_addr":"172.21.15.175:6801/1974018373","cluster_addr":"172.21.15.175:6803/1974018373","heartbeat_back_addr":"172.21.15.175:6807/1974018373","heartbeat_front_addr":"172.21.15.175:6805/1974018373","state":["exists","up"]},{"osd":7,"uuid":"5fc56286-91e9-4a13-b161-ad7d30fc0119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6809","nonce":2386415083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6811","nonce":2386415083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6815","nonce":2386415083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6813","nonce":2386415083}]},"public_addr":"172.21.15.175:6809/2386415083","cluster_addr":"172.21.15.175:6811/2386415083","heartbeat_back_addr":"172.21.15.175:6815/2386415083","heartbeat_front_addr":"172.21.15.175:6813/2386415083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.191845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.871482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.594323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.463568+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.398880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.490112+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.119097+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.677350+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:09:43.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.341+0000 7f459485e640 1 -- 172.21.15.78:0/2232885159 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f457006c2b0 msgr2=0x7f457006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.341+0000 7f459485e640 1 --2- 172.21.15.78:0/2232885159 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f457006c2b0 0x7f457006e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4580009b40 tx=0x7f4580009190 comp rx=0 tx=0).stop 2024-09-15T22:09:43.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.341+0000 7f459485e640 1 -- 172.21.15.78:0/2232885159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f459009d1c0 msgr2=0x7f4590141450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.341+0000 7f459485e640 1 --2- 172.21.15.78:0/2232885159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f459009d1c0 0x7f4590141450 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f457800c4b0 tx=0x7f457800c970 comp rx=0 tx=0).stop 2024-09-15T22:09:43.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.341+0000 7f459485e640 1 -- 172.21.15.78:0/2232885159 shutdown_connections 2024-09-15T22:09:43.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.341+0000 7f459485e640 1 --2- 172.21.15.78:0/2232885159 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f457006c2b0 0x7f457006e770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.341+0000 7f459485e640 1 --2- 172.21.15.78:0/2232885159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45900b41c0 0x7f45901d8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.341+0000 7f459485e640 1 --2- 172.21.15.78:0/2232885159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f459009d1c0 0x7f4590141450 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.341+0000 7f459485e640 1 --2- 172.21.15.78:0/2232885159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f459009c290 0x7f459006f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.341+0000 7f459485e640 1 -- 172.21.15.78:0/2232885159 >> 172.21.15.78:0/2232885159 conn(0x7f459006c270 msgr2=0x7f45900b9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:43.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.341+0000 7f459485e640 1 -- 172.21.15.78:0/2232885159 shutdown_connections 2024-09-15T22:09:43.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.341+0000 7f459485e640 1 -- 172.21.15.78:0/2232885159 wait complete. 2024-09-15T22:09:43.355 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:09:43.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.451+0000 7f45dbff6640 1 Processor -- start 2024-09-15T22:09:43.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.451+0000 7f45dbff6640 1 -- start start 2024-09-15T22:09:43.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45dbff6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f45d409d1c0 0x7f45d4148200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45dbff6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d409c290 0x7f45d413e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45dbff6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f45d40b41c0 0x7f45d40b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45dbff6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f45d409e220 con 0x7f45d409d1c0 2024-09-15T22:09:43.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45dbff6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f45d4148c90 con 0x7f45d40b41c0 2024-09-15T22:09:43.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45dbff6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f45d4148740 con 0x7f45d409c290 2024-09-15T22:09:43.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45d9d92640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f45d409d1c0 0x7f45d4148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45d9d92640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f45d409d1c0 0x7f45d4148200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37354/0 (socket says 172.21.15.78:37354) 2024-09-15T22:09:43.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45d9d92640 1 -- 172.21.15.78:0/3559061928 learned_addr learned my addr 172.21.15.78:0/3559061928 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:43.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45da593640 1 --2- 172.21.15.78:0/3559061928 >> v2:172.21.15.175:3300/0 conn(0x7f45d40b41c0 0x7f45d40b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45d9591640 1 --2- 172.21.15.78:0/3559061928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d409c290 0x7f45d413e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45d9d92640 1 -- 172.21.15.78:0/3559061928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d409c290 msgr2=0x7f45d413e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:43.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45d9d92640 1 --2- 172.21.15.78:0/3559061928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d409c290 0x7f45d413e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45d9d92640 1 -- 172.21.15.78:0/3559061928 >> v2:172.21.15.175:3300/0 conn(0x7f45d40b41c0 msgr2=0x7f45d40b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:43.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45d9d92640 1 --2- 172.21.15.78:0/3559061928 >> v2:172.21.15.175:3300/0 conn(0x7f45d40b41c0 0x7f45d40b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45d9d92640 1 -- 172.21.15.78:0/3559061928 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d409d5a0 con 0x7f45d409d1c0 2024-09-15T22:09:43.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.452+0000 7f45d9591640 1 --2- 172.21.15.78:0/3559061928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d409c290 0x7f45d413e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:43.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.453+0000 7f45d9d92640 1 --2- 172.21.15.78:0/3559061928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d409d1c0 0x7f45d4148200 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f45d40b6bf0 tx=0x7f45d002a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5071aa936b262240 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:43.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.453+0000 7f45d8d90640 1 -- 172.21.15.78:0/3559061928 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d0036070 con 0x7f45d409d1c0 2024-09-15T22:09:43.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.453+0000 7f45d8d90640 1 -- 172.21.15.78:0/3559061928 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d0031600 con 0x7f45d409d1c0 2024-09-15T22:09:43.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.453+0000 7f45d8d90640 1 -- 172.21.15.78:0/3559061928 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d00319d0 con 0x7f45d409d1c0 2024-09-15T22:09:43.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.453+0000 7f45dbff6640 1 -- 172.21.15.78:0/3559061928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d409d1c0 msgr2=0x7f45d4148200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.453+0000 7f45dbff6640 1 --2- 172.21.15.78:0/3559061928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d409d1c0 0x7f45d4148200 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f45d40b6bf0 tx=0x7f45d002a5b0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.453+0000 7f45dbff6640 1 -- 172.21.15.78:0/3559061928 shutdown_connections 2024-09-15T22:09:43.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.453+0000 7f45dbff6640 1 --2- 172.21.15.78:0/3559061928 >> v2:172.21.15.175:3300/0 conn(0x7f45d40b41c0 0x7f45d40b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.453+0000 7f45dbff6640 1 --2- 172.21.15.78:0/3559061928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d409c290 0x7f45d413e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.453+0000 7f45dbff6640 1 --2- 172.21.15.78:0/3559061928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d409d1c0 0x7f45d4148200 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.453+0000 7f45dbff6640 1 -- 172.21.15.78:0/3559061928 >> 172.21.15.78:0/3559061928 conn(0x7f45d406c270 msgr2=0x7f45d406c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:43.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.454+0000 7f45dbff6640 1 -- 172.21.15.78:0/3559061928 shutdown_connections 2024-09-15T22:09:43.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.454+0000 7f45dbff6640 1 -- 172.21.15.78:0/3559061928 wait complete. 2024-09-15T22:09:43.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.454+0000 7f45dbff6640 1 Processor -- start 2024-09-15T22:09:43.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45dbff6640 1 -- start start 2024-09-15T22:09:43.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45dbff6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d409c290 0x7f45d40b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45dbff6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d409d1c0 0x7f45d41419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45dbff6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d40b41c0 0x7f45d413a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45dbff6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f45d413ed70 con 0x7f45d409c290 2024-09-15T22:09:43.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45dbff6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f45d40b3ca0 con 0x7f45d40b41c0 2024-09-15T22:09:43.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45dbff6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f45d413eef0 con 0x7f45d409d1c0 2024-09-15T22:09:43.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45d9d92640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d409c290 0x7f45d40b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45d9d92640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d409c290 0x7f45d40b94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37360/0 (socket says 172.21.15.78:37360) 2024-09-15T22:09:43.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45d9d92640 1 -- 172.21.15.78:0/1184767136 learned_addr learned my addr 172.21.15.78:0/1184767136 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:43.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45d9591640 1 --2- 172.21.15.78:0/1184767136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d409d1c0 0x7f45d41419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45da593640 1 --2- 172.21.15.78:0/1184767136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d40b41c0 0x7f45d413a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45d9d92640 1 -- 172.21.15.78:0/1184767136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d409d1c0 msgr2=0x7f45d41419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45d9d92640 1 --2- 172.21.15.78:0/1184767136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d409d1c0 0x7f45d41419c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45d9d92640 1 -- 172.21.15.78:0/1184767136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d40b41c0 msgr2=0x7f45d413a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45d9d92640 1 --2- 172.21.15.78:0/1184767136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d40b41c0 0x7f45d413a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.455+0000 7f45d9d92640 1 -- 172.21.15.78:0/1184767136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d41428f0 con 0x7f45d409c290 2024-09-15T22:09:43.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.456+0000 7f45d9d92640 1 --2- 172.21.15.78:0/1184767136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d409c290 0x7f45d40b94f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f45d0034040 tx=0x7f45d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:43.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.456+0000 7f45ca7fc640 1 -- 172.21.15.78:0/1184767136 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d0036050 con 0x7f45d409c290 2024-09-15T22:09:43.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.456+0000 7f45ca7fc640 1 -- 172.21.15.78:0/1184767136 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d0042070 con 0x7f45d409c290 2024-09-15T22:09:43.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.456+0000 7f45dbff6640 1 -- 172.21.15.78:0/1184767136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d41447d0 con 0x7f45d409c290 2024-09-15T22:09:43.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.456+0000 7f45ca7fc640 1 -- 172.21.15.78:0/1184767136 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d0007c70 con 0x7f45d409c290 2024-09-15T22:09:43.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.456+0000 7f45dbff6640 1 -- 172.21.15.78:0/1184767136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d4142640 con 0x7f45d409c290 2024-09-15T22:09:43.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.457+0000 7f45dbff6640 1 -- 172.21.15.78:0/1184767136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d41481e0 con 0x7f45d409c290 2024-09-15T22:09:43.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.457+0000 7f45ca7fc640 1 -- 172.21.15.78:0/1184767136 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f45d0047460 con 0x7f45d409c290 2024-09-15T22:09:43.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.458+0000 7f45ca7fc640 1 --2- 172.21.15.78:0/1184767136 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f45b806c2b0 0x7f45b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.458+0000 7f45ca7fc640 1 -- 172.21.15.78:0/1184767136 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f45d00ac530 con 0x7f45d409c290 2024-09-15T22:09:43.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.458+0000 7f45d9591640 1 --2- 172.21.15.78:0/1184767136 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f45b806c2b0 0x7f45b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.458+0000 7f45d9591640 1 --2- 172.21.15.78:0/1184767136 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f45b806c2b0 0x7f45b806e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f45d406cb70 tx=0x7f45c4004730 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:43.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.462+0000 7f45ca7fc640 1 -- 172.21.15.78:0/1184767136 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f45d007a430 con 0x7f45d409c290 2024-09-15T22:09:43.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.663+0000 7f45dbff6640 1 -- 172.21.15.78:0/1184767136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45d41416e0 con 0x7f45d409c290 2024-09-15T22:09:43.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.663+0000 7f45ca7fc640 1 -- 172.21.15.78:0/1184767136 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3574 (secure 0 0 0) 0x7f45d007e730 con 0x7f45d409c290 2024-09-15T22:09:43.666 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:09:43.666 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"btime":"2024-09-15T22:09:35:458988+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1036052633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1036052633},{"type":"v1","addr":"172.21.15.78:6835","nonce":1036052633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:09:16.727586+0000","modified":"2024-09-15T22:09:34.782979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6833/4038139714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":4038139714},{"type":"v1","addr":"172.21.15.175:6833","nonce":4038139714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-09-15T22:09:43.666 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2024-09-15T22:09:43.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.667+0000 7f45dbff6640 1 -- 172.21.15.78:0/1184767136 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f45b806c2b0 msgr2=0x7f45b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.667+0000 7f45dbff6640 1 --2- 172.21.15.78:0/1184767136 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f45b806c2b0 0x7f45b806e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f45d406cb70 tx=0x7f45c4004730 comp rx=0 tx=0).stop 2024-09-15T22:09:43.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.667+0000 7f45dbff6640 1 -- 172.21.15.78:0/1184767136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d409c290 msgr2=0x7f45d40b94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.667+0000 7f45dbff6640 1 --2- 172.21.15.78:0/1184767136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d409c290 0x7f45d40b94f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f45d0034040 tx=0x7f45d0004a40 comp rx=0 tx=0).stop 2024-09-15T22:09:43.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.667+0000 7f45dbff6640 1 -- 172.21.15.78:0/1184767136 shutdown_connections 2024-09-15T22:09:43.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.667+0000 7f45dbff6640 1 --2- 172.21.15.78:0/1184767136 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f45b806c2b0 0x7f45b806e770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.667+0000 7f45dbff6640 1 --2- 172.21.15.78:0/1184767136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d40b41c0 0x7f45d413a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.667+0000 7f45dbff6640 1 --2- 172.21.15.78:0/1184767136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d409d1c0 0x7f45d41419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.667+0000 7f45dbff6640 1 --2- 172.21.15.78:0/1184767136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45d409c290 0x7f45d40b94f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.667+0000 7f45dbff6640 1 -- 172.21.15.78:0/1184767136 >> 172.21.15.78:0/1184767136 conn(0x7f45d406c270 msgr2=0x7f45d41cfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:43.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.667+0000 7f45dbff6640 1 -- 172.21.15.78:0/1184767136 shutdown_connections 2024-09-15T22:09:43.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.667+0000 7f45dbff6640 1 -- 172.21.15.78:0/1184767136 wait complete. 2024-09-15T22:09:43.880 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:09:16.727586+0000', 'modified': '2024-09-15T22:09:34.782979+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6833/4038139714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 4038139714}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 4038139714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4267, 'qdb_cluster': [4267]} 2024-09-15T22:09:43.880 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:09:43.880 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-15T22:09:43.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.978+0000 7fc05b733640 1 Processor -- start 2024-09-15T22:09:43.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.978+0000 7fc05b733640 1 -- start start 2024-09-15T22:09:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.979+0000 7fc05b733640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc0540b4fb0 0x7fc054074e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.979+0000 7fc05b733640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0540b6a50 0x7fc054075380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.979+0000 7fc05b733640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0540b5390 con 0x7fc054141a30 2024-09-15T22:09:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.979+0000 7fc05b733640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fc0540b62e0 con 0x7fc0540b4fb0 2024-09-15T22:09:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.979+0000 7fc05b733640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc0541486d0 con 0x7fc0540b6a50 2024-09-15T22:09:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.979+0000 7fc0594cf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc0540b4fb0 0x7fc054074e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.979+0000 7fc059cd0640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc054141a30 0x7fc054141ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54832/0 (socket says 172.21.15.78:54832) 2024-09-15T22:09:43.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.979+0000 7fc059cd0640 1 -- 172.21.15.78:0/480237928 learned_addr learned my addr 172.21.15.78:0/480237928 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:09:43.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.979+0000 7fc0594cf640 1 --2- 172.21.15.78:0/480237928 >> v2:172.21.15.78:3300/0 conn(0x7fc0540b4fb0 0x7fc054074e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37366/0 (socket says 172.21.15.78:37366) 2024-09-15T22:09:43.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.979+0000 7fc0594cf640 1 -- 172.21.15.78:0/480237928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0540b6a50 msgr2=0x7fc054075380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:43.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.979+0000 7fc0594cf640 1 --2- 172.21.15.78:0/480237928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0540b6a50 0x7fc054075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.979+0000 7fc0594cf640 1 -- 172.21.15.78:0/480237928 >> v1:172.21.15.78:6789/0 conn(0x7fc054141a30 legacy=0x7fc054141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.979+0000 7fc0594cf640 1 -- 172.21.15.78:0/480237928 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0541489b0 con 0x7fc0540b4fb0 2024-09-15T22:09:43.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.979+0000 7fc053fff640 1 -- 172.21.15.78:0/480237928 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3945023765 0 0) 0x7fc0540b5390 con 0x7fc054141a30 2024-09-15T22:09:43.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.980+0000 7fc0594cf640 1 --2- 172.21.15.78:0/480237928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0540b4fb0 0x7fc054074e40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0097a0 tx=0x7fc04c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63acfdb0560928a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:43.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.980+0000 7fc053fff640 1 -- 172.21.15.78:0/480237928 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c037070 con 0x7fc0540b4fb0 2024-09-15T22:09:43.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.980+0000 7fc053fff640 1 -- 172.21.15.78:0/480237928 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc04c032440 con 0x7fc0540b4fb0 2024-09-15T22:09:43.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.980+0000 7fc053fff640 1 -- 172.21.15.78:0/480237928 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c032810 con 0x7fc0540b4fb0 2024-09-15T22:09:43.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.981+0000 7fc05b733640 1 -- 172.21.15.78:0/480237928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0540b4fb0 msgr2=0x7fc054074e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.981+0000 7fc05b733640 1 --2- 172.21.15.78:0/480237928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0540b4fb0 0x7fc054074e40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0097a0 tx=0x7fc04c02a1a0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.981+0000 7fc05b733640 1 -- 172.21.15.78:0/480237928 shutdown_connections 2024-09-15T22:09:43.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.981+0000 7fc05b733640 1 --2- 172.21.15.78:0/480237928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0540b6a50 0x7fc054075380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.981+0000 7fc05b733640 1 --2- 172.21.15.78:0/480237928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0540b4fb0 0x7fc054074e40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.981+0000 7fc05b733640 1 -- 172.21.15.78:0/480237928 >> 172.21.15.78:0/480237928 conn(0x7fc05409c0f0 msgr2=0x7fc05409c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:43.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.981+0000 7fc05b733640 1 -- 172.21.15.78:0/480237928 shutdown_connections 2024-09-15T22:09:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.981+0000 7fc05b733640 1 -- 172.21.15.78:0/480237928 wait complete. 2024-09-15T22:09:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.982+0000 7fc05b733640 1 Processor -- start 2024-09-15T22:09:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.982+0000 7fc05b733640 1 -- start start 2024-09-15T22:09:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.982+0000 7fc05b733640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0540b4fb0 0x7fc054071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.982+0000 7fc05b733640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc054141a30 0x7fc0541dd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.982+0000 7fc05b733640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0541dde40 0x7fc05413e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.982+0000 7fc05b733640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc0541482c0 con 0x7fc054141a30 2024-09-15T22:09:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.982+0000 7fc05b733640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc05409ce80 con 0x7fc0540b4fb0 2024-09-15T22:09:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.982+0000 7fc05b733640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc054148440 con 0x7fc0541dde40 2024-09-15T22:09:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.982+0000 7fc058cce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc054141a30 0x7fc0541dd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.982+0000 7fc058cce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc054141a30 0x7fc0541dd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37370/0 (socket says 172.21.15.78:37370) 2024-09-15T22:09:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.982+0000 7fc058cce640 1 -- 172.21.15.78:0/1585359752 learned_addr learned my addr 172.21.15.78:0/1585359752 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.982+0000 7fc0594cf640 1 --2- 172.21.15.78:0/1585359752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0540b4fb0 0x7fc054071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.982+0000 7fc059cd0640 1 --2- 172.21.15.78:0/1585359752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0541dde40 0x7fc05413e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.983+0000 7fc058cce640 1 -- 172.21.15.78:0/1585359752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0541dde40 msgr2=0x7fc05413e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.983+0000 7fc058cce640 1 --2- 172.21.15.78:0/1585359752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0541dde40 0x7fc05413e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.983+0000 7fc058cce640 1 -- 172.21.15.78:0/1585359752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0540b4fb0 msgr2=0x7fc054071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.983+0000 7fc058cce640 1 --2- 172.21.15.78:0/1585359752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0540b4fb0 0x7fc054071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.983+0000 7fc058cce640 1 -- 172.21.15.78:0/1585359752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc054149370 con 0x7fc054141a30 2024-09-15T22:09:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.983+0000 7fc0594cf640 1 --2- 172.21.15.78:0/1585359752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0540b4fb0 0x7fc054071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:43.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.983+0000 7fc058cce640 1 --2- 172.21.15.78:0/1585359752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc054141a30 0x7fc0541dd900 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc048009fd0 tx=0x7fc04800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.983+0000 7fc051ffb640 1 -- 172.21.15.78:0/1585359752 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc048005e20 con 0x7fc054141a30 2024-09-15T22:09:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.983+0000 7fc051ffb640 1 -- 172.21.15.78:0/1585359752 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc048016070 con 0x7fc054141a30 2024-09-15T22:09:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.983+0000 7fc05b733640 1 -- 172.21.15.78:0/1585359752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0541e13b0 con 0x7fc054141a30 2024-09-15T22:09:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.983+0000 7fc051ffb640 1 -- 172.21.15.78:0/1585359752 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc048006250 con 0x7fc054141a30 2024-09-15T22:09:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.983+0000 7fc05b733640 1 -- 172.21.15.78:0/1585359752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0541e1080 con 0x7fc054141a30 2024-09-15T22:09:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.985+0000 7fc051ffb640 1 -- 172.21.15.78:0/1585359752 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc0480063f0 con 0x7fc054141a30 2024-09-15T22:09:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.985+0000 7fc051ffb640 1 --2- 172.21.15.78:0/1585359752 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc04006c2b0 0x7fc04006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.985+0000 7fc051ffb640 1 -- 172.21.15.78:0/1585359752 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc04808b400 con 0x7fc054141a30 2024-09-15T22:09:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.985+0000 7fc0594cf640 1 --2- 172.21.15.78:0/1585359752 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc04006c2b0 0x7fc04006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.985+0000 7fc0594cf640 1 --2- 172.21.15.78:0/1585359752 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc04006c2b0 0x7fc04006e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc04c034000 tx=0x7fc04c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.986+0000 7fc05e4c8740 1 Processor -- start 2024-09-15T22:09:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.986+0000 7fc05e4c8740 1 -- start start 2024-09-15T22:09:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.986+0000 7fc05e4c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a49aa0 0x557142a7b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.986+0000 7fc05e4c8740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a7be10 0x557142a858c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.986+0000 7fc05e4c8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a85e00 0x557142a86280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.986+0000 7fc05e4c8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5571429b1520 con 0x557142a85e00 2024-09-15T22:09:43.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.986+0000 7fc05e4c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5571429593e0 con 0x557142a49aa0 2024-09-15T22:09:43.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.986+0000 7fc05e4c8740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x5571429ad4e0 con 0x557142a7be10 2024-09-15T22:09:43.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.987+0000 7fc059cd0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a85e00 0x557142a86280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.987+0000 7fc059cd0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a85e00 0x557142a86280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37378/0 (socket says 172.21.15.78:37378) 2024-09-15T22:09:43.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.987+0000 7fc059cd0640 1 -- 172.21.15.78:0/1277398266 learned_addr learned my addr 172.21.15.78:0/1277398266 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:43.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.987+0000 7fc059cd0640 1 -- 172.21.15.78:0/1277398266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a7be10 msgr2=0x557142a858c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:43.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.987+0000 7fc059cd0640 1 --2- 172.21.15.78:0/1277398266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a7be10 0x557142a858c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.987+0000 7fc059cd0640 1 -- 172.21.15.78:0/1277398266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a49aa0 msgr2=0x557142a7b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:43.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.987+0000 7fc0594cf640 1 --2- 172.21.15.78:0/1277398266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a49aa0 0x557142a7b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.987+0000 7fc059cd0640 1 --2- 172.21.15.78:0/1277398266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a49aa0 0x557142a7b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.987+0000 7fc059cd0640 1 -- 172.21.15.78:0/1277398266 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571429742f0 con 0x557142a85e00 2024-09-15T22:09:43.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.987+0000 7fc059cd0640 1 --2- 172.21.15.78:0/1277398266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a85e00 0x557142a86280 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc044007480 tx=0x7fc044007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5504d91e0e827a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:43.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.987+0000 7fc03affd640 1 -- 172.21.15.78:0/1277398266 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044019070 con 0x557142a85e00 2024-09-15T22:09:43.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.987+0000 7fc03affd640 1 -- 172.21.15.78:0/1277398266 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc044001bf0 con 0x557142a85e00 2024-09-15T22:09:43.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.987+0000 7fc03affd640 1 -- 172.21.15.78:0/1277398266 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044001fc0 con 0x557142a85e00 2024-09-15T22:09:43.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.988+0000 7fc05e4c8740 1 -- 172.21.15.78:0/1277398266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a85e00 msgr2=0x557142a86280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.988+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/1277398266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a85e00 0x557142a86280 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc044007480 tx=0x7fc044007940 comp rx=0 tx=0).stop 2024-09-15T22:09:43.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.988+0000 7fc05e4c8740 1 -- 172.21.15.78:0/1277398266 shutdown_connections 2024-09-15T22:09:43.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.988+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/1277398266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a85e00 0x557142a86280 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.988+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/1277398266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a7be10 0x557142a858c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.988+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/1277398266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a49aa0 0x557142a7b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.988+0000 7fc05e4c8740 1 -- 172.21.15.78:0/1277398266 >> 172.21.15.78:0/1277398266 conn(0x557142a4b7b0 msgr2=0x557142a4df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.988+0000 7fc05e4c8740 1 -- 172.21.15.78:0/1277398266 shutdown_connections 2024-09-15T22:09:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.988+0000 7fc05e4c8740 1 -- 172.21.15.78:0/1277398266 wait complete. 2024-09-15T22:09:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.988+0000 7fc05e4c8740 1 -- start start 2024-09-15T22:09:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.988+0000 7fc05e4c8740 1 Processor -- start 2024-09-15T22:09:44.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.989+0000 7fc05e4c8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142a85490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.989+0000 7fc05e4c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a85e00 0x557142a64e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.989+0000 7fc05e4c8740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a78a00 0x557142a653b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.989+0000 7fc05e4c8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557142a7b440 con 0x557142a7be10 2024-09-15T22:09:44.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.989+0000 7fc05e4c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55714293a450 con 0x557142a85e00 2024-09-15T22:09:44.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.989+0000 7fc05e4c8740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x557142a4e610 con 0x557142a78a00 2024-09-15T22:09:44.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.989+0000 7fc05e4c8740 10 client.0 _ll_register_callbacks cb 0x5571426c3ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:09:44.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.989+0000 7fc0594cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142a85490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:44.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.989+0000 7fc0594cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142a85490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37380/0 (socket says 172.21.15.78:37380) 2024-09-15T22:09:44.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.989+0000 7fc0594cf640 1 -- 172.21.15.78:0/3953723808 learned_addr learned my addr 172.21.15.78:0/3953723808 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:44.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc058cce640 1 --2- 172.21.15.78:0/3953723808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a85e00 0x557142a64e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:44.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc059cd0640 1 --2- 172.21.15.78:0/3953723808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a78a00 0x557142a653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:44.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc0594cf640 1 -- 172.21.15.78:0/3953723808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a78a00 msgr2=0x557142a653b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:44.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc0594cf640 1 --2- 172.21.15.78:0/3953723808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a78a00 0x557142a653b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc0594cf640 1 -- 172.21.15.78:0/3953723808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a85e00 msgr2=0x557142a64e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:44.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc0594cf640 1 --2- 172.21.15.78:0/3953723808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a85e00 0x557142a64e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc0594cf640 1 -- 172.21.15.78:0/3953723808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571426c42d0 con 0x557142a7be10 2024-09-15T22:09:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc0594cf640 1 --2- 172.21.15.78:0/3953723808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142a85490 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0098c0 tx=0x7fc04c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411f7d63f04572a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc033fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-15T22:09:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc033fff640 1 -- 172.21.15.78:0/3953723808 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c04b030 con 0x557142a7be10 2024-09-15T22:09:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc033fff640 1 -- 172.21.15.78:0/3953723808 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc04c003ce0 con 0x557142a7be10 2024-09-15T22:09:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3953723808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc044001bf0 con 0x557142a7be10 2024-09-15T22:09:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc033fff640 1 -- 172.21.15.78:0/3953723808 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc04c057050 con 0x557142a7be10 2024-09-15T22:09:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc05e4c8740 10 client.4692 fetch_fsmap learned FSMap version 9 2024-09-15T22:09:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3953723808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55714278e6b0 con 0x557142a7be10 2024-09-15T22:09:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc033fff640 1 -- 172.21.15.78:0/3953723808 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc044001bf0 con 0x557142a7be10 2024-09-15T22:09:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc033fff640 1 -- 172.21.15.78:0/3953723808 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 9) ==== 2300+0+0 (secure 0 0 0) 0x7fc04c05a020 con 0x557142a7be10 2024-09-15T22:09:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc05e4c8740 10 client.4692 fetch_fsmap finished waiting for FSMap version 9 2024-09-15T22:09:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc05e4c8740 10 client.4692 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:09:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc05e4c8740 20 client.4692 populate_metadata read hostname 'smithi078' 2024-09-15T22:09:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3953723808 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x557142a902a0 0x557142a90680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc05e4c8740 4 client.4692 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:09:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.990+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3953723808 --> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571429bec50 con 0x557142a902a0 2024-09-15T22:09:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.991+0000 7fc058cce640 1 --2- 172.21.15.78:0/3953723808 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x557142a902a0 0x557142a90680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.991+0000 7fc058cce640 1 --2- 172.21.15.78:0/3953723808 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x557142a902a0 0x557142a90680 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34dbc8e73f5742f0 server_cookie=905fee09d28c4c87 in_seq=0 out_seq=0 2024-09-15T22:09:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.991+0000 7fc033fff640 10 client.4692 ms_handle_connect on v2:172.21.15.175:6832/4038139714 2024-09-15T22:09:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.992+0000 7fc033fff640 1 -- 172.21.15.78:0/3953723808 <== mds.0 v2:172.21.15.175:6832/4038139714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571429bec50 con 0x557142a902a0 2024-09-15T22:09:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.992+0000 7fc033fff640 10 client.4692 handle_command_reply: tid=0 2024-09-15T22:09:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.992+0000 7fc05e4c8740 1 client.4692 shutdown 2024-09-15T22:09:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.992+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3953723808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 msgr2=0x557142a85490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.992+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3953723808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142a85490 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0098c0 tx=0x7fc04c004730 comp rx=0 tx=0).stop 2024-09-15T22:09:44.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.992+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3953723808 shutdown_connections 2024-09-15T22:09:44.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.992+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3953723808 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x557142a902a0 0x557142a90680 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.992+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3953723808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a78a00 0x557142a653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.992+0000 7fc033fff640 0 client.4692 ms_handle_reset on v2:172.21.15.175:6832/4038139714 2024-09-15T22:09:44.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.992+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3953723808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a85e00 0x557142a64e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.992+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3953723808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142a85490 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.992+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3953723808 >> 172.21.15.78:0/3953723808 conn(0x557142a49aa0 msgr2=0x557142a4eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:44.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.992+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3953723808 shutdown_connections 2024-09-15T22:09:44.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.992+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3953723808 wait complete. 2024-09-15T22:09:44.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:43.992+0000 7fc05e4c8740 20 client.4692 trim_cache size 0 max 16384 2024-09-15T22:09:44.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.009+0000 7fc05e4c8740 1 Processor -- start 2024-09-15T22:09:44.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.009+0000 7fc05e4c8740 1 -- start start 2024-09-15T22:09:44.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc05e4c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a78a00 0x557142a85000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc05e4c8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142a48b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc05e4c8740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a85e00 0x557142a49040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc05e4c8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc0541eb120 con 0x557142a7be10 2024-09-15T22:09:44.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc05e4c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc054073f40 con 0x557142a78a00 2024-09-15T22:09:44.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc05e4c8740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x557142a78f90 con 0x557142a85e00 2024-09-15T22:09:44.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc058cce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142a48b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:44.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc058cce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142a48b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37394/0 (socket says 172.21.15.78:37394) 2024-09-15T22:09:44.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc058cce640 1 -- 172.21.15.78:0/3226283119 learned_addr learned my addr 172.21.15.78:0/3226283119 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:44.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc0594cf640 1 --2- 172.21.15.78:0/3226283119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a78a00 0x557142a85000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:44.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc059cd0640 1 --2- 172.21.15.78:0/3226283119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a85e00 0x557142a49040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:44.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc058cce640 1 -- 172.21.15.78:0/3226283119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a85e00 msgr2=0x557142a49040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:44.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc058cce640 1 --2- 172.21.15.78:0/3226283119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a85e00 0x557142a49040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc058cce640 1 -- 172.21.15.78:0/3226283119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a78a00 msgr2=0x557142a85000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:44.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc058cce640 1 --2- 172.21.15.78:0/3226283119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a78a00 0x557142a85000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc058cce640 1 -- 172.21.15.78:0/3226283119 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557142a452f0 con 0x557142a7be10 2024-09-15T22:09:44.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.010+0000 7fc059cd0640 1 --2- 172.21.15.78:0/3226283119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a85e00 0x557142a49040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:44.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.011+0000 7fc058cce640 1 --2- 172.21.15.78:0/3226283119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142a48b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc048059150 tx=0x7fc048004820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d0db3c3a8fbb61 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:44.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.011+0000 7fc03a7fc640 1 -- 172.21.15.78:0/3226283119 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0480711e0 con 0x557142a7be10 2024-09-15T22:09:44.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.011+0000 7fc03a7fc640 1 -- 172.21.15.78:0/3226283119 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc048071030 con 0x557142a7be10 2024-09-15T22:09:44.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.011+0000 7fc03a7fc640 1 -- 172.21.15.78:0/3226283119 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0480574c0 con 0x557142a7be10 2024-09-15T22:09:44.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.011+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3226283119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 msgr2=0x557142a48b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:44.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.011+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3226283119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142a48b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc048059150 tx=0x7fc048004820 comp rx=0 tx=0).stop 2024-09-15T22:09:44.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.011+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3226283119 shutdown_connections 2024-09-15T22:09:44.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.011+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3226283119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a85e00 0x557142a49040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.011+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3226283119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142a48b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.011+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3226283119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a78a00 0x557142a85000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.011+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3226283119 >> 172.21.15.78:0/3226283119 conn(0x557142a49aa0 msgr2=0x557142a65c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.011+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3226283119 shutdown_connections 2024-09-15T22:09:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.011+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3226283119 wait complete. 2024-09-15T22:09:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.012+0000 7fc05e4c8740 1 -- start start 2024-09-15T22:09:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.012+0000 7fc05e4c8740 1 Processor -- start 2024-09-15T22:09:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.012+0000 7fc05e4c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a78a00 0x557142a81630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.012+0000 7fc05e4c8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142af4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.012+0000 7fc05e4c8740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a85e00 0x557142af5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.012+0000 7fc05e4c8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557142a859d0 con 0x557142a7be10 2024-09-15T22:09:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.012+0000 7fc05e4c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557142a61fa0 con 0x557142a78a00 2024-09-15T22:09:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.012+0000 7fc05e4c8740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x557142a4ded0 con 0x557142a85e00 2024-09-15T22:09:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc05e4c8740 10 client.0 _ll_register_callbacks cb 0x7fc04c035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:09:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc058cce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142af4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc058cce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142af4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37404/0 (socket says 172.21.15.78:37404) 2024-09-15T22:09:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc058cce640 1 -- 172.21.15.78:0/3343906620 learned_addr learned my addr 172.21.15.78:0/3343906620 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc058cce640 1 -- 172.21.15.78:0/3343906620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a85e00 msgr2=0x557142af5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc058cce640 1 --2- 172.21.15.78:0/3343906620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a85e00 0x557142af5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc058cce640 1 -- 172.21.15.78:0/3343906620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a78a00 msgr2=0x557142a81630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc058cce640 1 --2- 172.21.15.78:0/3343906620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a78a00 0x557142a81630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc058cce640 1 -- 172.21.15.78:0/3343906620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557142afea20 con 0x557142a7be10 2024-09-15T22:09:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc058cce640 1 --2- 172.21.15.78:0/3343906620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142af4cd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc04800bde0 tx=0x7fc04800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d015467f0990e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:44.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc033fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-15T22:09:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc033fff640 1 -- 172.21.15.78:0/3343906620 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc048089070 con 0x557142a7be10 2024-09-15T22:09:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc033fff640 1 -- 172.21.15.78:0/3343906620 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc048072e10 con 0x557142a7be10 2024-09-15T22:09:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3343906620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc048071030 con 0x557142a7be10 2024-09-15T22:09:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc033fff640 1 -- 172.21.15.78:0/3343906620 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc0480711e0 con 0x557142a7be10 2024-09-15T22:09:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc05e4c8740 10 client.4698 fetch_fsmap learned FSMap version 9 2024-09-15T22:09:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3343906620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x557142a61d40 con 0x557142a7be10 2024-09-15T22:09:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.013+0000 7fc033fff640 1 -- 172.21.15.78:0/3343906620 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc048071030 con 0x557142a7be10 2024-09-15T22:09:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.014+0000 7fc033fff640 1 -- 172.21.15.78:0/3343906620 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 9) ==== 2300+0+0 (secure 0 0 0) 0x7fc048055830 con 0x557142a7be10 2024-09-15T22:09:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.014+0000 7fc05e4c8740 10 client.4698 fetch_fsmap finished waiting for FSMap version 9 2024-09-15T22:09:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.014+0000 7fc05e4c8740 10 client.4698 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:09:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.014+0000 7fc05e4c8740 20 client.4698 populate_metadata read hostname 'smithi078' 2024-09-15T22:09:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.014+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3343906620 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x557142a61800 0x557142a4c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.014+0000 7fc05e4c8740 4 client.4698 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:09:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.014+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3343906620 --> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] -- command(tid 0: {"prefix": "status"}) -- 0x5571429b8fa0 con 0x557142a61800 2024-09-15T22:09:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.015+0000 7fc0594cf640 1 --2- 172.21.15.78:0/3343906620 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x557142a61800 0x557142a4c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:44.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.016+0000 7fc0594cf640 1 --2- 172.21.15.78:0/3343906620 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x557142a61800 0x557142a4c710 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80b50e07da86343b server_cookie=7dff7a14a753d28f in_seq=0 out_seq=0 2024-09-15T22:09:44.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.016+0000 7fc033fff640 10 client.4698 ms_handle_connect on v2:172.21.15.175:6832/4038139714 2024-09-15T22:09:44.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.017+0000 7fc033fff640 1 -- 172.21.15.78:0/3343906620 <== mds.0 v2:172.21.15.175:6832/4038139714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5571429b8fa0 con 0x557142a61800 2024-09-15T22:09:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.017+0000 7fc033fff640 10 client.4698 handle_command_reply: tid=0 2024-09-15T22:09:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.017+0000 7fc05e4c8740 1 client.4698 shutdown 2024-09-15T22:09:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.017+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3343906620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 msgr2=0x557142af4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.017+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3343906620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142af4cd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc04800bde0 tx=0x7fc04800bf90 comp rx=0 tx=0).stop 2024-09-15T22:09:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.017+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3343906620 shutdown_connections 2024-09-15T22:09:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.017+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3343906620 >> [v2:172.21.15.175:6832/4038139714,v1:172.21.15.175:6833/4038139714] conn(0x557142a61800 0x557142a4c710 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.017+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3343906620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557142a85e00 0x557142af5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.017+0000 7fc033fff640 0 client.4698 ms_handle_reset on v2:172.21.15.175:6832/4038139714 2024-09-15T22:09:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.017+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3343906620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557142a7be10 0x557142af4cd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.017+0000 7fc05e4c8740 1 --2- 172.21.15.78:0/3343906620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557142a78a00 0x557142a81630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.017+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3343906620 >> 172.21.15.78:0/3343906620 conn(0x557142a49aa0 msgr2=0x557142a83c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.017+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3343906620 shutdown_connections 2024-09-15T22:09:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.017+0000 7fc05e4c8740 1 -- 172.21.15.78:0/3343906620 wait complete. 2024-09-15T22:09:44.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.017+0000 7fc05e4c8740 20 client.4698 trim_cache size 0 max 16384 2024-09-15T22:09:44.028 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-15T22:09:44.028 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "34e44e87-1d1a-416f-b208-c16e07980ff5", 2024-09-15T22:09:44.028 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-15T22:09:44.028 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4267, 2024-09-15T22:09:44.029 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-15T22:09:44.029 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-15T22:09:44.029 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-15T22:09:44.029 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 26.628160473000001, 2024-09-15T22:09:44.029 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 9, 2024-09-15T22:09:44.029 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 25, 2024-09-15T22:09:44.029 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 25, 2024-09-15T22:09:44.029 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 32.645131352 2024-09-15T22:09:44.030 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-15T22:09:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.018+0000 7fc05b733640 1 -- 172.21.15.78:0/1585359752 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc04006c2b0 msgr2=0x7fc04006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.018+0000 7fc05b733640 1 --2- 172.21.15.78:0/1585359752 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc04006c2b0 0x7fc04006e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc04c034000 tx=0x7fc04c02e000 comp rx=0 tx=0).stop 2024-09-15T22:09:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.018+0000 7fc05b733640 1 -- 172.21.15.78:0/1585359752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc054141a30 msgr2=0x7fc0541dd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.018+0000 7fc05b733640 1 --2- 172.21.15.78:0/1585359752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc054141a30 0x7fc0541dd900 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc048009fd0 tx=0x7fc04800b8e0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.018+0000 7fc05b733640 1 -- 172.21.15.78:0/1585359752 shutdown_connections 2024-09-15T22:09:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.018+0000 7fc05b733640 1 --2- 172.21.15.78:0/1585359752 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc04006c2b0 0x7fc04006e770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.018+0000 7fc05b733640 1 --2- 172.21.15.78:0/1585359752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0541dde40 0x7fc05413e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.018+0000 7fc05b733640 1 --2- 172.21.15.78:0/1585359752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc054141a30 0x7fc0541dd900 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.018+0000 7fc05b733640 1 --2- 172.21.15.78:0/1585359752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0540b4fb0 0x7fc054071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.018+0000 7fc05b733640 1 -- 172.21.15.78:0/1585359752 >> 172.21.15.78:0/1585359752 conn(0x7fc05409c0f0 msgr2=0x7fc0540b8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:44.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.018+0000 7fc05b733640 1 -- 172.21.15.78:0/1585359752 shutdown_connections 2024-09-15T22:09:44.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.018+0000 7fc05b733640 1 -- 172.21.15.78:0/1585359752 wait complete. 2024-09-15T22:09:44.034 INFO:teuthology.run_tasks:Running task sequential... 2024-09-15T22:09:44.044 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-15T22:09:44.044 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-15T22:09:44.045 INFO:teuthology.task.print:Enabling mgr modules 2024-09-15T22:09:44.045 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-15T22:09:44.055 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-15T22:09:44.055 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-15T22:09:44.055 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-15T22:09:44.055 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:09:44.055 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:09:44.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:44.056 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-15T22:09:44.071 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-15T22:09:44.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:44.072 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:09:44.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:44.136 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2024-09-15T22:09:44.230 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-15T22:09:44.231 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-15T22:09:44.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:09:44.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.328+0000 7fd353966640 1 Processor -- start 2024-09-15T22:09:44.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.328+0000 7fd353966640 1 -- start start 2024-09-15T22:09:44.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd353966640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd34c0b6770 0x7fd34c0b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd353966640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34c09cc60 0x7fd34c14e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd353966640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd34c0b6b50 con 0x7fd34c0b5370 2024-09-15T22:09:44.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd353966640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fd34c0b5180 con 0x7fd34c0b6770 2024-09-15T22:09:44.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd353966640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd34c13e630 con 0x7fd34c09cc60 2024-09-15T22:09:44.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd351702640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd34c0b6770 0x7fd34c0b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:44.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd351702640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd34c0b6770 0x7fd34c0b4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37414/0 (socket says 172.21.15.78:37414) 2024-09-15T22:09:44.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd351702640 1 -- 172.21.15.78:0/1414808796 learned_addr learned my addr 172.21.15.78:0/1414808796 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:44.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd351702640 1 -- 172.21.15.78:0/1414808796 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34c09cc60 msgr2=0x7fd34c14e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:09:44.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd351f03640 1 --2- 172.21.15.78:0/1414808796 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34c09cc60 0x7fd34c14e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:44.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd351702640 1 --2- 172.21.15.78:0/1414808796 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34c09cc60 0x7fd34c14e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd351702640 1 -- 172.21.15.78:0/1414808796 >> v1:172.21.15.175:6789/0 conn(0x7fd34c0b5370 legacy=0x7fd34c13df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd351702640 1 -- 172.21.15.78:0/1414808796 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34c0aff50 con 0x7fd34c0b6770 2024-09-15T22:09:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd351f03640 1 --2- 172.21.15.78:0/1414808796 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34c09cc60 0x7fd34c14e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd351702640 1 --2- 172.21.15.78:0/1414808796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd34c0b6770 0x7fd34c0b4c40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009870 tx=0x7fd33c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e060bffcde396cc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd343fff640 1 -- 172.21.15.78:0/1414808796 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c037070 con 0x7fd34c0b6770 2024-09-15T22:09:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd343fff640 1 -- 172.21.15.78:0/1414808796 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33c032440 con 0x7fd34c0b6770 2024-09-15T22:09:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd343fff640 1 -- 172.21.15.78:0/1414808796 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c032810 con 0x7fd34c0b6770 2024-09-15T22:09:44.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd353966640 1 -- 172.21.15.78:0/1414808796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd34c0b6770 msgr2=0x7fd34c0b4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:44.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.330+0000 7fd353966640 1 --2- 172.21.15.78:0/1414808796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd34c0b6770 0x7fd34c0b4c40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009870 tx=0x7fd33c02a1c0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.331+0000 7fd353966640 1 -- 172.21.15.78:0/1414808796 shutdown_connections 2024-09-15T22:09:44.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.331+0000 7fd353966640 1 --2- 172.21.15.78:0/1414808796 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34c09cc60 0x7fd34c14e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.331+0000 7fd353966640 1 --2- 172.21.15.78:0/1414808796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd34c0b6770 0x7fd34c0b4c40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.331+0000 7fd353966640 1 -- 172.21.15.78:0/1414808796 >> 172.21.15.78:0/1414808796 conn(0x7fd34c06c270 msgr2=0x7fd34c06c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:44.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.331+0000 7fd353966640 1 -- 172.21.15.78:0/1414808796 shutdown_connections 2024-09-15T22:09:44.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.331+0000 7fd353966640 1 -- 172.21.15.78:0/1414808796 wait complete. 2024-09-15T22:09:44.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.332+0000 7fd353966640 1 Processor -- start 2024-09-15T22:09:44.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.332+0000 7fd353966640 1 -- start start 2024-09-15T22:09:44.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.332+0000 7fd353966640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34c09cc60 0x7fd34c073b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.332+0000 7fd353966640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd34c0b5370 0x7fd34c1e0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.332+0000 7fd353966640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd34c0b6770 0x7fd34c1e1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.332+0000 7fd353966640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c147540 con 0x7fd34c0b6770 2024-09-15T22:09:44.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.332+0000 7fd353966640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c1473c0 con 0x7fd34c0b5370 2024-09-15T22:09:44.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.332+0000 7fd353966640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd34c1476c0 con 0x7fd34c09cc60 2024-09-15T22:09:44.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.332+0000 7fd351f03640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd34c0b6770 0x7fd34c1e1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:44.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.332+0000 7fd351f03640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd34c0b6770 0x7fd34c1e1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37420/0 (socket says 172.21.15.78:37420) 2024-09-15T22:09:44.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.332+0000 7fd351f03640 1 -- 172.21.15.78:0/3510569687 learned_addr learned my addr 172.21.15.78:0/3510569687 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:09:44.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.332+0000 7fd351702640 1 --2- 172.21.15.78:0/3510569687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34c09cc60 0x7fd34c073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:44.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.332+0000 7fd350f01640 1 --2- 172.21.15.78:0/3510569687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd34c0b5370 0x7fd34c1e0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:44.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.333+0000 7fd351f03640 1 -- 172.21.15.78:0/3510569687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34c09cc60 msgr2=0x7fd34c073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:44.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.333+0000 7fd351f03640 1 --2- 172.21.15.78:0/3510569687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34c09cc60 0x7fd34c073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.333+0000 7fd351f03640 1 -- 172.21.15.78:0/3510569687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd34c0b5370 msgr2=0x7fd34c1e0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:44.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.333+0000 7fd351f03640 1 --2- 172.21.15.78:0/3510569687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd34c0b5370 0x7fd34c1e0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.333+0000 7fd351f03640 1 -- 172.21.15.78:0/3510569687 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34c0b09c0 con 0x7fd34c0b6770 2024-09-15T22:09:44.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.333+0000 7fd351f03640 1 --2- 172.21.15.78:0/3510569687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd34c0b6770 0x7fd34c1e1420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd34400ce80 tx=0x7fd34400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:44.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.333+0000 7fd341ffb640 1 -- 172.21.15.78:0/3510569687 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34401a070 con 0x7fd34c0b6770 2024-09-15T22:09:44.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.333+0000 7fd341ffb640 1 -- 172.21.15.78:0/3510569687 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd34400d880 con 0x7fd34c0b6770 2024-09-15T22:09:44.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.333+0000 7fd353966640 1 -- 172.21.15.78:0/3510569687 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34c0b1b80 con 0x7fd34c0b6770 2024-09-15T22:09:44.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.333+0000 7fd341ffb640 1 -- 172.21.15.78:0/3510569687 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34400dc70 con 0x7fd34c0b6770 2024-09-15T22:09:44.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.333+0000 7fd353966640 1 -- 172.21.15.78:0/3510569687 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd34c0b0570 con 0x7fd34c0b6770 2024-09-15T22:09:44.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.334+0000 7fd353966640 1 -- 172.21.15.78:0/3510569687 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd34c143ff0 con 0x7fd34c0b6770 2024-09-15T22:09:44.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.335+0000 7fd341ffb640 1 -- 172.21.15.78:0/3510569687 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd34401d070 con 0x7fd34c0b6770 2024-09-15T22:09:44.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.335+0000 7fd341ffb640 1 --2- 172.21.15.78:0/3510569687 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd33006c2b0 0x7fd33006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:44.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.335+0000 7fd341ffb640 1 -- 172.21.15.78:0/3510569687 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd34408be90 con 0x7fd34c0b6770 2024-09-15T22:09:44.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.335+0000 7fd351702640 1 --2- 172.21.15.78:0/3510569687 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd33006c2b0 0x7fd33006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:44.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.335+0000 7fd351702640 1 --2- 172.21.15.78:0/3510569687 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd33006c2b0 0x7fd33006e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd33c034000 tx=0x7fd33c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:44.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.339+0000 7fd341ffb640 1 -- 172.21.15.78:0/3510569687 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd344059d00 con 0x7fd34c0b6770 2024-09-15T22:09:44.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.540+0000 7fd353966640 1 -- 172.21.15.78:0/3510569687 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd34c0b4c20 con 0x7fd34c0b6770 2024-09-15T22:09:44.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.541+0000 7fd341ffb640 1 -- 172.21.15.78:0/3510569687 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fd34405e000 con 0x7fd34c0b6770 2024-09-15T22:09:44.542 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T22:09:44.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.543+0000 7fd353966640 1 -- 172.21.15.78:0/3510569687 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd33006c2b0 msgr2=0x7fd33006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:44.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.543+0000 7fd353966640 1 --2- 172.21.15.78:0/3510569687 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd33006c2b0 0x7fd33006e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd33c034000 tx=0x7fd33c02e000 comp rx=0 tx=0).stop 2024-09-15T22:09:44.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.543+0000 7fd353966640 1 -- 172.21.15.78:0/3510569687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd34c0b6770 msgr2=0x7fd34c1e1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:44.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.543+0000 7fd353966640 1 --2- 172.21.15.78:0/3510569687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd34c0b6770 0x7fd34c1e1420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd34400ce80 tx=0x7fd34400a710 comp rx=0 tx=0).stop 2024-09-15T22:09:44.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.543+0000 7fd353966640 1 -- 172.21.15.78:0/3510569687 shutdown_connections 2024-09-15T22:09:44.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.543+0000 7fd353966640 1 --2- 172.21.15.78:0/3510569687 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd33006c2b0 0x7fd33006e770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.543+0000 7fd353966640 1 --2- 172.21.15.78:0/3510569687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd34c0b6770 0x7fd34c1e1420 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.543+0000 7fd353966640 1 --2- 172.21.15.78:0/3510569687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd34c0b5370 0x7fd34c1e0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.543+0000 7fd353966640 1 --2- 172.21.15.78:0/3510569687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34c09cc60 0x7fd34c073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.543+0000 7fd353966640 1 -- 172.21.15.78:0/3510569687 >> 172.21.15.78:0/3510569687 conn(0x7fd34c06c270 msgr2=0x7fd34c0ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:44.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.543+0000 7fd353966640 1 -- 172.21.15.78:0/3510569687 shutdown_connections 2024-09-15T22:09:44.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44.543+0000 7fd353966640 1 -- 172.21.15.78:0/3510569687 wait complete. 2024-09-15T22:09:44.554 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:09:44.554 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:09:44.555 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-09-15T22:09:44.555 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:09:44.555 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:09:44.555 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:09:44.555 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:09:44.555 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:09:44.555 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:09:44.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:44.555 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-09-15T22:09:44.570 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:09:44.571 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:09:44.571 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:09:44.571 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:09:44.571 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-09-15T22:09:44.571 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:09:44.571 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:09:44.571 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:09:44.571 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-09-15T22:09:44.571 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:09:44.571 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:09:44.572 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-09-15T22:09:44.572 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:09:44.572 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:09:44.572 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:09:44.572 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-09-15T22:09:44.572 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:09:44.572 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42782sec preferred_lft 42782sec 2024-09-15T22:09:44.572 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link noprefixroute 2024-09-15T22:09:44.572 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:09:44.572 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:09:44.572 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:09:44.573 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-15T22:09:44.573 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:09:44.573 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2024-09-15T22:09:44.573 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2024-09-15T22:09:44.573 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:09:44.573 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-15T22:09:44.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:09:44.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:09:44.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:44.709 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:09:44.732 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-09-15T22:09:44.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:44.734 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-09-15T22:09:44.790 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-09-15T22:09:44.790 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:09:44.790 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:09:44.790 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:09:44.790 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:09:44.790 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:09:44.790 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-15T22:09:44.791 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:09:44.791 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:09:44.791 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:09:44.791 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-15T22:09:44.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:09:44.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:09:44.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:44.916 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-15T22:09:44.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:44.931 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2024-09-15T22:09:44.987 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:09:44.987 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-15T22:09:44.987 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:09:44.987 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-15T22:09:44.987 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-15T22:09:45.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:09:45.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:09:45.103 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-15T22:09:45.103 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:09:45.103 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-15T22:09:45.103 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-15T22:09:45.103 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:09:45.104 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-15T22:09:45.104 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-15T22:09:45.104 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-15T22:09:45.104 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-15T22:09:45.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:09:45.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:09:45.215 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:09:45.216 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-15T22:09:45.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2024-09-15T22:09:45.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:09:45.216 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-15T22:09:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:09:45.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:09:45.292 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T22:09:45.292 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:09:45.292 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:09:45.307 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:09:45.307 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:09:45.308 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:09:45.362 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2024-09-15T22:09:45.427 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:09:45.484 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2024-09-15T22:09:45.484 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2024-09-15T22:09:45.484 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2024-09-15T22:09:45.485 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2024-09-15T22:09:45.485 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2024-09-15T22:09:45.485 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2024-09-15T22:09:45.485 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2024-09-15T22:09:45.485 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2024-09-15T22:09:45.485 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2024-09-15T22:09:45.486 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2024-09-15T22:09:45.486 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2024-09-15T22:09:45.486 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/selinux 2024-09-15T22:09:45.486 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:09:45.486 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2024-09-15T22:09:45.487 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2024-09-15T22:09:45.487 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2024-09-15T22:09:45.487 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2024-09-15T22:09:45.487 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2024-09-15T22:09:45.487 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2024-09-15T22:09:45.487 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T22:09:45.487 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T22:09:45.488 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T22:09:45.488 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T22:09:45.488 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2024-09-15T22:09:45.488 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2024-09-15T22:09:45.488 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:09:45.488 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:09:45.489 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:09:45.489 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:09:45.489 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2024-09-15T22:09:45.489 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:09:45.489 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:09:45.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:45.490 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2024-09-15T22:09:45.540 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T22:09:45.540 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T22:09:45.582 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2024-09-15T22:09:45.606 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:09:45.663 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2024-09-15T22:09:45.663 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2024-09-15T22:09:45.663 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2024-09-15T22:09:45.663 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2024-09-15T22:09:45.663 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2024-09-15T22:09:45.663 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2024-09-15T22:09:45.663 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2024-09-15T22:09:45.663 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2024-09-15T22:09:45.663 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2024-09-15T22:09:45.663 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2024-09-15T22:09:45.663 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2024-09-15T22:09:45.664 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/selinux 2024-09-15T22:09:45.664 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:09:45.664 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2024-09-15T22:09:45.664 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2024-09-15T22:09:45.664 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2024-09-15T22:09:45.664 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2024-09-15T22:09:45.664 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2024-09-15T22:09:45.664 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2024-09-15T22:09:45.664 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T22:09:45.664 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T22:09:45.664 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T22:09:45.664 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T22:09:45.664 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2024-09-15T22:09:45.665 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2024-09-15T22:09:45.665 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:09:45.665 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:09:45.665 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:09:45.665 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:09:45.665 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2024-09-15T22:09:45.665 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:09:45.665 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:09:45.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:45.666 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2024-09-15T22:09:45.666 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:2024-09-15T22:09:45.662+0000 7f5d0400e480 -1 init, newargv = 0x55fde030bf10 newargc=15 2024-09-15T22:09:45.666 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[43838]: starting ceph client 2024-09-15T22:09:45.668 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[43838]: starting fuse 2024-09-15T22:09:45.682 INFO:teuthology.orchestra.run.smithi078.stdout:41 2024-09-15T22:09:45.682 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-15T22:09:45.682 DEBUG:teuthology.orchestra.run.smithi078:> sudo stdin-killer -- python3 -c ' 2024-09-15T22:09:45.682 DEBUG:teuthology.orchestra.run.smithi078:> import glob 2024-09-15T22:09:45.682 DEBUG:teuthology.orchestra.run.smithi078:> import re 2024-09-15T22:09:45.683 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-15T22:09:45.683 DEBUG:teuthology.orchestra.run.smithi078:> import subprocess 2024-09-15T22:09:45.683 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-15T22:09:45.683 DEBUG:teuthology.orchestra.run.smithi078:> def _find_admin_socket(client_name): 2024-09-15T22:09:45.683 DEBUG:teuthology.orchestra.run.smithi078:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T22:09:45.683 DEBUG:teuthology.orchestra.run.smithi078:> files = glob.glob(asok_path) 2024-09-15T22:09:45.683 DEBUG:teuthology.orchestra.run.smithi078:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T22:09:45.683 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-15T22:09:45.683 DEBUG:teuthology.orchestra.run.smithi078:> # Given a non-glob path, it better be there 2024-09-15T22:09:45.683 DEBUG:teuthology.orchestra.run.smithi078:> if "*" not in asok_path: 2024-09-15T22:09:45.683 DEBUG:teuthology.orchestra.run.smithi078:> assert(len(files) == 1) 2024-09-15T22:09:45.683 DEBUG:teuthology.orchestra.run.smithi078:> return files[0] 2024-09-15T22:09:45.684 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-15T22:09:45.684 DEBUG:teuthology.orchestra.run.smithi078:> for f in files: 2024-09-15T22:09:45.684 DEBUG:teuthology.orchestra.run.smithi078:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T22:09:45.684 DEBUG:teuthology.orchestra.run.smithi078:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T22:09:45.684 DEBUG:teuthology.orchestra.run.smithi078:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T22:09:45.684 DEBUG:teuthology.orchestra.run.smithi078:> contents = proc_f.read() 2024-09-15T22:09:45.684 DEBUG:teuthology.orchestra.run.smithi078:> if mountpoint in contents: 2024-09-15T22:09:45.684 DEBUG:teuthology.orchestra.run.smithi078:> return f 2024-09-15T22:09:45.684 DEBUG:teuthology.orchestra.run.smithi078:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T22:09:45.684 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-15T22:09:45.684 DEBUG:teuthology.orchestra.run.smithi078:> print(_find_admin_socket("client.0")) 2024-09-15T22:09:45.684 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-15T22:09:45.728 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:09:45.730 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:09:45.800 INFO:teuthology.orchestra.run.smithi078.stdout:/var/run/ceph/ceph-client.0.43838.asok 2024-09-15T22:09:45.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:09:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:09:45.811 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43838.asok 2024-09-15T22:09:45.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:45.811 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43838.asok status 2024-09-15T22:09:45.945 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-15T22:09:45.945 INFO:teuthology.orchestra.run.smithi078.stdout: "metadata": { 2024-09-15T22:09:45.945 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T22:09:45.945 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:09:45.945 INFO:teuthology.orchestra.run.smithi078.stdout: "entity_id": "0", 2024-09-15T22:09:45.945 INFO:teuthology.orchestra.run.smithi078.stdout: "hostname": "smithi078", 2024-09-15T22:09:45.945 INFO:teuthology.orchestra.run.smithi078.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T22:09:45.945 INFO:teuthology.orchestra.run.smithi078.stdout: "pid": "43838", 2024-09-15T22:09:45.945 INFO:teuthology.orchestra.run.smithi078.stdout: "root": "/" 2024-09-15T22:09:45.945 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-15T22:09:45.946 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_count": 0, 2024-09-15T22:09:45.946 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_pinned_count": 0, 2024-09-15T22:09:45.946 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4713, 2024-09-15T22:09:45.946 INFO:teuthology.orchestra.run.smithi078.stdout: "inst": { 2024-09-15T22:09:45.946 INFO:teuthology.orchestra.run.smithi078.stdout: "name": { 2024-09-15T22:09:45.946 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "client", 2024-09-15T22:09:45.946 INFO:teuthology.orchestra.run.smithi078.stdout: "num": 4713 2024-09-15T22:09:45.946 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-15T22:09:45.946 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2024-09-15T22:09:45.946 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-09-15T22:09:45.946 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:09:45.946 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1626582628 2024-09-15T22:09:45.946 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-15T22:09:45.947 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-15T22:09:45.947 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2024-09-15T22:09:45.947 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-09-15T22:09:45.947 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:09:45.947 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1626582628 2024-09-15T22:09:45.947 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-15T22:09:45.947 INFO:teuthology.orchestra.run.smithi078.stdout: "inst_str": "client.4713 192.168.0.1:0/1626582628", 2024-09-15T22:09:45.947 INFO:teuthology.orchestra.run.smithi078.stdout: "addr_str": "192.168.0.1:0/1626582628", 2024-09-15T22:09:45.947 INFO:teuthology.orchestra.run.smithi078.stdout: "inode_count": 1, 2024-09-15T22:09:45.947 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_epoch": 9, 2024-09-15T22:09:45.948 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch": 25, 2024-09-15T22:09:45.948 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch_barrier": 0, 2024-09-15T22:09:45.948 INFO:teuthology.orchestra.run.smithi078.stdout: "blocklisted": false, 2024-09-15T22:09:45.948 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs" 2024-09-15T22:09:45.948 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-15T22:09:45.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:45.954 DEBUG:teuthology.orchestra.run.smithi078:> stat --file-system '--printf=%T 2024-09-15T22:09:45.954 DEBUG:teuthology.orchestra.run.smithi078:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T22:09:45.970 INFO:teuthology.orchestra.run.smithi078.stdout:fuseblk 2024-09-15T22:09:45.970 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T22:09:45.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:09:45.970 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:09:46.035 INFO:teuthology.run_tasks:Running task workunit... 2024-09-15T22:09:46.050 INFO:tasks.workunit:Pulling workunits from ref ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T22:09:46.050 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-15T22:09:46.050 INFO:tasks.workunit:timeout=3h 2024-09-15T22:09:46.050 INFO:tasks.workunit:cleanup=True 2024-09-15T22:09:46.051 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-15T22:09:46.091 INFO:teuthology.orchestra.run.smithi078.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-15T22:09:46.091 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-15T22:09:46.091 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-09-15T22:09:46.091 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:09:46.091 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-15T22:09:46.091 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-15T22:09:46.092 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-15 22:09:17.390680990 +0000 2024-09-15T22:09:46.092 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-15 22:09:26.559826726 +0000 2024-09-15T22:09:46.092 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-09-15T22:09:46.092 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-15T22:09:46.092 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-15T22:09:46.164 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T22:09:46.219 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-15T22:10:15.839 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:10:15.842 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:10:41.817 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to 'ad35db06e8924912f01e32b35576297c0f1352b4'. 2024-09-15T22:10:41.817 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-15T22:10:41.817 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-15T22:10:41.817 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-15T22:10:41.817 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-09-15T22:10:41.817 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-15T22:10:41.818 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-15T22:10:41.818 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-15T22:10:41.818 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-15T22:10:41.818 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-09-15T22:10:41.818 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-15T22:10:41.818 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-09-15T22:10:41.818 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-15T22:10:41.818 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-09-15T22:10:41.818 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-15T22:10:41.818 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-15T22:10:41.818 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-15T22:10:41.818 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at ad35db06e89 Merge pull request #59794 from zdover23/wip-doc-2024-09-15-backport-59613-to-squid 2024-09-15T22:10:41.821 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-15T22:10:41.858 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-15T22:10:41.860 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T22:10:41.861 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-15T22:10:42.496 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-15T22:10:42.575 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-15T22:10:42.616 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T22:10:42.618 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T22:10:42.618 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-15T22:10:42.657 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T22:10:42.660 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:10:42.660 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-15T22:10:42.717 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-09-15T22:10:42.718 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-09-15T22:10:42.718 DEBUG:teuthology.orchestra.run.smithi078:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ad35db06e8924912f01e32b35576297c0f1352b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-09-15T22:10:42.782 INFO:tasks.workunit.client.0.smithi078.stderr:+ dbench 1 2024-09-15T22:10:42.787 INFO:tasks.workunit.client.0.smithi078.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-09-15T22:10:42.787 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-15T22:10:42.787 INFO:tasks.workunit.client.0.smithi078.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-09-15T22:10:42.791 INFO:tasks.workunit.client.0.smithi078.stdout:0 of 1 processes prepared for launch 0 sec 2024-09-15T22:10:42.891 INFO:tasks.workunit.client.0.smithi078.stdout:1 of 1 processes prepared for launch 0 sec 2024-09-15T22:10:42.891 INFO:tasks.workunit.client.0.smithi078.stdout:releasing clients 2024-09-15T22:10:43.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 925 21.78 MB/sec warmup 1 sec latency 12.914 ms 2024-09-15T22:10:44.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 1759 13.14 MB/sec warmup 2 sec latency 11.414 ms 2024-09-15T22:10:45.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 2551 9.64 MB/sec warmup 3 sec latency 11.919 ms 2024-09-15T22:10:45.977 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:10:45.979 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:10:46.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 3377 8.86 MB/sec warmup 4 sec latency 15.544 ms 2024-09-15T22:10:47.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 4058 8.02 MB/sec warmup 5 sec latency 11.020 ms 2024-09-15T22:10:48.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 4738 7.02 MB/sec warmup 6 sec latency 15.813 ms 2024-09-15T22:10:49.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 5613 6.53 MB/sec warmup 7 sec latency 23.470 ms 2024-09-15T22:10:50.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 6487 6.58 MB/sec warmup 8 sec latency 23.997 ms 2024-09-15T22:10:51.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 7242 6.43 MB/sec warmup 9 sec latency 15.922 ms 2024-09-15T22:10:52.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 7812 5.94 MB/sec warmup 10 sec latency 13.764 ms 2024-09-15T22:10:53.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 8594 5.84 MB/sec warmup 11 sec latency 13.805 ms 2024-09-15T22:10:54.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 9439 5.51 MB/sec warmup 12 sec latency 10.630 ms 2024-09-15T22:10:55.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 10389 5.66 MB/sec warmup 13 sec latency 20.041 ms 2024-09-15T22:10:56.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 10987 5.59 MB/sec warmup 14 sec latency 10.318 ms 2024-09-15T22:10:57.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 11585 5.28 MB/sec warmup 15 sec latency 18.013 ms 2024-09-15T22:10:58.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 12425 5.23 MB/sec warmup 16 sec latency 15.876 ms 2024-09-15T22:10:59.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 13203 5.07 MB/sec warmup 17 sec latency 27.126 ms 2024-09-15T22:11:00.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 14039 5.16 MB/sec warmup 18 sec latency 16.315 ms 2024-09-15T22:11:01.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 14721 5.13 MB/sec warmup 19 sec latency 9.013 ms 2024-09-15T22:11:02.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 15427 4.98 MB/sec warmup 20 sec latency 15.565 ms 2024-09-15T22:11:03.891 INFO:tasks.workunit.client.0.smithi078.stdout: 1 16289 4.91 MB/sec warmup 21 sec latency 11.642 ms 2024-09-15T22:11:04.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 17170 5.00 MB/sec warmup 22 sec latency 13.021 ms 2024-09-15T22:11:05.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 17971 5.05 MB/sec warmup 23 sec latency 10.077 ms 2024-09-15T22:11:06.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 18535 4.87 MB/sec warmup 24 sec latency 15.015 ms 2024-09-15T22:11:07.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 19360 4.87 MB/sec warmup 25 sec latency 10.450 ms 2024-09-15T22:11:08.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 20213 4.76 MB/sec warmup 26 sec latency 31.016 ms 2024-09-15T22:11:09.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 21103 4.85 MB/sec warmup 27 sec latency 10.388 ms 2024-09-15T22:11:10.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 21743 4.85 MB/sec warmup 28 sec latency 11.026 ms 2024-09-15T22:11:11.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 22392 4.75 MB/sec warmup 29 sec latency 18.884 ms 2024-09-15T22:11:12.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 23233 4.71 MB/sec warmup 30 sec latency 16.076 ms 2024-09-15T22:11:13.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 24088 4.73 MB/sec warmup 31 sec latency 20.783 ms 2024-09-15T22:11:14.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 24945 4.79 MB/sec warmup 32 sec latency 18.042 ms 2024-09-15T22:11:15.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 25496 4.69 MB/sec warmup 33 sec latency 11.116 ms 2024-09-15T22:11:16.062 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:11:16.064 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:11:16.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 26278 4.70 MB/sec warmup 34 sec latency 23.877 ms 2024-09-15T22:11:17.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 27071 4.59 MB/sec warmup 35 sec latency 65.272 ms 2024-09-15T22:11:18.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 28083 4.67 MB/sec warmup 36 sec latency 26.358 ms 2024-09-15T22:11:19.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 28711 4.69 MB/sec warmup 37 sec latency 11.880 ms 2024-09-15T22:11:20.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 29307 4.60 MB/sec warmup 38 sec latency 15.095 ms 2024-09-15T22:11:21.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 30112 4.60 MB/sec warmup 39 sec latency 16.425 ms 2024-09-15T22:11:22.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 30909 4.54 MB/sec warmup 40 sec latency 11.256 ms 2024-09-15T22:11:23.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 31751 4.59 MB/sec warmup 41 sec latency 18.738 ms 2024-09-15T22:11:24.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 32429 4.60 MB/sec warmup 42 sec latency 10.934 ms 2024-09-15T22:11:25.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 33119 4.54 MB/sec warmup 43 sec latency 15.003 ms 2024-09-15T22:11:26.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 33992 4.52 MB/sec warmup 44 sec latency 11.617 ms 2024-09-15T22:11:27.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 34889 4.57 MB/sec warmup 45 sec latency 20.016 ms 2024-09-15T22:11:28.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 35667 4.59 MB/sec warmup 46 sec latency 15.468 ms 2024-09-15T22:11:29.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 36218 4.52 MB/sec warmup 47 sec latency 14.677 ms 2024-09-15T22:11:30.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 37005 4.53 MB/sec warmup 48 sec latency 15.822 ms 2024-09-15T22:11:31.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 37875 4.47 MB/sec warmup 49 sec latency 20.539 ms 2024-09-15T22:11:32.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 38812 4.53 MB/sec warmup 50 sec latency 24.514 ms 2024-09-15T22:11:33.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 39432 4.54 MB/sec warmup 51 sec latency 10.857 ms 2024-09-15T22:11:34.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 40059 4.47 MB/sec warmup 52 sec latency 17.232 ms 2024-09-15T22:11:35.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 40915 4.47 MB/sec warmup 53 sec latency 10.665 ms 2024-09-15T22:11:36.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 41657 4.43 MB/sec warmup 54 sec latency 28.096 ms 2024-09-15T22:11:37.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 42583 4.52 MB/sec warmup 55 sec latency 15.110 ms 2024-09-15T22:11:38.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 43150 4.47 MB/sec warmup 56 sec latency 13.232 ms 2024-09-15T22:11:39.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 43882 4.43 MB/sec warmup 57 sec latency 13.150 ms 2024-09-15T22:11:40.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 44768 4.42 MB/sec warmup 58 sec latency 13.510 ms 2024-09-15T22:11:41.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 45626 4.46 MB/sec warmup 59 sec latency 27.084 ms 2024-09-15T22:11:42.892 INFO:tasks.workunit.client.0.smithi078.stdout: 1 46418 4.49 MB/sec warmup 60 sec latency 11.752 ms 2024-09-15T22:11:43.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 47011 4.43 MB/sec warmup 61 sec latency 17.470 ms 2024-09-15T22:11:44.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 47785 4.43 MB/sec warmup 62 sec latency 17.256 ms 2024-09-15T22:11:45.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 48580 4.39 MB/sec warmup 63 sec latency 14.175 ms 2024-09-15T22:11:46.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 49474 4.44 MB/sec warmup 64 sec latency 12.156 ms 2024-09-15T22:11:47.062 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:11:47.065 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:11:47.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 50148 4.44 MB/sec warmup 65 sec latency 11.187 ms 2024-09-15T22:11:48.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 50844 4.41 MB/sec warmup 66 sec latency 13.944 ms 2024-09-15T22:11:49.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 51711 4.39 MB/sec warmup 67 sec latency 13.577 ms 2024-09-15T22:11:50.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 52566 4.41 MB/sec warmup 68 sec latency 29.062 ms 2024-09-15T22:11:51.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 53344 4.44 MB/sec warmup 69 sec latency 15.517 ms 2024-09-15T22:11:52.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 53863 4.40 MB/sec warmup 70 sec latency 38.280 ms 2024-09-15T22:11:53.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 54639 4.41 MB/sec warmup 71 sec latency 13.423 ms 2024-09-15T22:11:54.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 55459 4.36 MB/sec warmup 72 sec latency 22.055 ms 2024-09-15T22:11:55.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 56423 4.40 MB/sec warmup 73 sec latency 13.401 ms 2024-09-15T22:11:56.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 57059 4.41 MB/sec warmup 74 sec latency 16.351 ms 2024-09-15T22:11:57.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 57604 4.37 MB/sec warmup 75 sec latency 40.144 ms 2024-09-15T22:11:58.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 58392 4.37 MB/sec warmup 76 sec latency 14.401 ms 2024-09-15T22:11:59.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 59204 4.34 MB/sec warmup 77 sec latency 29.471 ms 2024-09-15T22:12:00.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 60093 4.38 MB/sec warmup 78 sec latency 17.350 ms 2024-09-15T22:12:01.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 60730 4.38 MB/sec warmup 79 sec latency 12.922 ms 2024-09-15T22:12:02.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 61385 4.35 MB/sec warmup 80 sec latency 15.651 ms 2024-09-15T22:12:03.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 62199 4.34 MB/sec warmup 81 sec latency 15.402 ms 2024-09-15T22:12:04.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 62984 4.33 MB/sec warmup 82 sec latency 30.886 ms 2024-09-15T22:12:05.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 63884 4.38 MB/sec warmup 83 sec latency 15.496 ms 2024-09-15T22:12:06.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 64471 4.35 MB/sec warmup 84 sec latency 12.668 ms 2024-09-15T22:12:07.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 65256 4.36 MB/sec warmup 85 sec latency 25.691 ms 2024-09-15T22:12:08.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 66070 4.31 MB/sec warmup 86 sec latency 19.837 ms 2024-09-15T22:12:09.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 67134 4.36 MB/sec warmup 87 sec latency 13.169 ms 2024-09-15T22:12:10.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 67714 4.36 MB/sec warmup 88 sec latency 15.459 ms 2024-09-15T22:12:11.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 68311 4.33 MB/sec warmup 89 sec latency 15.013 ms 2024-09-15T22:12:12.893 INFO:tasks.workunit.client.0.smithi078.stdout: 1 69070 4.33 MB/sec warmup 90 sec latency 16.406 ms 2024-09-15T22:12:13.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 69874 4.30 MB/sec warmup 91 sec latency 14.504 ms 2024-09-15T22:12:14.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 70747 4.33 MB/sec warmup 92 sec latency 14.473 ms 2024-09-15T22:12:15.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 71419 4.34 MB/sec warmup 93 sec latency 11.154 ms 2024-09-15T22:12:16.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 72104 4.31 MB/sec warmup 94 sec latency 15.821 ms 2024-09-15T22:12:17.122 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:12:17.124 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:12:17.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 72967 4.30 MB/sec warmup 95 sec latency 12.528 ms 2024-09-15T22:12:18.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 73873 4.32 MB/sec warmup 96 sec latency 28.003 ms 2024-09-15T22:12:19.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 74650 4.34 MB/sec warmup 97 sec latency 17.025 ms 2024-09-15T22:12:20.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 75198 4.31 MB/sec warmup 98 sec latency 17.400 ms 2024-09-15T22:12:21.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 75935 4.32 MB/sec warmup 99 sec latency 10.612 ms 2024-09-15T22:12:22.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 76728 4.28 MB/sec warmup 100 sec latency 21.561 ms 2024-09-15T22:12:23.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 77709 4.31 MB/sec warmup 101 sec latency 27.990 ms 2024-09-15T22:12:24.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 78319 4.33 MB/sec warmup 102 sec latency 13.958 ms 2024-09-15T22:12:25.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 78865 4.29 MB/sec warmup 103 sec latency 13.675 ms 2024-09-15T22:12:26.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 79593 4.30 MB/sec warmup 104 sec latency 14.730 ms 2024-09-15T22:12:27.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 80422 4.27 MB/sec warmup 105 sec latency 25.731 ms 2024-09-15T22:12:28.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 81373 4.30 MB/sec warmup 106 sec latency 12.982 ms 2024-09-15T22:12:29.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 81954 4.30 MB/sec warmup 107 sec latency 10.213 ms 2024-09-15T22:12:30.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 82540 4.27 MB/sec warmup 108 sec latency 15.246 ms 2024-09-15T22:12:31.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 83292 4.28 MB/sec warmup 109 sec latency 13.720 ms 2024-09-15T22:12:32.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 84063 4.25 MB/sec warmup 110 sec latency 41.617 ms 2024-09-15T22:12:33.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 84950 4.28 MB/sec warmup 111 sec latency 11.770 ms 2024-09-15T22:12:34.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 85591 4.29 MB/sec warmup 112 sec latency 11.248 ms 2024-09-15T22:12:35.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 86226 4.26 MB/sec warmup 113 sec latency 17.327 ms 2024-09-15T22:12:36.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 87040 4.26 MB/sec warmup 114 sec latency 14.231 ms 2024-09-15T22:12:37.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 87791 4.24 MB/sec warmup 115 sec latency 29.023 ms 2024-09-15T22:12:38.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 88706 4.29 MB/sec warmup 116 sec latency 15.195 ms 2024-09-15T22:12:39.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 89273 4.27 MB/sec warmup 117 sec latency 12.008 ms 2024-09-15T22:12:40.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 89943 4.25 MB/sec warmup 118 sec latency 13.377 ms 2024-09-15T22:12:41.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 90782 4.24 MB/sec warmup 119 sec latency 24.308 ms 2024-09-15T22:12:43.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 92415 5.30 MB/sec execute 1 sec latency 27.227 ms 2024-09-15T22:12:44.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 92976 3.42 MB/sec execute 2 sec latency 14.661 ms 2024-09-15T22:12:45.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 93761 3.89 MB/sec execute 3 sec latency 14.785 ms 2024-09-15T22:12:46.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 94606 3.37 MB/sec execute 4 sec latency 12.965 ms 2024-09-15T22:12:47.235 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:12:47.238 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:12:47.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 95559 4.20 MB/sec execute 5 sec latency 18.229 ms 2024-09-15T22:12:48.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 96149 4.26 MB/sec execute 6 sec latency 11.252 ms 2024-09-15T22:12:49.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 96755 3.79 MB/sec execute 7 sec latency 15.569 ms 2024-09-15T22:12:50.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 97584 3.88 MB/sec execute 8 sec latency 13.405 ms 2024-09-15T22:12:51.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 98367 3.74 MB/sec execute 9 sec latency 30.438 ms 2024-09-15T22:12:52.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 99150 4.01 MB/sec execute 10 sec latency 18.909 ms 2024-09-15T22:12:53.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 99832 4.08 MB/sec execute 11 sec latency 10.903 ms 2024-09-15T22:12:54.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 100516 3.91 MB/sec execute 12 sec latency 14.504 ms 2024-09-15T22:12:55.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 101373 3.88 MB/sec execute 13 sec latency 10.692 ms 2024-09-15T22:12:56.894 INFO:tasks.workunit.client.0.smithi078.stdout: 1 102259 4.05 MB/sec execute 14 sec latency 31.489 ms 2024-09-15T22:12:57.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 103034 4.18 MB/sec execute 15 sec latency 14.256 ms 2024-09-15T22:12:58.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 103588 4.01 MB/sec execute 16 sec latency 16.936 ms 2024-09-15T22:12:59.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 104378 4.06 MB/sec execute 17 sec latency 13.159 ms 2024-09-15T22:13:00.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 105245 3.94 MB/sec execute 18 sec latency 20.880 ms 2024-09-15T22:13:01.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 106192 4.12 MB/sec execute 19 sec latency 16.726 ms 2024-09-15T22:13:02.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 106759 4.14 MB/sec execute 20 sec latency 18.505 ms 2024-09-15T22:13:03.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 107325 3.99 MB/sec execute 21 sec latency 15.059 ms 2024-09-15T22:13:04.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 108118 4.02 MB/sec execute 22 sec latency 11.180 ms 2024-09-15T22:13:05.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 108888 3.92 MB/sec execute 23 sec latency 35.814 ms 2024-09-15T22:13:06.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 109769 4.06 MB/sec execute 24 sec latency 11.528 ms 2024-09-15T22:13:07.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 110403 4.09 MB/sec execute 25 sec latency 10.465 ms 2024-09-15T22:13:08.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 111049 4.01 MB/sec execute 26 sec latency 16.548 ms 2024-09-15T22:13:09.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 111846 3.99 MB/sec execute 27 sec latency 11.774 ms 2024-09-15T22:13:10.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 112596 3.94 MB/sec execute 28 sec latency 14.756 ms 2024-09-15T22:13:11.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 113502 4.12 MB/sec execute 29 sec latency 15.669 ms 2024-09-15T22:13:12.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 114067 4.04 MB/sec execute 30 sec latency 14.566 ms 2024-09-15T22:13:13.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 114755 3.98 MB/sec execute 31 sec latency 15.578 ms 2024-09-15T22:13:14.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 115605 3.97 MB/sec execute 32 sec latency 20.667 ms 2024-09-15T22:13:15.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 116506 4.06 MB/sec execute 33 sec latency 28.735 ms 2024-09-15T22:13:16.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 117289 4.12 MB/sec execute 34 sec latency 9.492 ms 2024-09-15T22:13:17.323 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:13:17.326 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:13:17.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 117716 4.01 MB/sec execute 35 sec latency 91.910 ms 2024-09-15T22:13:18.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 118493 4.04 MB/sec execute 36 sec latency 11.185 ms 2024-09-15T22:13:19.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 119350 3.95 MB/sec execute 37 sec latency 11.096 ms 2024-09-15T22:13:20.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 120348 4.07 MB/sec execute 38 sec latency 27.013 ms 2024-09-15T22:13:21.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 120924 4.08 MB/sec execute 39 sec latency 13.679 ms 2024-09-15T22:13:22.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 121497 4.00 MB/sec execute 40 sec latency 14.246 ms 2024-09-15T22:13:23.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 122273 4.02 MB/sec execute 41 sec latency 10.857 ms 2024-09-15T22:13:24.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 123074 3.97 MB/sec execute 42 sec latency 12.495 ms 2024-09-15T22:13:25.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 123960 4.05 MB/sec execute 43 sec latency 16.581 ms 2024-09-15T22:13:26.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 124612 4.06 MB/sec execute 44 sec latency 13.549 ms 2024-09-15T22:13:27.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 125252 4.01 MB/sec execute 45 sec latency 14.687 ms 2024-09-15T22:13:28.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 126077 4.00 MB/sec execute 46 sec latency 14.935 ms 2024-09-15T22:13:29.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 126930 4.04 MB/sec execute 47 sec latency 27.075 ms 2024-09-15T22:13:30.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 127790 4.09 MB/sec execute 48 sec latency 15.110 ms 2024-09-15T22:13:31.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 128328 4.04 MB/sec execute 49 sec latency 16.658 ms 2024-09-15T22:13:32.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 129018 4.00 MB/sec execute 50 sec latency 15.231 ms 2024-09-15T22:13:33.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 129898 3.99 MB/sec execute 51 sec latency 13.353 ms 2024-09-15T22:13:34.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 130750 4.05 MB/sec execute 52 sec latency 13.398 ms 2024-09-15T22:13:35.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 131518 4.09 MB/sec execute 53 sec latency 11.940 ms 2024-09-15T22:13:36.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 132034 4.02 MB/sec execute 54 sec latency 16.341 ms 2024-09-15T22:13:37.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 132821 4.04 MB/sec execute 55 sec latency 16.533 ms 2024-09-15T22:13:38.895 INFO:tasks.workunit.client.0.smithi078.stdout: 1 133645 4.00 MB/sec execute 56 sec latency 22.430 ms 2024-09-15T22:13:39.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 134576 4.06 MB/sec execute 57 sec latency 11.654 ms 2024-09-15T22:13:40.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 135177 4.07 MB/sec execute 58 sec latency 12.446 ms 2024-09-15T22:13:41.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 135767 4.02 MB/sec execute 59 sec latency 17.418 ms 2024-09-15T22:13:42.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 136539 4.02 MB/sec execute 60 sec latency 13.388 ms 2024-09-15T22:13:43.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 137326 4.00 MB/sec execute 61 sec latency 19.356 ms 2024-09-15T22:13:44.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 138170 4.04 MB/sec execute 62 sec latency 15.176 ms 2024-09-15T22:13:45.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 138826 4.05 MB/sec execute 63 sec latency 13.155 ms 2024-09-15T22:13:46.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 139489 4.02 MB/sec execute 64 sec latency 14.059 ms 2024-09-15T22:13:47.786 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:13:47.788 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:13:47.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 140348 4.01 MB/sec execute 65 sec latency 10.508 ms 2024-09-15T22:13:48.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 141242 4.04 MB/sec execute 66 sec latency 16.291 ms 2024-09-15T22:13:49.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 142006 4.07 MB/sec execute 67 sec latency 10.938 ms 2024-09-15T22:13:50.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 142568 4.04 MB/sec execute 68 sec latency 13.792 ms 2024-09-15T22:13:51.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 143315 4.05 MB/sec execute 69 sec latency 11.707 ms 2024-09-15T22:13:52.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 144128 4.00 MB/sec execute 70 sec latency 11.094 ms 2024-09-15T22:13:53.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 145095 4.05 MB/sec execute 71 sec latency 11.330 ms 2024-09-15T22:13:54.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 145725 4.07 MB/sec execute 72 sec latency 10.973 ms 2024-09-15T22:13:55.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 146293 4.03 MB/sec execute 73 sec latency 15.971 ms 2024-09-15T22:13:56.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 147099 4.04 MB/sec execute 74 sec latency 10.807 ms 2024-09-15T22:13:57.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 147850 4.01 MB/sec execute 75 sec latency 62.827 ms 2024-09-15T22:13:58.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 148767 4.05 MB/sec execute 76 sec latency 89.357 ms 2024-09-15T22:13:59.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 149383 4.06 MB/sec execute 77 sec latency 12.069 ms 2024-09-15T22:14:00.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 149990 4.02 MB/sec execute 78 sec latency 19.927 ms 2024-09-15T22:14:01.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 150840 4.02 MB/sec execute 79 sec latency 20.583 ms 2024-09-15T22:14:02.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 151596 4.01 MB/sec execute 80 sec latency 26.542 ms 2024-09-15T22:14:03.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 152522 4.07 MB/sec execute 81 sec latency 18.198 ms 2024-09-15T22:14:04.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 153102 4.04 MB/sec execute 82 sec latency 12.644 ms 2024-09-15T22:14:05.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 153805 4.02 MB/sec execute 83 sec latency 15.859 ms 2024-09-15T22:14:06.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 154646 4.02 MB/sec execute 84 sec latency 18.096 ms 2024-09-15T22:14:07.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 155535 4.05 MB/sec execute 85 sec latency 17.583 ms 2024-09-15T22:14:08.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 156314 4.08 MB/sec execute 86 sec latency 14.504 ms 2024-09-15T22:14:09.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 156825 4.04 MB/sec execute 87 sec latency 15.960 ms 2024-09-15T22:14:10.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 157585 4.04 MB/sec execute 88 sec latency 15.199 ms 2024-09-15T22:14:11.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 158430 4.02 MB/sec execute 89 sec latency 22.868 ms 2024-09-15T22:14:12.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 159381 4.06 MB/sec execute 90 sec latency 18.631 ms 2024-09-15T22:14:13.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 159977 4.06 MB/sec execute 91 sec latency 11.200 ms 2024-09-15T22:14:14.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 160577 4.03 MB/sec execute 92 sec latency 16.249 ms 2024-09-15T22:14:15.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 161413 4.03 MB/sec execute 93 sec latency 17.172 ms 2024-09-15T22:14:16.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 162189 4.02 MB/sec execute 94 sec latency 19.813 ms 2024-09-15T22:14:17.848 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:14:17.851 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:14:17.896 INFO:tasks.workunit.client.0.smithi078.stdout: 1 163010 4.05 MB/sec execute 95 sec latency 14.977 ms 2024-09-15T22:14:18.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 163682 4.05 MB/sec execute 96 sec latency 10.120 ms 2024-09-15T22:14:19.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 164366 4.03 MB/sec execute 97 sec latency 14.932 ms 2024-09-15T22:14:20.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 165232 4.03 MB/sec execute 98 sec latency 10.732 ms 2024-09-15T22:14:21.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 166105 4.06 MB/sec execute 99 sec latency 29.357 ms 2024-09-15T22:14:22.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 166844 4.07 MB/sec execute 100 sec latency 15.492 ms 2024-09-15T22:14:23.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 167400 4.04 MB/sec execute 101 sec latency 14.394 ms 2024-09-15T22:14:24.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 168133 4.05 MB/sec execute 102 sec latency 19.857 ms 2024-09-15T22:14:25.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 168918 4.02 MB/sec execute 103 sec latency 35.619 ms 2024-09-15T22:14:26.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 169928 4.05 MB/sec execute 104 sec latency 12.729 ms 2024-09-15T22:14:27.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 170529 4.07 MB/sec execute 105 sec latency 15.106 ms 2024-09-15T22:14:28.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 171063 4.03 MB/sec execute 106 sec latency 16.954 ms 2024-09-15T22:14:29.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 171834 4.04 MB/sec execute 107 sec latency 16.057 ms 2024-09-15T22:14:30.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 172652 4.02 MB/sec execute 108 sec latency 30.738 ms 2024-09-15T22:14:31.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 173583 4.05 MB/sec execute 109 sec latency 17.980 ms 2024-09-15T22:14:32.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 174202 4.06 MB/sec execute 110 sec latency 16.043 ms 2024-09-15T22:14:33.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 174802 4.03 MB/sec execute 111 sec latency 17.455 ms 2024-09-15T22:14:34.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 175650 4.03 MB/sec execute 112 sec latency 15.820 ms 2024-09-15T22:14:35.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 176399 4.02 MB/sec execute 113 sec latency 31.322 ms 2024-09-15T22:14:36.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 177192 4.04 MB/sec execute 114 sec latency 17.872 ms 2024-09-15T22:14:37.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 177829 4.05 MB/sec execute 115 sec latency 11.809 ms 2024-09-15T22:14:38.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 178435 4.03 MB/sec execute 116 sec latency 89.316 ms 2024-09-15T22:14:39.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 179258 4.02 MB/sec execute 117 sec latency 21.527 ms 2024-09-15T22:14:40.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 179998 4.02 MB/sec execute 118 sec latency 17.789 ms 2024-09-15T22:14:41.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 180932 4.06 MB/sec execute 119 sec latency 14.301 ms 2024-09-15T22:14:42.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 181506 4.04 MB/sec execute 120 sec latency 17.939 ms 2024-09-15T22:14:43.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 182120 4.02 MB/sec execute 121 sec latency 97.164 ms 2024-09-15T22:14:44.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 182968 4.02 MB/sec execute 122 sec latency 11.101 ms 2024-09-15T22:14:45.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 183848 4.04 MB/sec execute 123 sec latency 12.057 ms 2024-09-15T22:14:46.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 184607 4.05 MB/sec execute 124 sec latency 16.522 ms 2024-09-15T22:14:47.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 185137 4.03 MB/sec execute 125 sec latency 18.857 ms 2024-09-15T22:14:47.936 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:14:47.938 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:14:48.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 185904 4.04 MB/sec execute 126 sec latency 16.269 ms 2024-09-15T22:14:49.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 186754 4.02 MB/sec execute 127 sec latency 36.278 ms 2024-09-15T22:14:50.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 187731 4.05 MB/sec execute 128 sec latency 13.720 ms 2024-09-15T22:14:51.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 188308 4.05 MB/sec execute 129 sec latency 8.938 ms 2024-09-15T22:14:52.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 188872 4.03 MB/sec execute 130 sec latency 18.863 ms 2024-09-15T22:14:53.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 189655 4.03 MB/sec execute 131 sec latency 10.954 ms 2024-09-15T22:14:54.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 190449 4.02 MB/sec execute 132 sec latency 29.231 ms 2024-09-15T22:14:55.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 191328 4.04 MB/sec execute 133 sec latency 16.921 ms 2024-09-15T22:14:56.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 191966 4.04 MB/sec execute 134 sec latency 12.159 ms 2024-09-15T22:14:57.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 192602 4.03 MB/sec execute 135 sec latency 17.354 ms 2024-09-15T22:14:58.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 193422 4.02 MB/sec execute 136 sec latency 11.751 ms 2024-09-15T22:14:59.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 194168 4.02 MB/sec execute 137 sec latency 27.010 ms 2024-09-15T22:15:00.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 195100 4.05 MB/sec execute 138 sec latency 13.265 ms 2024-09-15T22:15:01.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 195694 4.04 MB/sec execute 139 sec latency 10.239 ms 2024-09-15T22:15:02.897 INFO:tasks.workunit.client.0.smithi078.stdout: 1 196380 4.02 MB/sec execute 140 sec latency 16.276 ms 2024-09-15T22:15:03.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 197236 4.02 MB/sec execute 141 sec latency 14.633 ms 2024-09-15T22:15:04.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 198070 4.04 MB/sec execute 142 sec latency 26.775 ms 2024-09-15T22:15:05.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 198839 4.06 MB/sec execute 143 sec latency 12.681 ms 2024-09-15T22:15:06.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 199362 4.03 MB/sec execute 144 sec latency 20.221 ms 2024-09-15T22:15:07.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 200127 4.04 MB/sec execute 145 sec latency 15.036 ms 2024-09-15T22:15:08.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 200947 4.02 MB/sec execute 146 sec latency 32.974 ms 2024-09-15T22:15:09.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 201917 4.04 MB/sec execute 147 sec latency 14.233 ms 2024-09-15T22:15:10.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 202481 4.05 MB/sec execute 148 sec latency 11.534 ms 2024-09-15T22:15:11.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 203050 4.03 MB/sec execute 149 sec latency 15.675 ms 2024-09-15T22:15:12.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 203826 4.03 MB/sec execute 150 sec latency 17.447 ms 2024-09-15T22:15:13.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 204612 4.02 MB/sec execute 151 sec latency 27.943 ms 2024-09-15T22:15:14.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 205504 4.04 MB/sec execute 152 sec latency 16.690 ms 2024-09-15T22:15:15.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 206152 4.04 MB/sec execute 153 sec latency 16.376 ms 2024-09-15T22:15:16.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 206809 4.03 MB/sec execute 154 sec latency 15.843 ms 2024-09-15T22:15:17.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 207644 4.03 MB/sec execute 155 sec latency 21.445 ms 2024-09-15T22:15:18.000 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:15:18.003 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:15:18.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 208325 4.02 MB/sec execute 156 sec latency 89.743 ms 2024-09-15T22:15:19.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 209118 4.03 MB/sec execute 157 sec latency 10.993 ms 2024-09-15T22:15:20.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 209783 4.04 MB/sec execute 158 sec latency 11.367 ms 2024-09-15T22:15:21.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 210478 4.02 MB/sec execute 159 sec latency 14.243 ms 2024-09-15T22:15:22.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 211335 4.02 MB/sec execute 160 sec latency 11.437 ms 2024-09-15T22:15:23.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 212172 4.03 MB/sec execute 161 sec latency 47.226 ms 2024-09-15T22:15:24.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 212931 4.05 MB/sec execute 162 sec latency 13.613 ms 2024-09-15T22:15:25.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 213480 4.03 MB/sec execute 163 sec latency 17.155 ms 2024-09-15T22:15:26.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 214255 4.04 MB/sec execute 164 sec latency 11.071 ms 2024-09-15T22:15:27.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 215097 4.02 MB/sec execute 165 sec latency 25.920 ms 2024-09-15T22:15:28.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 216062 4.04 MB/sec execute 166 sec latency 17.446 ms 2024-09-15T22:15:29.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 216664 4.05 MB/sec execute 167 sec latency 12.088 ms 2024-09-15T22:15:30.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 217232 4.03 MB/sec execute 168 sec latency 15.867 ms 2024-09-15T22:15:31.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 217980 4.03 MB/sec execute 169 sec latency 11.849 ms 2024-09-15T22:15:32.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 218783 4.02 MB/sec execute 170 sec latency 34.414 ms 2024-09-15T22:15:33.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 219712 4.04 MB/sec execute 171 sec latency 17.484 ms 2024-09-15T22:15:34.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 220293 4.04 MB/sec execute 172 sec latency 11.653 ms 2024-09-15T22:15:35.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 220878 4.02 MB/sec execute 173 sec latency 18.299 ms 2024-09-15T22:15:36.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 221624 4.02 MB/sec execute 174 sec latency 13.845 ms 2024-09-15T22:15:37.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 222407 4.01 MB/sec execute 175 sec latency 33.286 ms 2024-09-15T22:15:38.898 INFO:tasks.workunit.client.0.smithi078.stdout: 1 223287 4.03 MB/sec execute 176 sec latency 16.806 ms 2024-09-15T22:15:39.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 223933 4.03 MB/sec execute 177 sec latency 10.788 ms 2024-09-15T22:15:40.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 224570 4.02 MB/sec execute 178 sec latency 15.866 ms 2024-09-15T22:15:41.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 225417 4.02 MB/sec execute 179 sec latency 22.322 ms 2024-09-15T22:15:42.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 226258 4.03 MB/sec execute 180 sec latency 28.954 ms 2024-09-15T22:15:43.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 227055 4.04 MB/sec execute 181 sec latency 10.649 ms 2024-09-15T22:15:44.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 227613 4.03 MB/sec execute 182 sec latency 12.831 ms 2024-09-15T22:15:45.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 228295 4.02 MB/sec execute 183 sec latency 14.491 ms 2024-09-15T22:15:46.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 229147 4.02 MB/sec execute 184 sec latency 16.608 ms 2024-09-15T22:15:47.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 230022 4.03 MB/sec execute 185 sec latency 30.552 ms 2024-09-15T22:15:48.420 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:15:48.423 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:15:48.464 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-09-15T22:15:48.463+0000 7fc7d5ee9640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40459) UID: 0 2024-09-15T22:15:48.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 230764 4.04 MB/sec execute 186 sec latency 11.320 ms 2024-09-15T22:15:49.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 231326 4.02 MB/sec execute 187 sec latency 15.744 ms 2024-09-15T22:15:50.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 232096 4.03 MB/sec execute 188 sec latency 18.413 ms 2024-09-15T22:15:51.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 232946 4.02 MB/sec execute 189 sec latency 37.211 ms 2024-09-15T22:15:52.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 233894 4.04 MB/sec execute 190 sec latency 38.992 ms 2024-09-15T22:15:53.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 234487 4.04 MB/sec execute 191 sec latency 12.499 ms 2024-09-15T22:15:54.900 INFO:tasks.workunit.client.0.smithi078.stdout: 1 235089 4.02 MB/sec execute 192 sec latency 18.650 ms 2024-09-15T22:15:55.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 235851 4.02 MB/sec execute 193 sec latency 21.370 ms 2024-09-15T22:15:56.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 236641 4.02 MB/sec execute 194 sec latency 26.077 ms 2024-09-15T22:15:57.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 237475 4.03 MB/sec execute 195 sec latency 36.840 ms 2024-09-15T22:15:58.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 238142 4.03 MB/sec execute 196 sec latency 12.273 ms 2024-09-15T22:15:59.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 238769 4.02 MB/sec execute 197 sec latency 19.652 ms 2024-09-15T22:16:00.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 239600 4.02 MB/sec execute 198 sec latency 13.863 ms 2024-09-15T22:16:01.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 240454 4.03 MB/sec execute 199 sec latency 15.947 ms 2024-09-15T22:16:02.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 241272 4.04 MB/sec execute 200 sec latency 24.479 ms 2024-09-15T22:16:03.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 241858 4.03 MB/sec execute 201 sec latency 21.484 ms 2024-09-15T22:16:04.899 INFO:tasks.workunit.client.0.smithi078.stdout: 1 242519 4.02 MB/sec execute 202 sec latency 51.363 ms 2024-09-15T22:16:05.900 INFO:tasks.workunit.client.0.smithi078.stdout: 1 243347 4.02 MB/sec execute 203 sec latency 12.226 ms 2024-09-15T22:16:06.900 INFO:tasks.workunit.client.0.smithi078.stdout: 1 244225 4.03 MB/sec execute 204 sec latency 13.757 ms 2024-09-15T22:16:07.900 INFO:tasks.workunit.client.0.smithi078.stdout: 1 244995 4.04 MB/sec execute 205 sec latency 11.625 ms 2024-09-15T22:16:08.900 INFO:tasks.workunit.client.0.smithi078.stdout: 1 245519 4.03 MB/sec execute 206 sec latency 14.634 ms 2024-09-15T22:16:09.900 INFO:tasks.workunit.client.0.smithi078.stdout: 1 246275 4.03 MB/sec execute 207 sec latency 11.772 ms 2024-09-15T22:16:10.900 INFO:tasks.workunit.client.0.smithi078.stdout: 1 247125 4.02 MB/sec execute 208 sec latency 11.752 ms 2024-09-15T22:16:11.901 INFO:tasks.workunit.client.0.smithi078.stdout: 1 248076 4.03 MB/sec execute 209 sec latency 21.530 ms 2024-09-15T22:16:12.900 INFO:tasks.workunit.client.0.smithi078.stdout: 1 248669 4.04 MB/sec execute 210 sec latency 19.528 ms 2024-09-15T22:16:13.901 INFO:tasks.workunit.client.0.smithi078.stdout: 1 249220 4.02 MB/sec execute 211 sec latency 18.090 ms 2024-09-15T22:16:14.900 INFO:tasks.workunit.client.0.smithi078.stdout: 1 249997 4.02 MB/sec execute 212 sec latency 19.002 ms 2024-09-15T22:16:15.901 INFO:tasks.workunit.client.0.smithi078.stdout: 1 250800 4.02 MB/sec execute 213 sec latency 13.333 ms 2024-09-15T22:16:16.901 INFO:tasks.workunit.client.0.smithi078.stdout: 1 251659 4.03 MB/sec execute 214 sec latency 23.280 ms 2024-09-15T22:16:17.901 INFO:tasks.workunit.client.0.smithi078.stdout: 1 252318 4.03 MB/sec execute 215 sec latency 17.911 ms 2024-09-15T22:16:18.901 INFO:tasks.workunit.client.0.smithi078.stdout: 1 252936 4.02 MB/sec execute 216 sec latency 19.999 ms 2024-09-15T22:16:19.901 INFO:tasks.workunit.client.0.smithi078.stdout: 1 253744 4.02 MB/sec execute 217 sec latency 14.274 ms 2024-09-15T22:16:20.901 INFO:tasks.workunit.client.0.smithi078.stdout: 1 254496 4.01 MB/sec execute 218 sec latency 26.306 ms 2024-09-15T22:16:21.901 INFO:tasks.workunit.client.0.smithi078.stdout: 1 255388 4.04 MB/sec execute 219 sec latency 29.305 ms 2024-09-15T22:16:22.901 INFO:tasks.workunit.client.0.smithi078.stdout: 1 255946 4.03 MB/sec execute 220 sec latency 10.666 ms 2024-09-15T22:16:23.901 INFO:tasks.workunit.client.0.smithi078.stdout: 1 256604 4.02 MB/sec execute 221 sec latency 21.393 ms 2024-09-15T22:16:24.901 INFO:tasks.workunit.client.0.smithi078.stdout: 1 257453 4.02 MB/sec execute 222 sec latency 12.589 ms 2024-09-15T22:16:25.901 INFO:tasks.workunit.client.0.smithi078.stdout: 1 258336 4.03 MB/sec execute 223 sec latency 10.718 ms 2024-09-15T22:16:26.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 259082 4.04 MB/sec execute 224 sec latency 16.261 ms 2024-09-15T22:16:27.901 INFO:tasks.workunit.client.0.smithi078.stdout: 1 259624 4.02 MB/sec execute 225 sec latency 17.566 ms 2024-09-15T22:16:28.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 260260 4.02 MB/sec execute 226 sec latency 19.647 ms 2024-09-15T22:16:29.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 261120 4.01 MB/sec execute 227 sec latency 12.119 ms 2024-09-15T22:16:30.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 261980 4.03 MB/sec execute 228 sec latency 33.634 ms 2024-09-15T22:16:31.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 262752 4.04 MB/sec execute 229 sec latency 14.598 ms 2024-09-15T22:16:32.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 263303 4.02 MB/sec execute 230 sec latency 16.430 ms 2024-09-15T22:16:33.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 264049 4.02 MB/sec execute 231 sec latency 13.780 ms 2024-09-15T22:16:34.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 264880 4.01 MB/sec execute 232 sec latency 18.624 ms 2024-09-15T22:16:35.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 265803 4.03 MB/sec execute 233 sec latency 24.652 ms 2024-09-15T22:16:36.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 266380 4.03 MB/sec execute 234 sec latency 14.190 ms 2024-09-15T22:16:37.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 266969 4.02 MB/sec execute 235 sec latency 17.909 ms 2024-09-15T22:16:38.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 267736 4.02 MB/sec execute 236 sec latency 25.463 ms 2024-09-15T22:16:39.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 268552 4.01 MB/sec execute 237 sec latency 11.938 ms 2024-09-15T22:16:40.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 269392 4.03 MB/sec execute 238 sec latency 10.966 ms 2024-09-15T22:16:41.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 270073 4.03 MB/sec execute 239 sec latency 14.158 ms 2024-09-15T22:16:42.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 270733 4.02 MB/sec execute 240 sec latency 14.890 ms 2024-09-15T22:16:43.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 271602 4.02 MB/sec execute 241 sec latency 14.218 ms 2024-09-15T22:16:44.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 272376 4.02 MB/sec execute 242 sec latency 18.810 ms 2024-09-15T22:16:45.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 273169 4.03 MB/sec execute 243 sec latency 14.178 ms 2024-09-15T22:16:46.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 273768 4.02 MB/sec execute 244 sec latency 15.940 ms 2024-09-15T22:16:47.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 274439 4.02 MB/sec execute 245 sec latency 19.250 ms 2024-09-15T22:16:48.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 275236 4.01 MB/sec execute 246 sec latency 50.025 ms 2024-09-15T22:16:49.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 276123 4.03 MB/sec execute 247 sec latency 30.159 ms 2024-09-15T22:16:50.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 276824 4.03 MB/sec execute 248 sec latency 20.521 ms 2024-09-15T22:16:51.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 277386 4.02 MB/sec execute 249 sec latency 12.522 ms 2024-09-15T22:16:52.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 278162 4.02 MB/sec execute 250 sec latency 18.628 ms 2024-09-15T22:16:53.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 279032 4.02 MB/sec execute 251 sec latency 10.203 ms 2024-09-15T22:16:54.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 279984 4.03 MB/sec execute 252 sec latency 43.488 ms 2024-09-15T22:16:55.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 280550 4.03 MB/sec execute 253 sec latency 18.102 ms 2024-09-15T22:16:56.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 281143 4.02 MB/sec execute 254 sec latency 27.482 ms 2024-09-15T22:16:57.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 281935 4.02 MB/sec execute 255 sec latency 18.093 ms 2024-09-15T22:16:58.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 282732 4.01 MB/sec execute 256 sec latency 16.443 ms 2024-09-15T22:16:59.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 283573 4.03 MB/sec execute 257 sec latency 27.907 ms 2024-09-15T22:17:00.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 284243 4.03 MB/sec execute 258 sec latency 13.084 ms 2024-09-15T22:17:01.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 284878 4.02 MB/sec execute 259 sec latency 18.216 ms 2024-09-15T22:17:02.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 285712 4.02 MB/sec execute 260 sec latency 11.953 ms 2024-09-15T22:17:03.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 286535 4.02 MB/sec execute 261 sec latency 56.359 ms 2024-09-15T22:17:04.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 287330 4.03 MB/sec execute 262 sec latency 14.734 ms 2024-09-15T22:17:05.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 287875 4.02 MB/sec execute 263 sec latency 18.279 ms 2024-09-15T22:17:06.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 288512 4.02 MB/sec execute 264 sec latency 14.130 ms 2024-09-15T22:17:07.902 INFO:tasks.workunit.client.0.smithi078.stdout: 1 289322 4.01 MB/sec execute 265 sec latency 57.460 ms 2024-09-15T22:17:08.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 289950 4.01 MB/sec execute 266 sec latency 110.370 ms 2024-09-15T22:17:09.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 290851 4.03 MB/sec execute 267 sec latency 10.984 ms 2024-09-15T22:17:10.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 291419 4.02 MB/sec execute 268 sec latency 10.659 ms 2024-09-15T22:17:11.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 292063 4.01 MB/sec execute 269 sec latency 16.464 ms 2024-09-15T22:17:12.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 292957 4.01 MB/sec execute 270 sec latency 10.891 ms 2024-09-15T22:17:13.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 293846 4.02 MB/sec execute 271 sec latency 16.826 ms 2024-09-15T22:17:14.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 294565 4.03 MB/sec execute 272 sec latency 23.877 ms 2024-09-15T22:17:15.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 295105 4.02 MB/sec execute 273 sec latency 17.866 ms 2024-09-15T22:17:16.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 295849 4.02 MB/sec execute 274 sec latency 12.792 ms 2024-09-15T22:17:17.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 296727 4.01 MB/sec execute 275 sec latency 14.157 ms 2024-09-15T22:17:18.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 297699 4.03 MB/sec execute 276 sec latency 34.607 ms 2024-09-15T22:17:19.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 298237 4.03 MB/sec execute 277 sec latency 19.407 ms 2024-09-15T22:17:20.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 298797 4.02 MB/sec execute 278 sec latency 13.673 ms 2024-09-15T22:17:21.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 299564 4.02 MB/sec execute 279 sec latency 19.608 ms 2024-09-15T22:17:22.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 300386 4.01 MB/sec execute 280 sec latency 20.195 ms 2024-09-15T22:17:23.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 301294 4.02 MB/sec execute 281 sec latency 24.903 ms 2024-09-15T22:17:24.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 301934 4.02 MB/sec execute 282 sec latency 18.242 ms 2024-09-15T22:17:25.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 302581 4.02 MB/sec execute 283 sec latency 12.894 ms 2024-09-15T22:17:26.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 303414 4.01 MB/sec execute 284 sec latency 15.891 ms 2024-09-15T22:17:27.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 304279 4.02 MB/sec execute 285 sec latency 17.527 ms 2024-09-15T22:17:28.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 305150 4.03 MB/sec execute 286 sec latency 20.864 ms 2024-09-15T22:17:29.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 305723 4.02 MB/sec execute 287 sec latency 14.629 ms 2024-09-15T22:17:30.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 306489 4.02 MB/sec execute 288 sec latency 11.784 ms 2024-09-15T22:17:31.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 307270 4.01 MB/sec execute 289 sec latency 17.026 ms 2024-09-15T22:17:32.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 308252 4.02 MB/sec execute 290 sec latency 40.112 ms 2024-09-15T22:17:33.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 308866 4.03 MB/sec execute 291 sec latency 18.008 ms 2024-09-15T22:17:34.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 309393 4.02 MB/sec execute 292 sec latency 17.995 ms 2024-09-15T22:17:35.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 310150 4.02 MB/sec execute 293 sec latency 18.714 ms 2024-09-15T22:17:36.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 310977 4.01 MB/sec execute 294 sec latency 19.116 ms 2024-09-15T22:17:37.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 311901 4.03 MB/sec execute 295 sec latency 31.087 ms 2024-09-15T22:17:38.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 312469 4.03 MB/sec execute 296 sec latency 17.561 ms 2024-09-15T22:17:39.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 313030 4.02 MB/sec execute 297 sec latency 18.728 ms 2024-09-15T22:17:40.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 313778 4.02 MB/sec execute 298 sec latency 16.000 ms 2024-09-15T22:17:41.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 314564 4.01 MB/sec execute 299 sec latency 13.789 ms 2024-09-15T22:17:42.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 315463 4.02 MB/sec execute 300 sec latency 16.837 ms 2024-09-15T22:17:43.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 316020 4.02 MB/sec execute 301 sec latency 69.817 ms 2024-09-15T22:17:44.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 316538 4.01 MB/sec execute 302 sec latency 19.118 ms 2024-09-15T22:17:45.903 INFO:tasks.workunit.client.0.smithi078.stdout: 1 317313 4.01 MB/sec execute 303 sec latency 16.362 ms 2024-09-15T22:17:46.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 318113 4.01 MB/sec execute 304 sec latency 13.964 ms 2024-09-15T22:17:47.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 319012 4.02 MB/sec execute 305 sec latency 34.100 ms 2024-09-15T22:17:48.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 319627 4.02 MB/sec execute 306 sec latency 17.415 ms 2024-09-15T22:17:49.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 320235 4.01 MB/sec execute 307 sec latency 15.597 ms 2024-09-15T22:17:50.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 321057 4.01 MB/sec execute 308 sec latency 11.171 ms 2024-09-15T22:17:51.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 321822 4.01 MB/sec execute 309 sec latency 15.128 ms 2024-09-15T22:17:52.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 322631 4.02 MB/sec execute 310 sec latency 32.843 ms 2024-09-15T22:17:53.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 323287 4.02 MB/sec execute 311 sec latency 17.389 ms 2024-09-15T22:17:54.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 323971 4.01 MB/sec execute 312 sec latency 16.672 ms 2024-09-15T22:17:55.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 324801 4.01 MB/sec execute 313 sec latency 12.654 ms 2024-09-15T22:17:56.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 325672 4.02 MB/sec execute 314 sec latency 24.287 ms 2024-09-15T22:17:57.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 326445 4.02 MB/sec execute 315 sec latency 13.403 ms 2024-09-15T22:17:58.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 326964 4.01 MB/sec execute 316 sec latency 15.017 ms 2024-09-15T22:17:59.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 327740 4.02 MB/sec execute 317 sec latency 14.135 ms 2024-09-15T22:18:00.780 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:18:00.782 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:18:00.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 328555 4.01 MB/sec execute 318 sec latency 14.114 ms 2024-09-15T22:18:01.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 329523 4.02 MB/sec execute 319 sec latency 32.283 ms 2024-09-15T22:18:02.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 330140 4.02 MB/sec execute 320 sec latency 16.328 ms 2024-09-15T22:18:03.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 330693 4.01 MB/sec execute 321 sec latency 16.602 ms 2024-09-15T22:18:04.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 331451 4.02 MB/sec execute 322 sec latency 15.666 ms 2024-09-15T22:18:05.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 332278 4.01 MB/sec execute 323 sec latency 10.677 ms 2024-09-15T22:18:06.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 333198 4.02 MB/sec execute 324 sec latency 22.826 ms 2024-09-15T22:18:07.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 333808 4.02 MB/sec execute 325 sec latency 19.219 ms 2024-09-15T22:18:08.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 334397 4.01 MB/sec execute 326 sec latency 16.737 ms 2024-09-15T22:18:09.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 335238 4.01 MB/sec execute 327 sec latency 14.322 ms 2024-09-15T22:18:10.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 336007 4.01 MB/sec execute 328 sec latency 11.840 ms 2024-09-15T22:18:11.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 336803 4.02 MB/sec execute 329 sec latency 11.505 ms 2024-09-15T22:18:12.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 337451 4.02 MB/sec execute 330 sec latency 10.337 ms 2024-09-15T22:18:13.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 338152 4.01 MB/sec execute 331 sec latency 14.097 ms 2024-09-15T22:18:14.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 338981 4.01 MB/sec execute 332 sec latency 12.081 ms 2024-09-15T22:18:15.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 339855 4.02 MB/sec execute 333 sec latency 24.526 ms 2024-09-15T22:18:16.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 340630 4.02 MB/sec execute 334 sec latency 30.590 ms 2024-09-15T22:18:17.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 341145 4.02 MB/sec execute 335 sec latency 19.307 ms 2024-09-15T22:18:18.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 341920 4.02 MB/sec execute 336 sec latency 15.577 ms 2024-09-15T22:18:19.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 342767 4.01 MB/sec execute 337 sec latency 16.797 ms 2024-09-15T22:18:20.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 343684 4.02 MB/sec execute 338 sec latency 90.591 ms 2024-09-15T22:18:21.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 344309 4.02 MB/sec execute 339 sec latency 19.224 ms 2024-09-15T22:18:22.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 344857 4.01 MB/sec execute 340 sec latency 14.251 ms 2024-09-15T22:18:23.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 345629 4.02 MB/sec execute 341 sec latency 12.500 ms 2024-09-15T22:18:24.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 346459 4.01 MB/sec execute 342 sec latency 14.151 ms 2024-09-15T22:18:25.904 INFO:tasks.workunit.client.0.smithi078.stdout: 1 347374 4.02 MB/sec execute 343 sec latency 39.232 ms 2024-09-15T22:18:26.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 347985 4.02 MB/sec execute 344 sec latency 19.317 ms 2024-09-15T22:18:27.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 348562 4.01 MB/sec execute 345 sec latency 15.540 ms 2024-09-15T22:18:28.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 349421 4.01 MB/sec execute 346 sec latency 12.332 ms 2024-09-15T22:18:29.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 350181 4.01 MB/sec execute 347 sec latency 17.675 ms 2024-09-15T22:18:30.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 350985 4.02 MB/sec execute 348 sec latency 30.605 ms 2024-09-15T22:18:30.938 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:18:30.941 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:18:31.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 351630 4.02 MB/sec execute 349 sec latency 83.148 ms 2024-09-15T22:18:32.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 352321 4.01 MB/sec execute 350 sec latency 15.372 ms 2024-09-15T22:18:33.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 353153 4.01 MB/sec execute 351 sec latency 11.317 ms 2024-09-15T22:18:34.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 354059 4.02 MB/sec execute 352 sec latency 24.635 ms 2024-09-15T22:18:35.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 354809 4.02 MB/sec execute 353 sec latency 20.499 ms 2024-09-15T22:18:36.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 355358 4.02 MB/sec execute 354 sec latency 15.214 ms 2024-09-15T22:18:37.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 356119 4.02 MB/sec execute 355 sec latency 20.694 ms 2024-09-15T22:18:38.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 357001 4.01 MB/sec execute 356 sec latency 16.845 ms 2024-09-15T22:18:39.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 357904 4.02 MB/sec execute 357 sec latency 16.399 ms 2024-09-15T22:18:40.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 358513 4.02 MB/sec execute 358 sec latency 18.489 ms 2024-09-15T22:18:41.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 359083 4.01 MB/sec execute 359 sec latency 15.475 ms 2024-09-15T22:18:42.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 359861 4.02 MB/sec execute 360 sec latency 25.867 ms 2024-09-15T22:18:43.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 360683 4.01 MB/sec execute 361 sec latency 10.288 ms 2024-09-15T22:18:44.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 361565 4.02 MB/sec execute 362 sec latency 22.658 ms 2024-09-15T22:18:45.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 362201 4.02 MB/sec execute 363 sec latency 13.192 ms 2024-09-15T22:18:46.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 362794 4.01 MB/sec execute 364 sec latency 13.817 ms 2024-09-15T22:18:47.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 363629 4.01 MB/sec execute 365 sec latency 14.266 ms 2024-09-15T22:18:48.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 364398 4.01 MB/sec execute 366 sec latency 11.568 ms 2024-09-15T22:18:49.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 365311 4.03 MB/sec execute 367 sec latency 32.291 ms 2024-09-15T22:18:50.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 365874 4.02 MB/sec execute 368 sec latency 19.299 ms 2024-09-15T22:18:51.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 366554 4.01 MB/sec execute 369 sec latency 20.003 ms 2024-09-15T22:18:52.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 367410 4.01 MB/sec execute 370 sec latency 19.574 ms 2024-09-15T22:18:53.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 368304 4.02 MB/sec execute 371 sec latency 12.215 ms 2024-09-15T22:18:54.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 369043 4.02 MB/sec execute 372 sec latency 10.288 ms 2024-09-15T22:18:55.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 369572 4.02 MB/sec execute 373 sec latency 15.904 ms 2024-09-15T22:18:56.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 370293 4.02 MB/sec execute 374 sec latency 74.571 ms 2024-09-15T22:18:57.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 371107 4.01 MB/sec execute 375 sec latency 17.799 ms 2024-09-15T22:18:58.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 372080 4.02 MB/sec execute 376 sec latency 34.970 ms 2024-09-15T22:18:59.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 372700 4.02 MB/sec execute 377 sec latency 18.008 ms 2024-09-15T22:19:00.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 373258 4.02 MB/sec execute 378 sec latency 13.915 ms 2024-09-15T22:19:01.395 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:19:01.398 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:19:01.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 374040 4.02 MB/sec execute 379 sec latency 16.935 ms 2024-09-15T22:19:02.905 INFO:tasks.workunit.client.0.smithi078.stdout: 1 374861 4.01 MB/sec execute 380 sec latency 10.528 ms 2024-09-15T22:19:03.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 375751 4.02 MB/sec execute 381 sec latency 33.047 ms 2024-09-15T22:19:04.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 376395 4.02 MB/sec execute 382 sec latency 17.974 ms 2024-09-15T22:19:05.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 377042 4.02 MB/sec execute 383 sec latency 15.133 ms 2024-09-15T22:19:06.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 377915 4.02 MB/sec execute 384 sec latency 10.817 ms 2024-09-15T22:19:07.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 378758 4.02 MB/sec execute 385 sec latency 23.607 ms 2024-09-15T22:19:08.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 379582 4.03 MB/sec execute 386 sec latency 16.531 ms 2024-09-15T22:19:09.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 380146 4.02 MB/sec execute 387 sec latency 14.970 ms 2024-09-15T22:19:10.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 380848 4.01 MB/sec execute 388 sec latency 15.046 ms 2024-09-15T22:19:11.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 381663 4.01 MB/sec execute 389 sec latency 64.793 ms 2024-09-15T22:19:12.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 382555 4.02 MB/sec execute 390 sec latency 38.104 ms 2024-09-15T22:19:13.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 383324 4.03 MB/sec execute 391 sec latency 18.139 ms 2024-09-15T22:19:14.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 383847 4.02 MB/sec execute 392 sec latency 14.871 ms 2024-09-15T22:19:15.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 384634 4.02 MB/sec execute 393 sec latency 12.088 ms 2024-09-15T22:19:16.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 385491 4.01 MB/sec execute 394 sec latency 10.312 ms 2024-09-15T22:19:17.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 386429 4.02 MB/sec execute 395 sec latency 40.689 ms 2024-09-15T22:19:18.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 387019 4.02 MB/sec execute 396 sec latency 19.050 ms 2024-09-15T22:19:19.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 387615 4.02 MB/sec execute 397 sec latency 18.588 ms 2024-09-15T22:19:20.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 388440 4.02 MB/sec execute 398 sec latency 11.151 ms 2024-09-15T22:19:21.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 389166 4.01 MB/sec execute 399 sec latency 26.015 ms 2024-09-15T22:19:22.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 390006 4.02 MB/sec execute 400 sec latency 20.807 ms 2024-09-15T22:19:23.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 390668 4.02 MB/sec execute 401 sec latency 16.915 ms 2024-09-15T22:19:24.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 391323 4.02 MB/sec execute 402 sec latency 12.963 ms 2024-09-15T22:19:25.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 392129 4.02 MB/sec execute 403 sec latency 17.458 ms 2024-09-15T22:19:26.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 392979 4.02 MB/sec execute 404 sec latency 13.150 ms 2024-09-15T22:19:27.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 393799 4.03 MB/sec execute 405 sec latency 17.441 ms 2024-09-15T22:19:28.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 394380 4.02 MB/sec execute 406 sec latency 9.969 ms 2024-09-15T22:19:29.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 395058 4.02 MB/sec execute 407 sec latency 18.895 ms 2024-09-15T22:19:30.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 395943 4.01 MB/sec execute 408 sec latency 10.831 ms 2024-09-15T22:19:31.658 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:19:31.661 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:19:31.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 396784 4.02 MB/sec execute 409 sec latency 35.555 ms 2024-09-15T22:19:32.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 397544 4.03 MB/sec execute 410 sec latency 13.589 ms 2024-09-15T22:19:33.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 398066 4.02 MB/sec execute 411 sec latency 19.046 ms 2024-09-15T22:19:34.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 398846 4.02 MB/sec execute 412 sec latency 16.343 ms 2024-09-15T22:19:35.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 399675 4.01 MB/sec execute 413 sec latency 21.359 ms 2024-09-15T22:19:36.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 400600 4.02 MB/sec execute 414 sec latency 43.291 ms 2024-09-15T22:19:37.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 401194 4.02 MB/sec execute 415 sec latency 18.401 ms 2024-09-15T22:19:38.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 401797 4.02 MB/sec execute 416 sec latency 13.875 ms 2024-09-15T22:19:39.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 402601 4.02 MB/sec execute 417 sec latency 12.293 ms 2024-09-15T22:19:40.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 403366 4.01 MB/sec execute 418 sec latency 20.012 ms 2024-09-15T22:19:41.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 404192 4.02 MB/sec execute 419 sec latency 31.895 ms 2024-09-15T22:19:42.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 404865 4.02 MB/sec execute 420 sec latency 12.828 ms 2024-09-15T22:19:43.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 405543 4.02 MB/sec execute 421 sec latency 19.017 ms 2024-09-15T22:19:44.906 INFO:tasks.workunit.client.0.smithi078.stdout: 1 406379 4.02 MB/sec execute 422 sec latency 12.798 ms 2024-09-15T22:19:45.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 407270 4.02 MB/sec execute 423 sec latency 14.067 ms 2024-09-15T22:19:46.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 408019 4.03 MB/sec execute 424 sec latency 26.802 ms 2024-09-15T22:19:47.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 408570 4.02 MB/sec execute 425 sec latency 17.773 ms 2024-09-15T22:19:48.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 409341 4.02 MB/sec execute 426 sec latency 15.488 ms 2024-09-15T22:19:49.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 410152 4.01 MB/sec execute 427 sec latency 11.043 ms 2024-09-15T22:19:50.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 411135 4.02 MB/sec execute 428 sec latency 27.770 ms 2024-09-15T22:19:51.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 411739 4.03 MB/sec execute 429 sec latency 31.439 ms 2024-09-15T22:19:52.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 412301 4.02 MB/sec execute 430 sec latency 13.740 ms 2024-09-15T22:19:53.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 413086 4.02 MB/sec execute 431 sec latency 14.607 ms 2024-09-15T22:19:54.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 413901 4.02 MB/sec execute 432 sec latency 12.901 ms 2024-09-15T22:19:55.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 414807 4.02 MB/sec execute 433 sec latency 34.214 ms 2024-09-15T22:19:56.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 415435 4.02 MB/sec execute 434 sec latency 17.696 ms 2024-09-15T22:19:57.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 416077 4.02 MB/sec execute 435 sec latency 17.128 ms 2024-09-15T22:19:58.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 416901 4.02 MB/sec execute 436 sec latency 15.669 ms 2024-09-15T22:19:59.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 417655 4.02 MB/sec execute 437 sec latency 27.434 ms 2024-09-15T22:20:00.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 418559 4.03 MB/sec execute 438 sec latency 26.520 ms 2024-09-15T22:20:01.707 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:20:01.710 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:20:01.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 419135 4.02 MB/sec execute 439 sec latency 12.082 ms 2024-09-15T22:20:02.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 419816 4.02 MB/sec execute 440 sec latency 14.097 ms 2024-09-15T22:20:03.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 420661 4.02 MB/sec execute 441 sec latency 12.334 ms 2024-09-15T22:20:04.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 421498 4.02 MB/sec execute 442 sec latency 43.095 ms 2024-09-15T22:20:05.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 422254 4.03 MB/sec execute 443 sec latency 16.652 ms 2024-09-15T22:20:06.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 422756 4.02 MB/sec execute 444 sec latency 14.035 ms 2024-09-15T22:20:07.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 423520 4.02 MB/sec execute 445 sec latency 13.009 ms 2024-09-15T22:20:08.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 424309 4.02 MB/sec execute 446 sec latency 11.008 ms 2024-09-15T22:20:09.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 425146 4.02 MB/sec execute 447 sec latency 39.656 ms 2024-09-15T22:20:10.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 425901 4.03 MB/sec execute 448 sec latency 19.465 ms 2024-09-15T22:20:11.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 426366 4.02 MB/sec execute 449 sec latency 87.587 ms 2024-09-15T22:20:12.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 427128 4.02 MB/sec execute 450 sec latency 11.795 ms 2024-09-15T22:20:13.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 427979 4.02 MB/sec execute 451 sec latency 20.668 ms 2024-09-15T22:20:14.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 428947 4.02 MB/sec execute 452 sec latency 26.817 ms 2024-09-15T22:20:15.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 429530 4.02 MB/sec execute 453 sec latency 18.250 ms 2024-09-15T22:20:16.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 430046 4.02 MB/sec execute 454 sec latency 33.736 ms 2024-09-15T22:20:17.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 430817 4.02 MB/sec execute 455 sec latency 16.106 ms 2024-09-15T22:20:18.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 431618 4.01 MB/sec execute 456 sec latency 18.441 ms 2024-09-15T22:20:19.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 432530 4.02 MB/sec execute 457 sec latency 34.187 ms 2024-09-15T22:20:20.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 433156 4.02 MB/sec execute 458 sec latency 19.113 ms 2024-09-15T22:20:21.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 433820 4.02 MB/sec execute 459 sec latency 13.556 ms 2024-09-15T22:20:22.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 434638 4.02 MB/sec execute 460 sec latency 15.992 ms 2024-09-15T22:20:23.907 INFO:tasks.workunit.client.0.smithi078.stdout: 1 435383 4.01 MB/sec execute 461 sec latency 27.230 ms 2024-09-15T22:20:24.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 436300 4.03 MB/sec execute 462 sec latency 14.839 ms 2024-09-15T22:20:25.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 436883 4.02 MB/sec execute 463 sec latency 14.885 ms 2024-09-15T22:20:26.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 437552 4.02 MB/sec execute 464 sec latency 17.876 ms 2024-09-15T22:20:27.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 438404 4.02 MB/sec execute 465 sec latency 12.386 ms 2024-09-15T22:20:28.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 439279 4.02 MB/sec execute 466 sec latency 40.673 ms 2024-09-15T22:20:29.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 440016 4.02 MB/sec execute 467 sec latency 18.868 ms 2024-09-15T22:20:30.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 440539 4.02 MB/sec execute 468 sec latency 16.930 ms 2024-09-15T22:20:31.768 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:20:31.771 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:20:31.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 441271 4.02 MB/sec execute 469 sec latency 47.234 ms 2024-09-15T22:20:32.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 442117 4.01 MB/sec execute 470 sec latency 17.831 ms 2024-09-15T22:20:33.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 443062 4.02 MB/sec execute 471 sec latency 27.853 ms 2024-09-15T22:20:34.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 443684 4.02 MB/sec execute 472 sec latency 16.902 ms 2024-09-15T22:20:35.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 444214 4.02 MB/sec execute 473 sec latency 19.354 ms 2024-09-15T22:20:36.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 444965 4.02 MB/sec execute 474 sec latency 11.853 ms 2024-09-15T22:20:37.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 445789 4.01 MB/sec execute 475 sec latency 16.380 ms 2024-09-15T22:20:38.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 446708 4.02 MB/sec execute 476 sec latency 32.232 ms 2024-09-15T22:20:39.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 447322 4.02 MB/sec execute 477 sec latency 19.018 ms 2024-09-15T22:20:40.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 447928 4.02 MB/sec execute 478 sec latency 15.527 ms 2024-09-15T22:20:41.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 448758 4.02 MB/sec execute 479 sec latency 16.034 ms 2024-09-15T22:20:42.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 449523 4.01 MB/sec execute 480 sec latency 18.135 ms 2024-09-15T22:20:43.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 450313 4.02 MB/sec execute 481 sec latency 27.931 ms 2024-09-15T22:20:44.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 450993 4.02 MB/sec execute 482 sec latency 12.635 ms 2024-09-15T22:20:45.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 451671 4.02 MB/sec execute 483 sec latency 13.643 ms 2024-09-15T22:20:46.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 452533 4.02 MB/sec execute 484 sec latency 28.829 ms 2024-09-15T22:20:47.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 453364 4.02 MB/sec execute 485 sec latency 79.787 ms 2024-09-15T22:20:48.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 454124 4.02 MB/sec execute 486 sec latency 11.511 ms 2024-09-15T22:20:49.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 454657 4.02 MB/sec execute 487 sec latency 12.074 ms 2024-09-15T22:20:50.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 455429 4.02 MB/sec execute 488 sec latency 19.468 ms 2024-09-15T22:20:51.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 456262 4.01 MB/sec execute 489 sec latency 11.181 ms 2024-09-15T22:20:52.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 457223 4.02 MB/sec execute 490 sec latency 25.906 ms 2024-09-15T22:20:53.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 457849 4.02 MB/sec execute 491 sec latency 19.808 ms 2024-09-15T22:20:54.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 458344 4.02 MB/sec execute 492 sec latency 45.274 ms 2024-09-15T22:20:55.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 459198 4.05 MB/sec execute 493 sec latency 32.620 ms 2024-09-15T22:20:56.908 INFO:tasks.workunit.client.0.smithi078.stdout: 1 459973 4.05 MB/sec execute 494 sec latency 25.870 ms 2024-09-15T22:20:57.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 460745 4.05 MB/sec execute 495 sec latency 40.826 ms 2024-09-15T22:20:58.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 461663 4.06 MB/sec execute 496 sec latency 15.785 ms 2024-09-15T22:20:59.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 462303 4.06 MB/sec execute 497 sec latency 13.786 ms 2024-09-15T22:21:00.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 462940 4.05 MB/sec execute 498 sec latency 11.533 ms 2024-09-15T22:21:01.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 463750 4.05 MB/sec execute 499 sec latency 12.119 ms 2024-09-15T22:21:02.014 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:21:02.016 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:21:02.047 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-09-15T22:21:02.046+0000 7fc7d5ee9640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40603) UID: 0 2024-09-15T22:21:02.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 464478 4.05 MB/sec execute 500 sec latency 28.322 ms 2024-09-15T22:21:03.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 465235 4.05 MB/sec execute 501 sec latency 37.608 ms 2024-09-15T22:21:04.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 465901 4.05 MB/sec execute 502 sec latency 20.986 ms 2024-09-15T22:21:05.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 466549 4.05 MB/sec execute 503 sec latency 14.366 ms 2024-09-15T22:21:06.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 467342 4.05 MB/sec execute 504 sec latency 18.270 ms 2024-09-15T22:21:07.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 468067 4.05 MB/sec execute 505 sec latency 14.246 ms 2024-09-15T22:21:08.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 468998 4.06 MB/sec execute 506 sec latency 14.680 ms 2024-09-15T22:21:09.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 469528 4.05 MB/sec execute 507 sec latency 10.532 ms 2024-09-15T22:21:10.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 470173 4.05 MB/sec execute 508 sec latency 23.613 ms 2024-09-15T22:21:11.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 471042 4.05 MB/sec execute 509 sec latency 13.509 ms 2024-09-15T22:21:12.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 471820 4.05 MB/sec execute 510 sec latency 29.240 ms 2024-09-15T22:21:13.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 472612 4.06 MB/sec execute 511 sec latency 15.884 ms 2024-09-15T22:21:14.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 473159 4.05 MB/sec execute 512 sec latency 10.765 ms 2024-09-15T22:21:15.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 473923 4.05 MB/sec execute 513 sec latency 13.632 ms 2024-09-15T22:21:16.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 474730 4.05 MB/sec execute 514 sec latency 21.119 ms 2024-09-15T22:21:17.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 475712 4.05 MB/sec execute 515 sec latency 26.404 ms 2024-09-15T22:21:18.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 476339 4.06 MB/sec execute 516 sec latency 19.436 ms 2024-09-15T22:21:19.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 476895 4.05 MB/sec execute 517 sec latency 18.688 ms 2024-09-15T22:21:20.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 477646 4.05 MB/sec execute 518 sec latency 17.660 ms 2024-09-15T22:21:21.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 478497 4.05 MB/sec execute 519 sec latency 12.169 ms 2024-09-15T22:21:22.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 479413 4.05 MB/sec execute 520 sec latency 40.007 ms 2024-09-15T22:21:23.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 479993 4.05 MB/sec execute 521 sec latency 12.472 ms 2024-09-15T22:21:24.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 480582 4.05 MB/sec execute 522 sec latency 13.775 ms 2024-09-15T22:21:25.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 481375 4.05 MB/sec execute 523 sec latency 14.494 ms 2024-09-15T22:21:26.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 482164 4.05 MB/sec execute 524 sec latency 12.088 ms 2024-09-15T22:21:27.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 483000 4.05 MB/sec execute 525 sec latency 49.237 ms 2024-09-15T22:21:28.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 483681 4.05 MB/sec execute 526 sec latency 19.179 ms 2024-09-15T22:21:29.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 484340 4.05 MB/sec execute 527 sec latency 19.558 ms 2024-09-15T22:21:30.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 485151 4.05 MB/sec execute 528 sec latency 11.696 ms 2024-09-15T22:21:31.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 485976 4.05 MB/sec execute 529 sec latency 38.433 ms 2024-09-15T22:21:32.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 486793 4.05 MB/sec execute 530 sec latency 21.344 ms 2024-09-15T22:21:33.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 487389 4.05 MB/sec execute 531 sec latency 11.782 ms 2024-09-15T22:21:34.909 INFO:tasks.workunit.client.0.smithi078.stdout: 1 488165 4.05 MB/sec execute 532 sec latency 23.214 ms 2024-09-15T22:21:35.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 488974 4.05 MB/sec execute 533 sec latency 12.342 ms 2024-09-15T22:21:36.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 489968 4.05 MB/sec execute 534 sec latency 46.487 ms 2024-09-15T22:21:37.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 490570 4.05 MB/sec execute 535 sec latency 24.788 ms 2024-09-15T22:21:38.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 491142 4.05 MB/sec execute 536 sec latency 13.790 ms 2024-09-15T22:21:39.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 491919 4.05 MB/sec execute 537 sec latency 17.538 ms 2024-09-15T22:21:40.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 492710 4.05 MB/sec execute 538 sec latency 18.391 ms 2024-09-15T22:21:41.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 493618 4.05 MB/sec execute 539 sec latency 37.100 ms 2024-09-15T22:21:42.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 494217 4.05 MB/sec execute 540 sec latency 12.974 ms 2024-09-15T22:21:43.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 494792 4.05 MB/sec execute 541 sec latency 17.268 ms 2024-09-15T22:21:44.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 495557 4.05 MB/sec execute 542 sec latency 19.425 ms 2024-09-15T22:21:45.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 496342 4.04 MB/sec execute 543 sec latency 24.712 ms 2024-09-15T22:21:46.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 497175 4.05 MB/sec execute 544 sec latency 28.358 ms 2024-09-15T22:21:47.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 497800 4.05 MB/sec execute 545 sec latency 11.252 ms 2024-09-15T22:21:48.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 498436 4.05 MB/sec execute 546 sec latency 27.478 ms 2024-09-15T22:21:49.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 499191 4.05 MB/sec execute 547 sec latency 17.088 ms 2024-09-15T22:21:50.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 499899 4.04 MB/sec execute 548 sec latency 29.139 ms 2024-09-15T22:21:51.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 500726 4.05 MB/sec execute 549 sec latency 16.891 ms 2024-09-15T22:21:52.913 INFO:tasks.workunit.client.0.smithi078.stdout: 1 501368 4.05 MB/sec execute 550 sec latency 14.039 ms 2024-09-15T22:21:53.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 501978 4.04 MB/sec execute 551 sec latency 27.546 ms 2024-09-15T22:21:54.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 502765 4.04 MB/sec execute 552 sec latency 13.704 ms 2024-09-15T22:21:55.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 503517 4.04 MB/sec execute 553 sec latency 38.032 ms 2024-09-15T22:21:56.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 504292 4.05 MB/sec execute 554 sec latency 12.191 ms 2024-09-15T22:21:57.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 504963 4.05 MB/sec execute 555 sec latency 17.357 ms 2024-09-15T22:21:58.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 505642 4.04 MB/sec execute 556 sec latency 16.557 ms 2024-09-15T22:21:59.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 506458 4.04 MB/sec execute 557 sec latency 11.079 ms 2024-09-15T22:22:00.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 507254 4.04 MB/sec execute 558 sec latency 25.548 ms 2024-09-15T22:22:01.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 508040 4.05 MB/sec execute 559 sec latency 20.100 ms 2024-09-15T22:22:02.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 508568 4.04 MB/sec execute 560 sec latency 48.841 ms 2024-09-15T22:22:03.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 509241 4.04 MB/sec execute 561 sec latency 18.568 ms 2024-09-15T22:22:04.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 510073 4.04 MB/sec execute 562 sec latency 16.723 ms 2024-09-15T22:22:05.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 510907 4.04 MB/sec execute 563 sec latency 32.022 ms 2024-09-15T22:22:06.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 511662 4.05 MB/sec execute 564 sec latency 20.045 ms 2024-09-15T22:22:07.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 512166 4.04 MB/sec execute 565 sec latency 18.542 ms 2024-09-15T22:22:08.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 512813 4.04 MB/sec execute 566 sec latency 15.286 ms 2024-09-15T22:22:09.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 513662 4.04 MB/sec execute 567 sec latency 13.469 ms 2024-09-15T22:22:10.910 INFO:tasks.workunit.client.0.smithi078.stdout: 1 514501 4.04 MB/sec execute 568 sec latency 17.625 ms 2024-09-15T22:22:11.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 515242 4.05 MB/sec execute 569 sec latency 19.723 ms 2024-09-15T22:22:12.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 515738 4.04 MB/sec execute 570 sec latency 11.012 ms 2024-09-15T22:22:13.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 516375 4.04 MB/sec execute 571 sec latency 19.618 ms 2024-09-15T22:22:14.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 517223 4.04 MB/sec execute 572 sec latency 18.774 ms 2024-09-15T22:22:15.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 518095 4.04 MB/sec execute 573 sec latency 30.000 ms 2024-09-15T22:22:16.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 518813 4.04 MB/sec execute 574 sec latency 19.407 ms 2024-09-15T22:22:17.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 519339 4.04 MB/sec execute 575 sec latency 20.892 ms 2024-09-15T22:22:18.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 520081 4.04 MB/sec execute 576 sec latency 17.176 ms 2024-09-15T22:22:19.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 520876 4.04 MB/sec execute 577 sec latency 11.193 ms 2024-09-15T22:22:20.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 521841 4.04 MB/sec execute 578 sec latency 30.682 ms 2024-09-15T22:22:21.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 522450 4.04 MB/sec execute 579 sec latency 19.023 ms 2024-09-15T22:22:22.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 522930 4.04 MB/sec execute 580 sec latency 63.574 ms 2024-09-15T22:22:23.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 523683 4.04 MB/sec execute 581 sec latency 14.542 ms 2024-09-15T22:22:24.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 524537 4.04 MB/sec execute 582 sec latency 10.827 ms 2024-09-15T22:22:25.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 525480 4.04 MB/sec execute 583 sec latency 38.987 ms 2024-09-15T22:22:26.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 526013 4.04 MB/sec execute 584 sec latency 11.806 ms 2024-09-15T22:22:27.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 526535 4.04 MB/sec execute 585 sec latency 38.741 ms 2024-09-15T22:22:28.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 527273 4.04 MB/sec execute 586 sec latency 13.963 ms 2024-09-15T22:22:29.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 528113 4.03 MB/sec execute 587 sec latency 16.710 ms 2024-09-15T22:22:30.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 529053 4.04 MB/sec execute 588 sec latency 34.457 ms 2024-09-15T22:22:31.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 529646 4.04 MB/sec execute 589 sec latency 11.564 ms 2024-09-15T22:22:32.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 530243 4.03 MB/sec execute 590 sec latency 16.222 ms 2024-09-15T22:22:33.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 530978 4.04 MB/sec execute 591 sec latency 17.048 ms 2024-09-15T22:22:34.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 531808 4.03 MB/sec execute 592 sec latency 22.012 ms 2024-09-15T22:22:35.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 532657 4.04 MB/sec execute 593 sec latency 38.180 ms 2024-09-15T22:22:36.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 533297 4.04 MB/sec execute 594 sec latency 10.582 ms 2024-09-15T22:22:37.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 533944 4.04 MB/sec execute 595 sec latency 22.332 ms 2024-09-15T22:22:38.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 534755 4.03 MB/sec execute 596 sec latency 11.343 ms 2024-09-15T22:22:39.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 535493 4.03 MB/sec execute 597 sec latency 47.363 ms 2024-09-15T22:22:40.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 536412 4.04 MB/sec execute 598 sec latency 20.817 ms 2024-09-15T22:22:41.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 536956 4.04 MB/sec execute 599 sec latency 10.679 ms 2024-09-15T22:22:42.911 INFO:tasks.workunit.client.0.smithi078.stdout: 1 cleanup 600 sec 2024-09-15T22:22:43.183 INFO:tasks.workunit.client.0.smithi078.stdout: 0 cleanup 600 sec 2024-09-15T22:22:43.183 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-15T22:22:43.183 INFO:tasks.workunit.client.0.smithi078.stdout: Operation Count AvgLat MaxLat 2024-09-15T22:22:43.183 INFO:tasks.workunit.client.0.smithi078.stdout: ---------------------------------------- 2024-09-15T22:22:43.183 INFO:tasks.workunit.client.0.smithi078.stdout: NTCreateX 77102 2.234 89.738 2024-09-15T22:22:43.183 INFO:tasks.workunit.client.0.smithi078.stdout: Close 56610 0.044 2.046 2024-09-15T22:22:43.183 INFO:tasks.workunit.client.0.smithi078.stdout: Rename 3266 7.325 89.352 2024-09-15T22:22:43.183 INFO:tasks.workunit.client.0.smithi078.stdout: Unlink 15596 2.411 31.435 2024-09-15T22:22:43.183 INFO:tasks.workunit.client.0.smithi078.stdout: Deltree 2 109.392 186.169 2024-09-15T22:22:43.184 INFO:tasks.workunit.client.0.smithi078.stdout: Mkdir 1 0.213 0.213 2024-09-15T22:22:43.184 INFO:tasks.workunit.client.0.smithi078.stdout: Qpathinfo 69849 1.416 51.357 2024-09-15T22:22:43.184 INFO:tasks.workunit.client.0.smithi078.stdout: Qfileinfo 12229 0.066 4.726 2024-09-15T22:22:43.184 INFO:tasks.workunit.client.0.smithi078.stdout: Qfsinfo 12835 0.265 10.401 2024-09-15T22:22:43.184 INFO:tasks.workunit.client.0.smithi078.stdout: Sfileinfo 6279 0.598 5.045 2024-09-15T22:22:43.184 INFO:tasks.workunit.client.0.smithi078.stdout: Find 27028 8.359 110.368 2024-09-15T22:22:43.184 INFO:tasks.workunit.client.0.smithi078.stdout: WriteX 38434 0.149 21.911 2024-09-15T22:22:43.184 INFO:tasks.workunit.client.0.smithi078.stdout: ReadX 120818 0.003 0.689 2024-09-15T22:22:43.184 INFO:tasks.workunit.client.0.smithi078.stdout: LockX 250 0.610 5.508 2024-09-15T22:22:43.184 INFO:tasks.workunit.client.0.smithi078.stdout: UnlockX 250 0.468 5.699 2024-09-15T22:22:43.184 INFO:tasks.workunit.client.0.smithi078.stdout: Flush 5412 4.310 28.350 2024-09-15T22:22:43.184 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-15T22:22:43.185 INFO:tasks.workunit.client.0.smithi078.stdout:Throughput 4.03692 MB/sec 1 clients 1 procs max_latency=110.370 ms 2024-09-15T22:22:43.185 INFO:tasks.workunit.client.0.smithi078.stderr:+ dbench 10 2024-09-15T22:22:43.185 INFO:tasks.workunit.client.0.smithi078.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-09-15T22:22:43.185 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-15T22:22:43.186 INFO:tasks.workunit.client.0.smithi078.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-09-15T22:22:43.186 INFO:tasks.workunit.client.0.smithi078.stdout:8 of 10 processes prepared for launch 0 sec 2024-09-15T22:22:43.284 INFO:tasks.workunit.client.0.smithi078.stdout:10 of 10 processes prepared for launch 0 sec 2024-09-15T22:22:43.285 INFO:tasks.workunit.client.0.smithi078.stdout:releasing clients 2024-09-15T22:22:44.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 259 97.94 MB/sec warmup 1 sec latency 47.726 ms 2024-09-15T22:22:45.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 458 80.44 MB/sec warmup 2 sec latency 74.503 ms 2024-09-15T22:22:46.284 INFO:tasks.workunit.client.0.smithi078.stdout: 10 685 70.64 MB/sec warmup 3 sec latency 90.413 ms 2024-09-15T22:22:47.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 859 53.99 MB/sec warmup 4 sec latency 94.366 ms 2024-09-15T22:22:48.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 1018 45.02 MB/sec warmup 5 sec latency 76.292 ms 2024-09-15T22:22:49.284 INFO:tasks.workunit.client.0.smithi078.stdout: 10 1172 38.37 MB/sec warmup 6 sec latency 83.704 ms 2024-09-15T22:22:50.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 1353 35.92 MB/sec warmup 7 sec latency 164.373 ms 2024-09-15T22:22:51.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 1497 32.57 MB/sec warmup 8 sec latency 171.363 ms 2024-09-15T22:22:52.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 1645 29.10 MB/sec warmup 9 sec latency 130.025 ms 2024-09-15T22:22:53.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 1843 26.35 MB/sec warmup 10 sec latency 117.235 ms 2024-09-15T22:22:54.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 2017 24.13 MB/sec warmup 11 sec latency 114.590 ms 2024-09-15T22:22:55.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 2194 22.37 MB/sec warmup 12 sec latency 86.442 ms 2024-09-15T22:22:56.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 2353 21.44 MB/sec warmup 13 sec latency 98.266 ms 2024-09-15T22:22:57.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 2472 20.30 MB/sec warmup 14 sec latency 92.663 ms 2024-09-15T22:22:58.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 2643 19.82 MB/sec warmup 15 sec latency 76.674 ms 2024-09-15T22:22:59.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 2949 20.86 MB/sec warmup 16 sec latency 100.048 ms 2024-09-15T22:23:00.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 3261 20.66 MB/sec warmup 17 sec latency 95.597 ms 2024-09-15T22:23:01.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 3306 19.65 MB/sec warmup 18 sec latency 119.602 ms 2024-09-15T22:23:02.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 3326 18.62 MB/sec warmup 19 sec latency 161.267 ms 2024-09-15T22:23:03.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 3439 18.32 MB/sec warmup 20 sec latency 92.880 ms 2024-09-15T22:23:04.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 3672 18.47 MB/sec warmup 21 sec latency 78.937 ms 2024-09-15T22:23:05.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 3811 18.07 MB/sec warmup 22 sec latency 99.288 ms 2024-09-15T22:23:06.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 3915 17.40 MB/sec warmup 23 sec latency 100.122 ms 2024-09-15T22:23:07.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 4011 16.69 MB/sec warmup 24 sec latency 96.987 ms 2024-09-15T22:23:08.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 4132 16.04 MB/sec warmup 25 sec latency 94.051 ms 2024-09-15T22:23:09.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 4263 15.50 MB/sec warmup 26 sec latency 181.152 ms 2024-09-15T22:23:10.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 4407 15.06 MB/sec warmup 27 sec latency 140.604 ms 2024-09-15T22:23:11.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 4534 14.69 MB/sec warmup 28 sec latency 176.746 ms 2024-09-15T22:23:12.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 4681 14.51 MB/sec warmup 29 sec latency 132.748 ms 2024-09-15T22:23:13.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 4853 14.36 MB/sec warmup 30 sec latency 84.750 ms 2024-09-15T22:23:14.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 5046 14.57 MB/sec warmup 31 sec latency 77.219 ms 2024-09-15T22:23:15.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 5194 14.16 MB/sec warmup 32 sec latency 87.019 ms 2024-09-15T22:23:16.024 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:23:16.027 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:23:16.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 5387 13.77 MB/sec warmup 33 sec latency 91.569 ms 2024-09-15T22:23:17.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 5562 13.43 MB/sec warmup 34 sec latency 77.439 ms 2024-09-15T22:23:18.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 5729 13.12 MB/sec warmup 35 sec latency 83.483 ms 2024-09-15T22:23:19.286 INFO:tasks.workunit.client.0.smithi078.stdout: 10 5907 13.05 MB/sec warmup 36 sec latency 75.077 ms 2024-09-15T22:23:20.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 6025 12.85 MB/sec warmup 37 sec latency 92.527 ms 2024-09-15T22:23:21.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 6191 12.89 MB/sec warmup 38 sec latency 97.357 ms 2024-09-15T22:23:22.286 INFO:tasks.workunit.client.0.smithi078.stdout: 10 6466 13.35 MB/sec warmup 39 sec latency 104.135 ms 2024-09-15T22:23:23.286 INFO:tasks.workunit.client.0.smithi078.stdout: 10 6755 13.44 MB/sec warmup 40 sec latency 100.283 ms 2024-09-15T22:23:24.285 INFO:tasks.workunit.client.0.smithi078.stdout: 10 6855 13.29 MB/sec warmup 41 sec latency 121.701 ms 2024-09-15T22:23:25.286 INFO:tasks.workunit.client.0.smithi078.stdout: 10 6879 12.97 MB/sec warmup 42 sec latency 95.670 ms 2024-09-15T22:23:26.286 INFO:tasks.workunit.client.0.smithi078.stdout: 10 6983 12.96 MB/sec warmup 43 sec latency 130.459 ms 2024-09-15T22:23:27.286 INFO:tasks.workunit.client.0.smithi078.stdout: 10 7198 13.15 MB/sec warmup 44 sec latency 86.686 ms 2024-09-15T22:23:28.286 INFO:tasks.workunit.client.0.smithi078.stdout: 10 7349 13.06 MB/sec warmup 45 sec latency 100.494 ms 2024-09-15T22:23:29.286 INFO:tasks.workunit.client.0.smithi078.stdout: 10 7445 12.84 MB/sec warmup 46 sec latency 112.976 ms 2024-09-15T22:23:30.286 INFO:tasks.workunit.client.0.smithi078.stdout: 10 7539 12.59 MB/sec warmup 47 sec latency 136.371 ms 2024-09-15T22:23:31.286 INFO:tasks.workunit.client.0.smithi078.stdout: 10 7654 12.33 MB/sec warmup 48 sec latency 128.032 ms 2024-09-15T22:23:32.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 7778 12.12 MB/sec warmup 49 sec latency 113.054 ms 2024-09-15T22:23:33.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 7906 11.93 MB/sec warmup 50 sec latency 161.160 ms 2024-09-15T22:23:34.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 8054 11.79 MB/sec warmup 51 sec latency 83.793 ms 2024-09-15T22:23:35.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 8206 11.77 MB/sec warmup 52 sec latency 128.240 ms 2024-09-15T22:23:36.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 8343 11.62 MB/sec warmup 53 sec latency 119.604 ms 2024-09-15T22:23:37.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 8546 11.90 MB/sec warmup 54 sec latency 94.342 ms 2024-09-15T22:23:38.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 8695 11.71 MB/sec warmup 55 sec latency 72.652 ms 2024-09-15T22:23:39.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 8878 11.52 MB/sec warmup 56 sec latency 112.229 ms 2024-09-15T22:23:40.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 9065 11.35 MB/sec warmup 57 sec latency 73.047 ms 2024-09-15T22:23:41.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 9239 11.21 MB/sec warmup 58 sec latency 91.949 ms 2024-09-15T22:23:42.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 9419 11.16 MB/sec warmup 59 sec latency 93.096 ms 2024-09-15T22:23:43.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 9535 11.08 MB/sec warmup 60 sec latency 90.425 ms 2024-09-15T22:23:44.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 9681 11.06 MB/sec warmup 61 sec latency 85.771 ms 2024-09-15T22:23:45.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 9935 11.42 MB/sec warmup 62 sec latency 86.382 ms 2024-09-15T22:23:46.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 10208 11.51 MB/sec warmup 63 sec latency 81.753 ms 2024-09-15T22:23:46.368 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:23:46.370 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:23:47.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 10391 11.50 MB/sec warmup 64 sec latency 171.982 ms 2024-09-15T22:23:48.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 10416 11.32 MB/sec warmup 65 sec latency 94.870 ms 2024-09-15T22:23:49.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 10476 11.22 MB/sec warmup 66 sec latency 78.183 ms 2024-09-15T22:23:50.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 10686 11.47 MB/sec warmup 67 sec latency 95.181 ms 2024-09-15T22:23:51.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 10843 11.41 MB/sec warmup 68 sec latency 102.189 ms 2024-09-15T22:23:52.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 10957 11.32 MB/sec warmup 69 sec latency 94.450 ms 2024-09-15T22:23:53.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 11058 11.19 MB/sec warmup 70 sec latency 99.378 ms 2024-09-15T22:23:54.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 11161 11.03 MB/sec warmup 71 sec latency 123.569 ms 2024-09-15T22:23:55.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 11270 10.89 MB/sec warmup 72 sec latency 169.307 ms 2024-09-15T22:23:56.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 11417 10.78 MB/sec warmup 73 sec latency 98.507 ms 2024-09-15T22:23:57.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 11555 10.69 MB/sec warmup 74 sec latency 161.479 ms 2024-09-15T22:23:58.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 11684 10.63 MB/sec warmup 75 sec latency 155.890 ms 2024-09-15T22:23:59.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 11849 10.62 MB/sec warmup 76 sec latency 94.211 ms 2024-09-15T22:24:00.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 12035 10.68 MB/sec warmup 77 sec latency 80.240 ms 2024-09-15T22:24:01.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 12210 10.70 MB/sec warmup 78 sec latency 73.317 ms 2024-09-15T22:24:02.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 12371 10.58 MB/sec warmup 79 sec latency 88.080 ms 2024-09-15T22:24:03.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 12559 10.47 MB/sec warmup 80 sec latency 99.142 ms 2024-09-15T22:24:04.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 12735 10.37 MB/sec warmup 81 sec latency 82.958 ms 2024-09-15T22:24:05.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 12914 10.32 MB/sec warmup 82 sec latency 83.669 ms 2024-09-15T22:24:06.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 13051 10.29 MB/sec warmup 83 sec latency 82.729 ms 2024-09-15T22:24:07.287 INFO:tasks.workunit.client.0.smithi078.stdout: 10 13166 10.24 MB/sec warmup 84 sec latency 197.968 ms 2024-09-15T22:24:08.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 13362 10.36 MB/sec warmup 85 sec latency 92.250 ms 2024-09-15T22:24:09.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 13648 10.56 MB/sec warmup 86 sec latency 83.215 ms 2024-09-15T22:24:10.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 13905 10.62 MB/sec warmup 87 sec latency 97.349 ms 2024-09-15T22:24:11.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 13957 10.54 MB/sec warmup 88 sec latency 111.055 ms 2024-09-15T22:24:12.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 13997 10.45 MB/sec warmup 89 sec latency 83.949 ms 2024-09-15T22:24:13.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 14133 10.48 MB/sec warmup 90 sec latency 83.756 ms 2024-09-15T22:24:14.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 14347 10.60 MB/sec warmup 91 sec latency 96.353 ms 2024-09-15T22:24:15.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 14474 10.56 MB/sec warmup 92 sec latency 115.411 ms 2024-09-15T22:24:16.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 14571 10.47 MB/sec warmup 93 sec latency 99.760 ms 2024-09-15T22:24:16.624 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:24:16.627 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:24:17.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 14671 10.37 MB/sec warmup 94 sec latency 104.858 ms 2024-09-15T22:24:18.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 14789 10.26 MB/sec warmup 95 sec latency 107.823 ms 2024-09-15T22:24:19.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 14930 10.18 MB/sec warmup 96 sec latency 134.331 ms 2024-09-15T22:24:20.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 15046 10.11 MB/sec warmup 97 sec latency 188.104 ms 2024-09-15T22:24:21.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 15196 10.07 MB/sec warmup 98 sec latency 81.311 ms 2024-09-15T22:24:22.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 15323 10.05 MB/sec warmup 99 sec latency 163.163 ms 2024-09-15T22:24:23.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 15501 10.07 MB/sec warmup 100 sec latency 81.244 ms 2024-09-15T22:24:24.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 15684 10.15 MB/sec warmup 101 sec latency 98.338 ms 2024-09-15T22:24:25.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 15842 10.06 MB/sec warmup 102 sec latency 81.835 ms 2024-09-15T22:24:26.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 16024 9.98 MB/sec warmup 103 sec latency 82.773 ms 2024-09-15T22:24:27.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 16208 9.91 MB/sec warmup 104 sec latency 75.104 ms 2024-09-15T22:24:28.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 16388 9.87 MB/sec warmup 105 sec latency 94.983 ms 2024-09-15T22:24:29.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 16550 9.85 MB/sec warmup 106 sec latency 86.890 ms 2024-09-15T22:24:30.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 16663 9.80 MB/sec warmup 107 sec latency 96.472 ms 2024-09-15T22:24:31.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 16860 9.89 MB/sec warmup 108 sec latency 77.535 ms 2024-09-15T22:24:32.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 17072 10.01 MB/sec warmup 109 sec latency 198.035 ms 2024-09-15T22:24:33.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 17346 10.09 MB/sec warmup 110 sec latency 96.692 ms 2024-09-15T22:24:34.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 17490 10.08 MB/sec warmup 111 sec latency 119.538 ms 2024-09-15T22:24:35.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 17533 10.01 MB/sec warmup 112 sec latency 86.688 ms 2024-09-15T22:24:36.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 17645 10.04 MB/sec warmup 113 sec latency 86.723 ms 2024-09-15T22:24:37.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 17818 10.10 MB/sec warmup 114 sec latency 119.046 ms 2024-09-15T22:24:38.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 17969 10.08 MB/sec warmup 115 sec latency 86.961 ms 2024-09-15T22:24:39.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 18086 10.04 MB/sec warmup 116 sec latency 90.462 ms 2024-09-15T22:24:40.288 INFO:tasks.workunit.client.0.smithi078.stdout: 10 18191 9.96 MB/sec warmup 117 sec latency 99.499 ms 2024-09-15T22:24:41.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 18305 9.88 MB/sec warmup 118 sec latency 112.141 ms 2024-09-15T22:24:42.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 18440 9.81 MB/sec warmup 119 sec latency 107.313 ms 2024-09-15T22:24:44.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 18720 5.63 MB/sec execute 1 sec latency 151.213 ms 2024-09-15T22:24:45.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 18875 7.69 MB/sec execute 2 sec latency 133.092 ms 2024-09-15T22:24:46.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 19044 9.07 MB/sec execute 3 sec latency 87.216 ms 2024-09-15T22:24:46.801 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:24:46.804 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:24:46.837 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-09-15T22:24:46.835+0000 7fc7d5ee9640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40711) UID: 0 2024-09-15T22:24:47.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 19229 11.10 MB/sec execute 4 sec latency 92.776 ms 2024-09-15T22:24:48.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 19374 9.10 MB/sec execute 5 sec latency 84.592 ms 2024-09-15T22:24:49.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 19546 7.84 MB/sec execute 6 sec latency 89.003 ms 2024-09-15T22:24:50.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 19730 6.98 MB/sec execute 7 sec latency 91.140 ms 2024-09-15T22:24:51.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 19906 6.50 MB/sec execute 8 sec latency 88.638 ms 2024-09-15T22:24:52.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 20092 6.72 MB/sec execute 9 sec latency 77.047 ms 2024-09-15T22:24:53.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 20232 7.05 MB/sec execute 10 sec latency 95.555 ms 2024-09-15T22:24:54.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 20366 6.91 MB/sec execute 11 sec latency 105.016 ms 2024-09-15T22:24:55.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 20613 8.52 MB/sec execute 12 sec latency 114.834 ms 2024-09-15T22:24:56.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 20858 9.27 MB/sec execute 13 sec latency 158.845 ms 2024-09-15T22:24:57.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 21036 9.58 MB/sec execute 14 sec latency 179.394 ms 2024-09-15T22:24:58.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 21107 9.40 MB/sec execute 15 sec latency 138.871 ms 2024-09-15T22:24:59.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 21155 8.91 MB/sec execute 16 sec latency 84.725 ms 2024-09-15T22:25:00.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 21304 9.47 MB/sec execute 17 sec latency 138.638 ms 2024-09-15T22:25:01.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 21483 9.84 MB/sec execute 18 sec latency 331.785 ms 2024-09-15T22:25:02.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 21593 9.44 MB/sec execute 19 sec latency 102.765 ms 2024-09-15T22:25:03.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 21691 9.20 MB/sec execute 20 sec latency 133.055 ms 2024-09-15T22:25:04.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 21797 8.82 MB/sec execute 21 sec latency 95.256 ms 2024-09-15T22:25:05.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 21901 8.44 MB/sec execute 22 sec latency 145.003 ms 2024-09-15T22:25:06.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 22030 8.16 MB/sec execute 23 sec latency 103.694 ms 2024-09-15T22:25:07.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 22155 7.97 MB/sec execute 24 sec latency 148.819 ms 2024-09-15T22:25:08.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 22280 7.80 MB/sec execute 25 sec latency 171.483 ms 2024-09-15T22:25:09.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 22408 7.86 MB/sec execute 26 sec latency 145.750 ms 2024-09-15T22:25:10.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 22569 7.85 MB/sec execute 27 sec latency 84.791 ms 2024-09-15T22:25:11.289 INFO:tasks.workunit.client.0.smithi078.stdout: 10 22743 8.11 MB/sec execute 28 sec latency 97.597 ms 2024-09-15T22:25:12.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 22904 8.17 MB/sec execute 29 sec latency 106.336 ms 2024-09-15T22:25:13.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 23074 7.95 MB/sec execute 30 sec latency 103.802 ms 2024-09-15T22:25:14.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 23256 7.74 MB/sec execute 31 sec latency 103.422 ms 2024-09-15T22:25:15.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 23417 7.59 MB/sec execute 32 sec latency 107.438 ms 2024-09-15T22:25:16.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 23609 7.61 MB/sec execute 33 sec latency 74.117 ms 2024-09-15T22:25:17.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 23731 7.55 MB/sec execute 34 sec latency 134.564 ms 2024-09-15T22:25:18.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 23870 7.61 MB/sec execute 35 sec latency 98.409 ms 2024-09-15T22:25:19.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 24099 8.09 MB/sec execute 36 sec latency 102.744 ms 2024-09-15T22:25:20.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 24322 8.36 MB/sec execute 37 sec latency 98.118 ms 2024-09-15T22:25:21.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 24550 8.54 MB/sec execute 38 sec latency 93.822 ms 2024-09-15T22:25:22.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 24638 8.44 MB/sec execute 39 sec latency 96.587 ms 2024-09-15T22:25:23.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 24699 8.32 MB/sec execute 40 sec latency 84.780 ms 2024-09-15T22:25:24.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 24852 8.60 MB/sec execute 41 sec latency 103.416 ms 2024-09-15T22:25:25.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 25020 8.72 MB/sec execute 42 sec latency 100.865 ms 2024-09-15T22:25:26.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 25148 8.65 MB/sec execute 43 sec latency 91.011 ms 2024-09-15T22:25:27.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 25241 8.53 MB/sec execute 44 sec latency 153.953 ms 2024-09-15T22:25:28.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 25345 8.37 MB/sec execute 45 sec latency 125.560 ms 2024-09-15T22:25:29.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 25463 8.20 MB/sec execute 46 sec latency 121.317 ms 2024-09-15T22:25:30.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 25589 8.07 MB/sec execute 47 sec latency 128.518 ms 2024-09-15T22:25:31.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 25705 7.97 MB/sec execute 48 sec latency 171.544 ms 2024-09-15T22:25:32.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 25833 7.90 MB/sec execute 49 sec latency 134.470 ms 2024-09-15T22:25:33.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 25971 7.92 MB/sec execute 50 sec latency 143.597 ms 2024-09-15T22:25:34.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 26132 7.96 MB/sec execute 51 sec latency 111.058 ms 2024-09-15T22:25:35.290 INFO:tasks.workunit.client.0.smithi078.stdout: 10 26299 8.05 MB/sec execute 52 sec latency 88.654 ms 2024-09-15T22:25:36.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 26463 8.08 MB/sec execute 53 sec latency 101.168 ms 2024-09-15T22:25:37.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 26617 7.95 MB/sec execute 54 sec latency 169.245 ms 2024-09-15T22:25:38.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 26783 7.84 MB/sec execute 55 sec latency 93.188 ms 2024-09-15T22:25:39.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 26958 7.75 MB/sec execute 56 sec latency 83.227 ms 2024-09-15T22:25:40.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 27113 7.71 MB/sec execute 57 sec latency 97.322 ms 2024-09-15T22:25:41.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 27267 7.72 MB/sec execute 58 sec latency 90.570 ms 2024-09-15T22:25:42.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 27396 7.74 MB/sec execute 59 sec latency 101.007 ms 2024-09-15T22:25:43.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 27590 7.88 MB/sec execute 60 sec latency 108.391 ms 2024-09-15T22:25:44.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 27837 8.20 MB/sec execute 61 sec latency 96.228 ms 2024-09-15T22:25:45.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 28065 8.29 MB/sec execute 62 sec latency 103.096 ms 2024-09-15T22:25:46.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 28178 8.26 MB/sec execute 63 sec latency 113.003 ms 2024-09-15T22:25:47.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 28227 8.18 MB/sec execute 64 sec latency 123.378 ms 2024-09-15T22:25:48.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 28334 8.22 MB/sec execute 65 sec latency 91.836 ms 2024-09-15T22:25:49.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 28496 8.31 MB/sec execute 66 sec latency 94.196 ms 2024-09-15T22:25:50.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 28648 8.38 MB/sec execute 67 sec latency 117.811 ms 2024-09-15T22:25:51.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 28764 8.32 MB/sec execute 68 sec latency 103.398 ms 2024-09-15T22:25:52.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 28859 8.23 MB/sec execute 69 sec latency 114.012 ms 2024-09-15T22:25:53.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 28975 8.12 MB/sec execute 70 sec latency 123.121 ms 2024-09-15T22:25:54.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 29085 8.02 MB/sec execute 71 sec latency 139.668 ms 2024-09-15T22:25:55.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 29201 7.95 MB/sec execute 72 sec latency 159.902 ms 2024-09-15T22:25:56.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 29337 7.90 MB/sec execute 73 sec latency 155.577 ms 2024-09-15T22:25:57.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 29480 7.93 MB/sec execute 74 sec latency 166.630 ms 2024-09-15T22:25:58.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 29634 7.92 MB/sec execute 75 sec latency 80.306 ms 2024-09-15T22:25:59.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 29810 8.02 MB/sec execute 76 sec latency 95.219 ms 2024-09-15T22:26:00.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 29963 8.04 MB/sec execute 77 sec latency 105.840 ms 2024-09-15T22:26:01.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 30125 7.95 MB/sec execute 78 sec latency 102.281 ms 2024-09-15T22:26:02.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 30268 7.87 MB/sec execute 79 sec latency 129.600 ms 2024-09-15T22:26:03.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 30456 7.81 MB/sec execute 80 sec latency 75.677 ms 2024-09-15T22:26:04.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 30626 7.76 MB/sec execute 81 sec latency 95.874 ms 2024-09-15T22:26:05.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 30774 7.78 MB/sec execute 82 sec latency 89.114 ms 2024-09-15T22:26:06.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 30918 7.79 MB/sec execute 83 sec latency 95.201 ms 2024-09-15T22:26:07.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 31078 7.81 MB/sec execute 84 sec latency 104.614 ms 2024-09-15T22:26:08.291 INFO:tasks.workunit.client.0.smithi078.stdout: 10 31318 8.02 MB/sec execute 85 sec latency 107.990 ms 2024-09-15T22:26:09.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 31583 8.18 MB/sec execute 86 sec latency 112.867 ms 2024-09-15T22:26:10.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 31717 8.18 MB/sec execute 87 sec latency 110.416 ms 2024-09-15T22:26:11.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 31773 8.13 MB/sec execute 88 sec latency 96.740 ms 2024-09-15T22:26:12.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 31847 8.09 MB/sec execute 89 sec latency 97.617 ms 2024-09-15T22:26:13.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 32013 8.19 MB/sec execute 90 sec latency 106.357 ms 2024-09-15T22:26:14.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 32171 8.27 MB/sec execute 91 sec latency 152.850 ms 2024-09-15T22:26:15.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 32287 8.22 MB/sec execute 92 sec latency 111.700 ms 2024-09-15T22:26:16.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 32388 8.15 MB/sec execute 93 sec latency 97.826 ms 2024-09-15T22:26:17.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 32487 8.08 MB/sec execute 94 sec latency 134.288 ms 2024-09-15T22:26:18.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 32595 8.00 MB/sec execute 95 sec latency 163.842 ms 2024-09-15T22:26:19.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 32722 7.95 MB/sec execute 96 sec latency 150.259 ms 2024-09-15T22:26:20.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 32839 7.90 MB/sec execute 97 sec latency 170.265 ms 2024-09-15T22:26:21.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 32966 7.88 MB/sec execute 98 sec latency 144.939 ms 2024-09-15T22:26:22.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 33112 7.88 MB/sec execute 99 sec latency 113.445 ms 2024-09-15T22:26:23.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 33264 7.86 MB/sec execute 100 sec latency 127.749 ms 2024-09-15T22:26:24.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 33445 7.96 MB/sec execute 101 sec latency 76.384 ms 2024-09-15T22:26:25.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 33611 7.95 MB/sec execute 102 sec latency 127.391 ms 2024-09-15T22:26:26.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 33787 7.89 MB/sec execute 103 sec latency 106.409 ms 2024-09-15T22:26:27.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 33958 7.84 MB/sec execute 104 sec latency 104.708 ms 2024-09-15T22:26:28.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 34127 7.80 MB/sec execute 105 sec latency 102.510 ms 2024-09-15T22:26:29.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 34305 7.82 MB/sec execute 106 sec latency 93.760 ms 2024-09-15T22:26:30.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 34442 7.81 MB/sec execute 107 sec latency 103.398 ms 2024-09-15T22:26:31.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 34603 7.84 MB/sec execute 108 sec latency 109.153 ms 2024-09-15T22:26:32.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 34753 7.91 MB/sec execute 109 sec latency 192.369 ms 2024-09-15T22:26:33.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 34991 8.04 MB/sec execute 110 sec latency 84.330 ms 2024-09-15T22:26:34.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 35209 8.10 MB/sec execute 111 sec latency 119.661 ms 2024-09-15T22:26:35.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 35302 8.09 MB/sec execute 112 sec latency 101.806 ms 2024-09-15T22:26:36.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 35364 8.06 MB/sec execute 113 sec latency 108.849 ms 2024-09-15T22:26:37.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 35485 8.11 MB/sec execute 114 sec latency 155.513 ms 2024-09-15T22:26:38.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 35654 8.16 MB/sec execute 115 sec latency 120.680 ms 2024-09-15T22:26:39.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 35795 8.16 MB/sec execute 116 sec latency 95.010 ms 2024-09-15T22:26:40.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 35897 8.11 MB/sec execute 117 sec latency 106.720 ms 2024-09-15T22:26:41.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 36001 8.06 MB/sec execute 118 sec latency 128.567 ms 2024-09-15T22:26:42.292 INFO:tasks.workunit.client.0.smithi078.stdout: 10 36091 7.99 MB/sec execute 119 sec latency 172.885 ms 2024-09-15T22:26:43.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 36208 7.94 MB/sec execute 120 sec latency 129.585 ms 2024-09-15T22:26:44.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 36352 7.91 MB/sec execute 121 sec latency 133.721 ms 2024-09-15T22:26:45.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 36481 7.89 MB/sec execute 122 sec latency 166.270 ms 2024-09-15T22:26:46.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 36618 7.88 MB/sec execute 123 sec latency 119.268 ms 2024-09-15T22:26:47.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 36772 7.88 MB/sec execute 124 sec latency 100.077 ms 2024-09-15T22:26:48.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 36950 7.94 MB/sec execute 125 sec latency 96.792 ms 2024-09-15T22:26:49.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 37113 7.95 MB/sec execute 126 sec latency 141.819 ms 2024-09-15T22:26:50.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 37266 7.90 MB/sec execute 127 sec latency 113.287 ms 2024-09-15T22:26:51.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 37441 7.86 MB/sec execute 128 sec latency 109.408 ms 2024-09-15T22:26:52.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 37600 7.82 MB/sec execute 129 sec latency 115.697 ms 2024-09-15T22:26:53.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 37759 7.79 MB/sec execute 130 sec latency 95.837 ms 2024-09-15T22:26:54.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 37941 7.83 MB/sec execute 131 sec latency 88.520 ms 2024-09-15T22:26:55.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 38083 7.84 MB/sec execute 132 sec latency 105.485 ms 2024-09-15T22:26:56.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 38248 7.88 MB/sec execute 133 sec latency 104.350 ms 2024-09-15T22:26:57.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 38446 7.99 MB/sec execute 134 sec latency 159.475 ms 2024-09-15T22:26:58.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 38694 8.05 MB/sec execute 135 sec latency 106.770 ms 2024-09-15T22:26:59.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 38837 8.07 MB/sec execute 136 sec latency 124.758 ms 2024-09-15T22:27:00.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 38895 8.04 MB/sec execute 137 sec latency 111.894 ms 2024-09-15T22:27:01.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 38977 8.02 MB/sec execute 138 sec latency 89.453 ms 2024-09-15T22:27:02.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 39125 8.06 MB/sec execute 139 sec latency 100.193 ms 2024-09-15T22:27:03.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 39290 8.11 MB/sec execute 140 sec latency 141.141 ms 2024-09-15T22:27:04.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 39401 8.08 MB/sec execute 141 sec latency 113.611 ms 2024-09-15T22:27:05.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 39501 8.03 MB/sec execute 142 sec latency 104.454 ms 2024-09-15T22:27:06.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 39599 7.99 MB/sec execute 143 sec latency 158.175 ms 2024-09-15T22:27:07.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 39709 7.94 MB/sec execute 144 sec latency 211.323 ms 2024-09-15T22:27:08.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 39837 7.90 MB/sec execute 145 sec latency 160.518 ms 2024-09-15T22:27:09.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 39961 7.89 MB/sec execute 146 sec latency 196.662 ms 2024-09-15T22:27:10.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 40085 7.86 MB/sec execute 147 sec latency 154.638 ms 2024-09-15T22:27:11.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 40235 7.87 MB/sec execute 148 sec latency 90.947 ms 2024-09-15T22:27:12.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 40395 7.86 MB/sec execute 149 sec latency 91.467 ms 2024-09-15T22:27:13.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 40573 7.91 MB/sec execute 150 sec latency 84.100 ms 2024-09-15T22:27:14.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 40737 7.91 MB/sec execute 151 sec latency 93.874 ms 2024-09-15T22:27:15.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 40915 7.87 MB/sec execute 152 sec latency 87.804 ms 2024-09-15T22:27:16.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 41093 7.84 MB/sec execute 153 sec latency 75.969 ms 2024-09-15T22:27:17.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 41257 7.81 MB/sec execute 154 sec latency 86.623 ms 2024-09-15T22:27:18.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 41437 7.83 MB/sec execute 155 sec latency 111.604 ms 2024-09-15T22:27:19.293 INFO:tasks.workunit.client.0.smithi078.stdout: 10 41597 7.85 MB/sec execute 156 sec latency 87.907 ms 2024-09-15T22:27:20.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 41738 7.86 MB/sec execute 157 sec latency 104.699 ms 2024-09-15T22:27:21.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 41945 7.93 MB/sec execute 158 sec latency 110.402 ms 2024-09-15T22:27:22.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 42144 7.99 MB/sec execute 159 sec latency 152.248 ms 2024-09-15T22:27:23.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 42350 8.03 MB/sec execute 160 sec latency 153.940 ms 2024-09-15T22:27:24.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 42420 8.01 MB/sec execute 161 sec latency 97.430 ms 2024-09-15T22:27:25.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 42499 8.00 MB/sec execute 162 sec latency 115.329 ms 2024-09-15T22:27:26.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 42640 8.04 MB/sec execute 163 sec latency 118.602 ms 2024-09-15T22:27:27.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 42798 8.07 MB/sec execute 164 sec latency 132.191 ms 2024-09-15T22:27:28.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 42938 8.06 MB/sec execute 165 sec latency 115.631 ms 2024-09-15T22:27:29.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 43041 8.02 MB/sec execute 166 sec latency 121.792 ms 2024-09-15T22:27:30.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 43145 7.99 MB/sec execute 167 sec latency 129.489 ms 2024-09-15T22:27:31.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 43262 7.95 MB/sec execute 168 sec latency 133.462 ms 2024-09-15T22:27:32.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 43382 7.91 MB/sec execute 169 sec latency 140.149 ms 2024-09-15T22:27:33.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 43515 7.90 MB/sec execute 170 sec latency 161.809 ms 2024-09-15T22:27:34.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 43651 7.88 MB/sec execute 171 sec latency 139.556 ms 2024-09-15T22:27:35.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 43811 7.90 MB/sec execute 172 sec latency 102.411 ms 2024-09-15T22:27:36.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 43976 7.90 MB/sec execute 173 sec latency 98.137 ms 2024-09-15T22:27:37.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 44178 7.96 MB/sec execute 174 sec latency 85.207 ms 2024-09-15T22:27:38.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 44345 7.92 MB/sec execute 175 sec latency 94.802 ms 2024-09-15T22:27:39.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 44513 7.89 MB/sec execute 176 sec latency 100.449 ms 2024-09-15T22:27:39.364 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:27:39.367 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:27:39.580 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-09-15T22:27:39.579+0000 7fc7d5ee9640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40745) UID: 0 2024-09-15T22:27:40.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 44693 7.86 MB/sec execute 177 sec latency 95.371 ms 2024-09-15T22:27:41.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 44859 7.86 MB/sec execute 178 sec latency 103.718 ms 2024-09-15T22:27:42.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 45018 7.86 MB/sec execute 179 sec latency 103.544 ms 2024-09-15T22:27:43.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 45178 7.87 MB/sec execute 180 sec latency 119.556 ms 2024-09-15T22:27:44.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 45341 7.90 MB/sec execute 181 sec latency 110.894 ms 2024-09-15T22:27:45.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 45550 7.97 MB/sec execute 182 sec latency 95.927 ms 2024-09-15T22:27:46.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 45793 8.04 MB/sec execute 183 sec latency 85.443 ms 2024-09-15T22:27:47.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 45939 8.05 MB/sec execute 184 sec latency 96.816 ms 2024-09-15T22:27:48.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 45996 8.02 MB/sec execute 185 sec latency 102.193 ms 2024-09-15T22:27:49.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 46095 8.02 MB/sec execute 186 sec latency 88.663 ms 2024-09-15T22:27:50.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 46256 8.06 MB/sec execute 187 sec latency 105.441 ms 2024-09-15T22:27:51.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 46413 8.07 MB/sec execute 188 sec latency 131.386 ms 2024-09-15T22:27:52.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 46520 8.05 MB/sec execute 189 sec latency 113.965 ms 2024-09-15T22:27:53.294 INFO:tasks.workunit.client.0.smithi078.stdout: 10 46625 8.02 MB/sec execute 190 sec latency 128.296 ms 2024-09-15T22:27:54.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 46728 7.99 MB/sec execute 191 sec latency 127.130 ms 2024-09-15T22:27:55.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 46838 7.95 MB/sec execute 192 sec latency 190.427 ms 2024-09-15T22:27:56.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 46976 7.94 MB/sec execute 193 sec latency 144.731 ms 2024-09-15T22:27:57.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 47105 7.92 MB/sec execute 194 sec latency 169.132 ms 2024-09-15T22:27:58.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 47243 7.91 MB/sec execute 195 sec latency 167.043 ms 2024-09-15T22:27:59.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 47396 7.92 MB/sec execute 196 sec latency 114.563 ms 2024-09-15T22:28:00.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 47538 7.90 MB/sec execute 197 sec latency 99.967 ms 2024-09-15T22:28:01.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 47729 7.96 MB/sec execute 198 sec latency 99.895 ms 2024-09-15T22:28:02.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 47884 7.93 MB/sec execute 199 sec latency 108.908 ms 2024-09-15T22:28:03.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 48036 7.90 MB/sec execute 200 sec latency 107.636 ms 2024-09-15T22:28:04.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 48204 7.87 MB/sec execute 201 sec latency 129.828 ms 2024-09-15T22:28:05.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 48376 7.86 MB/sec execute 202 sec latency 89.683 ms 2024-09-15T22:28:06.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 48531 7.86 MB/sec execute 203 sec latency 115.237 ms 2024-09-15T22:28:07.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 48686 7.88 MB/sec execute 204 sec latency 99.239 ms 2024-09-15T22:28:08.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 48809 7.88 MB/sec execute 205 sec latency 199.906 ms 2024-09-15T22:28:09.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 48929 7.88 MB/sec execute 206 sec latency 391.850 ms 2024-09-15T22:28:10.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 49159 7.97 MB/sec execute 207 sec latency 101.524 ms 2024-09-15T22:28:11.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 49371 8.01 MB/sec execute 208 sec latency 119.584 ms 2024-09-15T22:28:12.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 49498 8.00 MB/sec execute 209 sec latency 93.893 ms 2024-09-15T22:28:13.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 49573 7.99 MB/sec execute 210 sec latency 101.630 ms 2024-09-15T22:28:14.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 49666 7.98 MB/sec execute 211 sec latency 100.061 ms 2024-09-15T22:28:15.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 49802 8.00 MB/sec execute 212 sec latency 216.646 ms 2024-09-15T22:28:16.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 49962 8.02 MB/sec execute 213 sec latency 223.997 ms 2024-09-15T22:28:17.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 50070 8.01 MB/sec execute 214 sec latency 112.155 ms 2024-09-15T22:28:18.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 50174 7.98 MB/sec execute 215 sec latency 115.403 ms 2024-09-15T22:28:19.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 50267 7.95 MB/sec execute 216 sec latency 144.806 ms 2024-09-15T22:28:20.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 50367 7.92 MB/sec execute 217 sec latency 130.041 ms 2024-09-15T22:28:21.297 INFO:tasks.workunit.client.0.smithi078.stdout: 10 50491 7.91 MB/sec execute 218 sec latency 156.721 ms 2024-09-15T22:28:22.295 INFO:tasks.workunit.client.0.smithi078.stdout: 10 50613 7.89 MB/sec execute 219 sec latency 153.621 ms 2024-09-15T22:28:23.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 50740 7.87 MB/sec execute 220 sec latency 151.986 ms 2024-09-15T22:28:24.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 50893 7.86 MB/sec execute 221 sec latency 142.155 ms 2024-09-15T22:28:25.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 51054 7.87 MB/sec execute 222 sec latency 97.085 ms 2024-09-15T22:28:26.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 51224 7.88 MB/sec execute 223 sec latency 116.382 ms 2024-09-15T22:28:27.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 51390 7.90 MB/sec execute 224 sec latency 102.243 ms 2024-09-15T22:28:28.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 51554 7.87 MB/sec execute 225 sec latency 92.907 ms 2024-09-15T22:28:29.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 51725 7.85 MB/sec execute 226 sec latency 98.522 ms 2024-09-15T22:28:30.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 51897 7.84 MB/sec execute 227 sec latency 93.466 ms 2024-09-15T22:28:31.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 52071 7.84 MB/sec execute 228 sec latency 93.720 ms 2024-09-15T22:28:32.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 52222 7.85 MB/sec execute 229 sec latency 104.501 ms 2024-09-15T22:28:33.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 52358 7.85 MB/sec execute 230 sec latency 100.485 ms 2024-09-15T22:28:34.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 52536 7.89 MB/sec execute 231 sec latency 103.942 ms 2024-09-15T22:28:35.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 52721 7.94 MB/sec execute 232 sec latency 147.533 ms 2024-09-15T22:28:36.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 52916 7.97 MB/sec execute 233 sec latency 101.782 ms 2024-09-15T22:28:37.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 53042 7.96 MB/sec execute 234 sec latency 113.973 ms 2024-09-15T22:28:38.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 53116 7.96 MB/sec execute 235 sec latency 91.711 ms 2024-09-15T22:28:39.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 53206 7.94 MB/sec execute 236 sec latency 106.900 ms 2024-09-15T22:28:40.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 53348 7.96 MB/sec execute 237 sec latency 105.124 ms 2024-09-15T22:28:41.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 53507 7.98 MB/sec execute 238 sec latency 109.156 ms 2024-09-15T22:28:42.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 53618 7.97 MB/sec execute 239 sec latency 125.766 ms 2024-09-15T22:28:43.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 53717 7.94 MB/sec execute 240 sec latency 151.153 ms 2024-09-15T22:28:44.297 INFO:tasks.workunit.client.0.smithi078.stdout: 10 53822 7.92 MB/sec execute 241 sec latency 121.246 ms 2024-09-15T22:28:45.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 53939 7.89 MB/sec execute 242 sec latency 152.329 ms 2024-09-15T22:28:46.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 54066 7.88 MB/sec execute 243 sec latency 181.658 ms 2024-09-15T22:28:47.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 54208 7.87 MB/sec execute 244 sec latency 100.543 ms 2024-09-15T22:28:48.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 54336 7.86 MB/sec execute 245 sec latency 129.135 ms 2024-09-15T22:28:49.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 54485 7.86 MB/sec execute 246 sec latency 154.105 ms 2024-09-15T22:28:50.297 INFO:tasks.workunit.client.0.smithi078.stdout: 10 54640 7.85 MB/sec execute 247 sec latency 110.266 ms 2024-09-15T22:28:51.296 INFO:tasks.workunit.client.0.smithi078.stdout: 10 54812 7.86 MB/sec execute 248 sec latency 100.215 ms 2024-09-15T22:28:52.298 INFO:tasks.workunit.client.0.smithi078.stdout: 10 54982 7.87 MB/sec execute 249 sec latency 106.942 ms 2024-09-15T22:28:53.298 INFO:tasks.workunit.client.0.smithi078.stdout: 10 55143 7.85 MB/sec execute 250 sec latency 117.543 ms 2024-09-15T22:28:54.298 INFO:tasks.workunit.client.0.smithi078.stdout: 10 55312 7.83 MB/sec execute 251 sec latency 99.951 ms 2024-09-15T22:28:55.298 INFO:tasks.workunit.client.0.smithi078.stdout: 10 55471 7.83 MB/sec execute 252 sec latency 97.828 ms 2024-09-15T22:28:56.298 INFO:tasks.workunit.client.0.smithi078.stdout: 10 55640 7.82 MB/sec execute 253 sec latency 101.781 ms 2024-09-15T22:28:57.301 INFO:tasks.workunit.client.0.smithi078.stdout: 10 55816 7.85 MB/sec execute 254 sec latency 94.532 ms 2024-09-15T22:28:58.298 INFO:tasks.workunit.client.0.smithi078.stdout: 10 55967 7.85 MB/sec execute 255 sec latency 96.739 ms 2024-09-15T22:28:59.298 INFO:tasks.workunit.client.0.smithi078.stdout: 10 56139 7.89 MB/sec execute 256 sec latency 100.318 ms 2024-09-15T22:29:00.298 INFO:tasks.workunit.client.0.smithi078.stdout: 10 56322 7.92 MB/sec execute 257 sec latency 151.944 ms 2024-09-15T22:29:01.298 INFO:tasks.workunit.client.0.smithi078.stdout: 10 56503 7.94 MB/sec execute 258 sec latency 108.095 ms 2024-09-15T22:29:02.298 INFO:tasks.workunit.client.0.smithi078.stdout: 10 56623 7.94 MB/sec execute 259 sec latency 99.537 ms 2024-09-15T22:29:03.298 INFO:tasks.workunit.client.0.smithi078.stdout: 10 56716 7.94 MB/sec execute 260 sec latency 111.619 ms 2024-09-15T22:29:04.298 INFO:tasks.workunit.client.0.smithi078.stdout: 10 56831 7.95 MB/sec execute 261 sec latency 94.718 ms 2024-09-15T22:29:05.298 INFO:tasks.workunit.client.0.smithi078.stdout: 10 56952 7.95 MB/sec execute 262 sec latency 210.402 ms 2024-09-15T22:29:06.298 INFO:tasks.workunit.client.0.smithi078.stdout: 10 57091 7.96 MB/sec execute 263 sec latency 143.524 ms 2024-09-15T22:29:07.303 INFO:tasks.workunit.client.0.smithi078.stdout: 10 57207 7.94 MB/sec execute 264 sec latency 125.098 ms 2024-09-15T22:29:08.302 INFO:tasks.workunit.client.0.smithi078.stdout: 10 57306 7.92 MB/sec execute 265 sec latency 143.306 ms 2024-09-15T22:29:09.301 INFO:tasks.workunit.client.0.smithi078.stdout: 10 57405 7.90 MB/sec execute 266 sec latency 122.997 ms 2024-09-15T22:29:10.302 INFO:tasks.workunit.client.0.smithi078.stdout: 10 57523 7.87 MB/sec execute 267 sec latency 146.853 ms 2024-09-15T22:29:11.301 INFO:tasks.workunit.client.0.smithi078.stdout: 10 57655 7.87 MB/sec execute 268 sec latency 148.103 ms 2024-09-15T22:29:12.302 INFO:tasks.workunit.client.0.smithi078.stdout: 10 57780 7.85 MB/sec execute 269 sec latency 150.572 ms 2024-09-15T22:29:13.302 INFO:tasks.workunit.client.0.smithi078.stdout: 10 57923 7.86 MB/sec execute 270 sec latency 151.119 ms 2024-09-15T22:29:14.302 INFO:tasks.workunit.client.0.smithi078.stdout: 10 58073 7.85 MB/sec execute 271 sec latency 113.510 ms 2024-09-15T22:29:15.303 INFO:tasks.workunit.client.0.smithi078.stdout: 10 58214 7.84 MB/sec execute 272 sec latency 108.375 ms 2024-09-15T22:29:16.304 INFO:tasks.workunit.client.0.smithi078.stdout: 10 58385 7.85 MB/sec execute 273 sec latency 107.304 ms 2024-09-15T22:29:17.306 INFO:tasks.workunit.client.0.smithi078.stdout: 10 58562 7.85 MB/sec execute 274 sec latency 83.435 ms 2024-09-15T22:29:18.307 INFO:tasks.workunit.client.0.smithi078.stdout: 10 58726 7.83 MB/sec execute 275 sec latency 85.309 ms 2024-09-15T22:29:19.307 INFO:tasks.workunit.client.0.smithi078.stdout: 10 58891 7.82 MB/sec execute 276 sec latency 96.699 ms 2024-09-15T22:29:20.308 INFO:tasks.workunit.client.0.smithi078.stdout: 10 59060 7.82 MB/sec execute 277 sec latency 96.701 ms 2024-09-15T22:29:21.308 INFO:tasks.workunit.client.0.smithi078.stdout: 10 59214 7.81 MB/sec execute 278 sec latency 96.990 ms 2024-09-15T22:29:22.309 INFO:tasks.workunit.client.0.smithi078.stdout: 10 59387 7.84 MB/sec execute 279 sec latency 104.850 ms 2024-09-15T22:29:23.309 INFO:tasks.workunit.client.0.smithi078.stdout: 10 59556 7.84 MB/sec execute 280 sec latency 109.306 ms 2024-09-15T22:29:24.309 INFO:tasks.workunit.client.0.smithi078.stdout: 10 59741 7.88 MB/sec execute 281 sec latency 98.903 ms 2024-09-15T22:29:25.309 INFO:tasks.workunit.client.0.smithi078.stdout: 10 59958 7.92 MB/sec execute 282 sec latency 112.466 ms 2024-09-15T22:29:26.311 INFO:tasks.workunit.client.0.smithi078.stdout: 10 60088 7.92 MB/sec execute 283 sec latency 97.875 ms 2024-09-15T22:29:27.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 60201 7.93 MB/sec execute 284 sec latency 109.843 ms 2024-09-15T22:29:28.313 INFO:tasks.workunit.client.0.smithi078.stdout: 10 60285 7.92 MB/sec execute 285 sec latency 97.120 ms 2024-09-15T22:29:29.313 INFO:tasks.workunit.client.0.smithi078.stdout: 10 60405 7.93 MB/sec execute 286 sec latency 100.974 ms 2024-09-15T22:29:30.313 INFO:tasks.workunit.client.0.smithi078.stdout: 10 60519 7.92 MB/sec execute 287 sec latency 165.214 ms 2024-09-15T22:29:31.313 INFO:tasks.workunit.client.0.smithi078.stdout: 10 60658 7.93 MB/sec execute 288 sec latency 151.391 ms 2024-09-15T22:29:32.313 INFO:tasks.workunit.client.0.smithi078.stdout: 10 60773 7.92 MB/sec execute 289 sec latency 97.724 ms 2024-09-15T22:29:33.313 INFO:tasks.workunit.client.0.smithi078.stdout: 10 60876 7.90 MB/sec execute 290 sec latency 119.682 ms 2024-09-15T22:29:34.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 60986 7.88 MB/sec execute 291 sec latency 160.059 ms 2024-09-15T22:29:35.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 61101 7.86 MB/sec execute 292 sec latency 178.457 ms 2024-09-15T22:29:36.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 61217 7.85 MB/sec execute 293 sec latency 155.670 ms 2024-09-15T22:29:37.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 61367 7.83 MB/sec execute 294 sec latency 104.857 ms 2024-09-15T22:29:38.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 61516 7.84 MB/sec execute 295 sec latency 126.139 ms 2024-09-15T22:29:39.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 61651 7.84 MB/sec execute 296 sec latency 135.009 ms 2024-09-15T22:29:40.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 61822 7.85 MB/sec execute 297 sec latency 126.052 ms 2024-09-15T22:29:41.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 61970 7.84 MB/sec execute 298 sec latency 86.437 ms 2024-09-15T22:29:42.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 62135 7.84 MB/sec execute 299 sec latency 117.799 ms 2024-09-15T22:29:43.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 62305 7.82 MB/sec execute 300 sec latency 112.815 ms 2024-09-15T22:29:44.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 62450 7.80 MB/sec execute 301 sec latency 84.209 ms 2024-09-15T22:29:45.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 62603 7.80 MB/sec execute 302 sec latency 164.445 ms 2024-09-15T22:29:46.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 62768 7.80 MB/sec execute 303 sec latency 97.544 ms 2024-09-15T22:29:47.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 62942 7.82 MB/sec execute 304 sec latency 124.067 ms 2024-09-15T22:29:48.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 63114 7.83 MB/sec execute 305 sec latency 89.585 ms 2024-09-15T22:29:49.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 63271 7.86 MB/sec execute 306 sec latency 102.819 ms 2024-09-15T22:29:50.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 63456 7.89 MB/sec execute 307 sec latency 166.495 ms 2024-09-15T22:29:51.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 63628 7.90 MB/sec execute 308 sec latency 101.569 ms 2024-09-15T22:29:52.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 63757 7.91 MB/sec execute 309 sec latency 98.032 ms 2024-09-15T22:29:53.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 63843 7.90 MB/sec execute 310 sec latency 92.660 ms 2024-09-15T22:29:54.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 63956 7.91 MB/sec execute 311 sec latency 104.992 ms 2024-09-15T22:29:55.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 64076 7.90 MB/sec execute 312 sec latency 165.568 ms 2024-09-15T22:29:56.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 64230 7.91 MB/sec execute 313 sec latency 111.343 ms 2024-09-15T22:29:57.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 64343 7.90 MB/sec execute 314 sec latency 152.562 ms 2024-09-15T22:29:58.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 64435 7.88 MB/sec execute 315 sec latency 161.689 ms 2024-09-15T22:29:59.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 64541 7.86 MB/sec execute 316 sec latency 146.661 ms 2024-09-15T22:30:00.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 64675 7.85 MB/sec execute 317 sec latency 134.750 ms 2024-09-15T22:30:01.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 64820 7.84 MB/sec execute 318 sec latency 97.914 ms 2024-09-15T22:30:02.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 64970 7.84 MB/sec execute 319 sec latency 179.516 ms 2024-09-15T22:30:03.314 INFO:tasks.workunit.client.0.smithi078.stdout: 10 65103 7.83 MB/sec execute 320 sec latency 146.140 ms 2024-09-15T22:30:04.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 65249 7.83 MB/sec execute 321 sec latency 115.772 ms 2024-09-15T22:30:05.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 65424 7.83 MB/sec execute 322 sec latency 96.394 ms 2024-09-15T22:30:06.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 65614 7.84 MB/sec execute 323 sec latency 84.233 ms 2024-09-15T22:30:07.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 65776 7.83 MB/sec execute 324 sec latency 96.914 ms 2024-09-15T22:30:08.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 65943 7.81 MB/sec execute 325 sec latency 94.002 ms 2024-09-15T22:30:09.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 66117 7.81 MB/sec execute 326 sec latency 78.877 ms 2024-09-15T22:30:10.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 66307 7.82 MB/sec execute 327 sec latency 97.437 ms 2024-09-15T22:30:11.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 66486 7.83 MB/sec execute 328 sec latency 98.838 ms 2024-09-15T22:30:12.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 66654 7.84 MB/sec execute 329 sec latency 98.899 ms 2024-09-15T22:30:13.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 66838 7.87 MB/sec execute 330 sec latency 89.749 ms 2024-09-15T22:30:14.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 67028 7.90 MB/sec execute 331 sec latency 141.376 ms 2024-09-15T22:30:15.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 67198 7.91 MB/sec execute 332 sec latency 106.257 ms 2024-09-15T22:30:16.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 67317 7.91 MB/sec execute 333 sec latency 92.324 ms 2024-09-15T22:30:17.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 67407 7.91 MB/sec execute 334 sec latency 96.737 ms 2024-09-15T22:30:18.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 67529 7.91 MB/sec execute 335 sec latency 108.644 ms 2024-09-15T22:30:19.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 67672 7.92 MB/sec execute 336 sec latency 145.705 ms 2024-09-15T22:30:20.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 67815 7.92 MB/sec execute 337 sec latency 98.166 ms 2024-09-15T22:30:21.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 67931 7.90 MB/sec execute 338 sec latency 139.037 ms 2024-09-15T22:30:22.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 68040 7.89 MB/sec execute 339 sec latency 163.541 ms 2024-09-15T22:30:23.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 68160 7.87 MB/sec execute 340 sec latency 177.631 ms 2024-09-15T22:30:24.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 68309 7.87 MB/sec execute 341 sec latency 92.456 ms 2024-09-15T22:30:25.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 68441 7.86 MB/sec execute 342 sec latency 161.971 ms 2024-09-15T22:30:26.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 68592 7.86 MB/sec execute 343 sec latency 138.870 ms 2024-09-15T22:30:27.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 68741 7.85 MB/sec execute 344 sec latency 124.232 ms 2024-09-15T22:30:28.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 68922 7.87 MB/sec execute 345 sec latency 80.934 ms 2024-09-15T22:30:28.891 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:30:28.894 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:30:28.934 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-09-15T22:30:28.933+0000 7fc7d5ee9640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40769) UID: 0 2024-09-15T22:30:29.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 69081 7.85 MB/sec execute 346 sec latency 86.137 ms 2024-09-15T22:30:30.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 69240 7.86 MB/sec execute 347 sec latency 122.194 ms 2024-09-15T22:30:31.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 69408 7.84 MB/sec execute 348 sec latency 93.893 ms 2024-09-15T22:30:32.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 69564 7.83 MB/sec execute 349 sec latency 108.840 ms 2024-09-15T22:30:33.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 69748 7.83 MB/sec execute 350 sec latency 80.921 ms 2024-09-15T22:30:34.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 69907 7.84 MB/sec execute 351 sec latency 128.919 ms 2024-09-15T22:30:35.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 70069 7.85 MB/sec execute 352 sec latency 125.331 ms 2024-09-15T22:30:36.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 70231 7.86 MB/sec execute 353 sec latency 106.472 ms 2024-09-15T22:30:37.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 70369 7.87 MB/sec execute 354 sec latency 159.915 ms 2024-09-15T22:30:38.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 70565 7.90 MB/sec execute 355 sec latency 101.289 ms 2024-09-15T22:30:39.315 INFO:tasks.workunit.client.0.smithi078.stdout: 10 70743 7.92 MB/sec execute 356 sec latency 114.678 ms 2024-09-15T22:30:40.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 70862 7.92 MB/sec execute 357 sec latency 89.149 ms 2024-09-15T22:30:41.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 70963 7.92 MB/sec execute 358 sec latency 101.130 ms 2024-09-15T22:30:42.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 71065 7.92 MB/sec execute 359 sec latency 105.014 ms 2024-09-15T22:30:43.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 71176 7.91 MB/sec execute 360 sec latency 146.417 ms 2024-09-15T22:30:44.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 71317 7.92 MB/sec execute 361 sec latency 116.626 ms 2024-09-15T22:30:45.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 71437 7.91 MB/sec execute 362 sec latency 128.724 ms 2024-09-15T22:30:46.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 71548 7.89 MB/sec execute 363 sec latency 149.016 ms 2024-09-15T22:30:47.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 71654 7.87 MB/sec execute 364 sec latency 160.500 ms 2024-09-15T22:30:48.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 71783 7.87 MB/sec execute 365 sec latency 176.191 ms 2024-09-15T22:30:49.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 71909 7.85 MB/sec execute 366 sec latency 149.527 ms 2024-09-15T22:30:50.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 72051 7.86 MB/sec execute 367 sec latency 155.162 ms 2024-09-15T22:30:51.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 72176 7.85 MB/sec execute 368 sec latency 159.479 ms 2024-09-15T22:30:52.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 72332 7.85 MB/sec execute 369 sec latency 124.850 ms 2024-09-15T22:30:53.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 72481 7.84 MB/sec execute 370 sec latency 101.237 ms 2024-09-15T22:30:54.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 72660 7.85 MB/sec execute 371 sec latency 104.378 ms 2024-09-15T22:30:55.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 72825 7.84 MB/sec execute 372 sec latency 86.395 ms 2024-09-15T22:30:56.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 72979 7.83 MB/sec execute 373 sec latency 103.165 ms 2024-09-15T22:30:57.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 73139 7.83 MB/sec execute 374 sec latency 113.035 ms 2024-09-15T22:30:58.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 73308 7.82 MB/sec execute 375 sec latency 92.277 ms 2024-09-15T22:30:59.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 73504 7.83 MB/sec execute 376 sec latency 104.208 ms 2024-09-15T22:31:00.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 73658 7.84 MB/sec execute 377 sec latency 181.911 ms 2024-09-15T22:31:01.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 73806 7.85 MB/sec execute 378 sec latency 97.682 ms 2024-09-15T22:31:02.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 73942 7.86 MB/sec execute 379 sec latency 134.123 ms 2024-09-15T22:31:03.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 74129 7.89 MB/sec execute 380 sec latency 92.445 ms 2024-09-15T22:31:04.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 74301 7.90 MB/sec execute 381 sec latency 124.403 ms 2024-09-15T22:31:05.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 74437 7.90 MB/sec execute 382 sec latency 128.978 ms 2024-09-15T22:31:06.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 74517 7.89 MB/sec execute 383 sec latency 123.151 ms 2024-09-15T22:31:07.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 74606 7.89 MB/sec execute 384 sec latency 127.118 ms 2024-09-15T22:31:08.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 74725 7.89 MB/sec execute 385 sec latency 119.277 ms 2024-09-15T22:31:09.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 74890 7.90 MB/sec execute 386 sec latency 153.692 ms 2024-09-15T22:31:10.316 INFO:tasks.workunit.client.0.smithi078.stdout: 10 75003 7.89 MB/sec execute 387 sec latency 111.106 ms 2024-09-15T22:31:11.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 75114 7.88 MB/sec execute 388 sec latency 175.340 ms 2024-09-15T22:31:12.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 75211 7.86 MB/sec execute 389 sec latency 149.250 ms 2024-09-15T22:31:13.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 75333 7.86 MB/sec execute 390 sec latency 143.289 ms 2024-09-15T22:31:14.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 75459 7.84 MB/sec execute 391 sec latency 134.597 ms 2024-09-15T22:31:15.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 75601 7.84 MB/sec execute 392 sec latency 175.305 ms 2024-09-15T22:31:16.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 75739 7.84 MB/sec execute 393 sec latency 117.990 ms 2024-09-15T22:31:17.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 75883 7.83 MB/sec execute 394 sec latency 98.354 ms 2024-09-15T22:31:18.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 76043 7.83 MB/sec execute 395 sec latency 102.080 ms 2024-09-15T22:31:19.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 76196 7.83 MB/sec execute 396 sec latency 107.973 ms 2024-09-15T22:31:20.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 76361 7.83 MB/sec execute 397 sec latency 137.297 ms 2024-09-15T22:31:21.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 76527 7.82 MB/sec execute 398 sec latency 109.996 ms 2024-09-15T22:31:22.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 76684 7.82 MB/sec execute 399 sec latency 96.697 ms 2024-09-15T22:31:23.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 76849 7.81 MB/sec execute 400 sec latency 101.991 ms 2024-09-15T22:31:24.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 77047 7.82 MB/sec execute 401 sec latency 115.061 ms 2024-09-15T22:31:25.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 77222 7.83 MB/sec execute 402 sec latency 97.026 ms 2024-09-15T22:31:26.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 77374 7.84 MB/sec execute 403 sec latency 102.797 ms 2024-09-15T22:31:27.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 77511 7.85 MB/sec execute 404 sec latency 115.126 ms 2024-09-15T22:31:28.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 77677 7.87 MB/sec execute 405 sec latency 93.879 ms 2024-09-15T22:31:29.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 77842 7.88 MB/sec execute 406 sec latency 110.427 ms 2024-09-15T22:31:30.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 78013 7.89 MB/sec execute 407 sec latency 98.823 ms 2024-09-15T22:31:31.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 78101 7.89 MB/sec execute 408 sec latency 103.251 ms 2024-09-15T22:31:32.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 78184 7.88 MB/sec execute 409 sec latency 100.818 ms 2024-09-15T22:31:33.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 78299 7.87 MB/sec execute 410 sec latency 121.039 ms 2024-09-15T22:31:34.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 78461 7.89 MB/sec execute 411 sec latency 141.262 ms 2024-09-15T22:31:35.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 78585 7.88 MB/sec execute 412 sec latency 132.269 ms 2024-09-15T22:31:36.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 78696 7.86 MB/sec execute 413 sec latency 161.959 ms 2024-09-15T22:31:37.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 78805 7.85 MB/sec execute 414 sec latency 162.887 ms 2024-09-15T22:31:38.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 78922 7.85 MB/sec execute 415 sec latency 181.751 ms 2024-09-15T22:31:39.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 79066 7.84 MB/sec execute 416 sec latency 99.184 ms 2024-09-15T22:31:40.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 79203 7.83 MB/sec execute 417 sec latency 146.362 ms 2024-09-15T22:31:41.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 79336 7.83 MB/sec execute 418 sec latency 190.819 ms 2024-09-15T22:31:42.317 INFO:tasks.workunit.client.0.smithi078.stdout: 10 79490 7.83 MB/sec execute 419 sec latency 107.981 ms 2024-09-15T22:31:43.318 INFO:tasks.workunit.client.0.smithi078.stdout: 10 79662 7.83 MB/sec execute 420 sec latency 88.704 ms 2024-09-15T22:31:44.318 INFO:tasks.workunit.client.0.smithi078.stdout: 10 79810 7.83 MB/sec execute 421 sec latency 108.505 ms 2024-09-15T22:31:45.318 INFO:tasks.workunit.client.0.smithi078.stdout: 10 79972 7.83 MB/sec execute 422 sec latency 96.735 ms 2024-09-15T22:31:46.318 INFO:tasks.workunit.client.0.smithi078.stdout: 10 80123 7.82 MB/sec execute 423 sec latency 95.868 ms 2024-09-15T22:31:47.318 INFO:tasks.workunit.client.0.smithi078.stdout: 10 80297 7.81 MB/sec execute 424 sec latency 128.150 ms 2024-09-15T22:31:48.318 INFO:tasks.workunit.client.0.smithi078.stdout: 10 80474 7.81 MB/sec execute 425 sec latency 89.174 ms 2024-09-15T22:31:49.318 INFO:tasks.workunit.client.0.smithi078.stdout: 10 80636 7.83 MB/sec execute 426 sec latency 129.429 ms 2024-09-15T22:31:50.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 80802 7.83 MB/sec execute 427 sec latency 106.466 ms 2024-09-15T22:31:51.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 80934 7.83 MB/sec execute 428 sec latency 116.655 ms 2024-09-15T22:31:52.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 81083 7.84 MB/sec execute 429 sec latency 110.282 ms 2024-09-15T22:31:53.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 81239 7.86 MB/sec execute 430 sec latency 122.750 ms 2024-09-15T22:31:54.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 81431 7.88 MB/sec execute 431 sec latency 99.410 ms 2024-09-15T22:31:55.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 81573 7.88 MB/sec execute 432 sec latency 101.711 ms 2024-09-15T22:31:56.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 81651 7.88 MB/sec execute 433 sec latency 114.764 ms 2024-09-15T22:31:57.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 81749 7.87 MB/sec execute 434 sec latency 105.764 ms 2024-09-15T22:31:58.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 81864 7.86 MB/sec execute 435 sec latency 102.431 ms 2024-09-15T22:31:59.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 82014 7.87 MB/sec execute 436 sec latency 169.136 ms 2024-09-15T22:32:00.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 82132 7.87 MB/sec execute 437 sec latency 130.358 ms 2024-09-15T22:32:01.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 82239 7.85 MB/sec execute 438 sec latency 157.526 ms 2024-09-15T22:32:02.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 82349 7.85 MB/sec execute 439 sec latency 158.766 ms 2024-09-15T22:32:03.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 82455 7.83 MB/sec execute 440 sec latency 180.729 ms 2024-09-15T22:32:04.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 82582 7.82 MB/sec execute 441 sec latency 144.250 ms 2024-09-15T22:32:05.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 82721 7.82 MB/sec execute 442 sec latency 136.151 ms 2024-09-15T22:32:06.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 82851 7.82 MB/sec execute 443 sec latency 160.071 ms 2024-09-15T22:32:07.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 83003 7.81 MB/sec execute 444 sec latency 116.129 ms 2024-09-15T22:32:08.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 83160 7.81 MB/sec execute 445 sec latency 119.493 ms 2024-09-15T22:32:09.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 83324 7.81 MB/sec execute 446 sec latency 114.577 ms 2024-09-15T22:32:10.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 83490 7.81 MB/sec execute 447 sec latency 113.823 ms 2024-09-15T22:32:11.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 83654 7.81 MB/sec execute 448 sec latency 108.719 ms 2024-09-15T22:32:12.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 83816 7.80 MB/sec execute 449 sec latency 96.277 ms 2024-09-15T22:32:13.319 INFO:tasks.workunit.client.0.smithi078.stdout: 10 83999 7.80 MB/sec execute 450 sec latency 84.805 ms 2024-09-15T22:32:14.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 84172 7.81 MB/sec execute 451 sec latency 103.373 ms 2024-09-15T22:32:15.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 84348 7.82 MB/sec execute 452 sec latency 99.736 ms 2024-09-15T22:32:16.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 84481 7.82 MB/sec execute 453 sec latency 94.450 ms 2024-09-15T22:32:17.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 84622 7.83 MB/sec execute 454 sec latency 114.411 ms 2024-09-15T22:32:18.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 84766 7.85 MB/sec execute 455 sec latency 105.004 ms 2024-09-15T22:32:19.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 84944 7.86 MB/sec execute 456 sec latency 105.133 ms 2024-09-15T22:32:20.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 85111 7.87 MB/sec execute 457 sec latency 107.762 ms 2024-09-15T22:32:21.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 85201 7.86 MB/sec execute 458 sec latency 112.474 ms 2024-09-15T22:32:22.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 85291 7.86 MB/sec execute 459 sec latency 116.348 ms 2024-09-15T22:32:23.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 85399 7.85 MB/sec execute 460 sec latency 121.757 ms 2024-09-15T22:32:24.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 85548 7.86 MB/sec execute 461 sec latency 134.175 ms 2024-09-15T22:32:25.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 85679 7.85 MB/sec execute 462 sec latency 142.469 ms 2024-09-15T22:32:26.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 85776 7.84 MB/sec execute 463 sec latency 174.684 ms 2024-09-15T22:32:27.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 85897 7.84 MB/sec execute 464 sec latency 138.963 ms 2024-09-15T22:32:28.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 86005 7.82 MB/sec execute 465 sec latency 158.760 ms 2024-09-15T22:32:29.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 86120 7.81 MB/sec execute 466 sec latency 143.493 ms 2024-09-15T22:32:30.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 86258 7.81 MB/sec execute 467 sec latency 153.051 ms 2024-09-15T22:32:31.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 86398 7.81 MB/sec execute 468 sec latency 156.513 ms 2024-09-15T22:32:32.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 86547 7.80 MB/sec execute 469 sec latency 126.193 ms 2024-09-15T22:32:33.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 86704 7.81 MB/sec execute 470 sec latency 96.599 ms 2024-09-15T22:32:34.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 86858 7.80 MB/sec execute 471 sec latency 97.274 ms 2024-09-15T22:32:35.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 87030 7.81 MB/sec execute 472 sec latency 107.322 ms 2024-09-15T22:32:36.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 87191 7.80 MB/sec execute 473 sec latency 125.030 ms 2024-09-15T22:32:37.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 87361 7.79 MB/sec execute 474 sec latency 107.441 ms 2024-09-15T22:32:38.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 87528 7.80 MB/sec execute 475 sec latency 96.919 ms 2024-09-15T22:32:39.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 87700 7.80 MB/sec execute 476 sec latency 115.743 ms 2024-09-15T22:32:40.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 87879 7.81 MB/sec execute 477 sec latency 110.268 ms 2024-09-15T22:32:41.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 88029 7.81 MB/sec execute 478 sec latency 93.536 ms 2024-09-15T22:32:42.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 88167 7.82 MB/sec execute 479 sec latency 120.069 ms 2024-09-15T22:32:43.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 88299 7.83 MB/sec execute 480 sec latency 143.753 ms 2024-09-15T22:32:44.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 88491 7.85 MB/sec execute 481 sec latency 118.181 ms 2024-09-15T22:32:45.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 88647 7.85 MB/sec execute 482 sec latency 142.068 ms 2024-09-15T22:32:46.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 88743 7.85 MB/sec execute 483 sec latency 133.976 ms 2024-09-15T22:32:47.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 88843 7.85 MB/sec execute 484 sec latency 96.977 ms 2024-09-15T22:32:48.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 88957 7.84 MB/sec execute 485 sec latency 131.142 ms 2024-09-15T22:32:49.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 89105 7.85 MB/sec execute 486 sec latency 158.349 ms 2024-09-15T22:32:50.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 89227 7.84 MB/sec execute 487 sec latency 153.269 ms 2024-09-15T22:32:51.320 INFO:tasks.workunit.client.0.smithi078.stdout: 10 89334 7.83 MB/sec execute 488 sec latency 156.126 ms 2024-09-15T22:32:52.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 89468 7.83 MB/sec execute 489 sec latency 90.336 ms 2024-09-15T22:32:53.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 89592 7.82 MB/sec execute 490 sec latency 136.527 ms 2024-09-15T22:32:54.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 89732 7.81 MB/sec execute 491 sec latency 148.230 ms 2024-09-15T22:32:55.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 89871 7.81 MB/sec execute 492 sec latency 132.381 ms 2024-09-15T22:32:56.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 90008 7.80 MB/sec execute 493 sec latency 134.757 ms 2024-09-15T22:32:57.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 90161 7.80 MB/sec execute 494 sec latency 122.391 ms 2024-09-15T22:32:58.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 90337 7.80 MB/sec execute 495 sec latency 127.188 ms 2024-09-15T22:32:59.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 90501 7.80 MB/sec execute 496 sec latency 93.931 ms 2024-09-15T22:33:00.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 90664 7.80 MB/sec execute 497 sec latency 92.782 ms 2024-09-15T22:33:01.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 90833 7.80 MB/sec execute 498 sec latency 105.775 ms 2024-09-15T22:33:02.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 91011 7.79 MB/sec execute 499 sec latency 108.562 ms 2024-09-15T22:33:03.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 91185 7.80 MB/sec execute 500 sec latency 135.587 ms 2024-09-15T22:33:04.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 91368 7.81 MB/sec execute 501 sec latency 96.044 ms 2024-09-15T22:33:05.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 91499 7.81 MB/sec execute 502 sec latency 139.713 ms 2024-09-15T22:33:06.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 91640 7.81 MB/sec execute 503 sec latency 99.397 ms 2024-09-15T22:33:07.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 91812 7.83 MB/sec execute 504 sec latency 103.639 ms 2024-09-15T22:33:08.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 92021 7.85 MB/sec execute 505 sec latency 118.831 ms 2024-09-15T22:33:09.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 92187 7.86 MB/sec execute 506 sec latency 129.941 ms 2024-09-15T22:33:10.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 92288 7.86 MB/sec execute 507 sec latency 127.294 ms 2024-09-15T22:33:11.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 92372 7.85 MB/sec execute 508 sec latency 119.147 ms 2024-09-15T22:33:12.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 92490 7.84 MB/sec execute 509 sec latency 131.853 ms 2024-09-15T22:33:13.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 92632 7.85 MB/sec execute 510 sec latency 190.072 ms 2024-09-15T22:33:14.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 92773 7.85 MB/sec execute 511 sec latency 87.419 ms 2024-09-15T22:33:14.473 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:33:14.476 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:33:14.513 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-09-15T22:33:14.512+0000 7fc7d5ee9640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40796) UID: 0 2024-09-15T22:33:15.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 92886 7.84 MB/sec execute 512 sec latency 173.933 ms 2024-09-15T22:33:16.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 93001 7.84 MB/sec execute 513 sec latency 153.699 ms 2024-09-15T22:33:17.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 93122 7.82 MB/sec execute 514 sec latency 152.931 ms 2024-09-15T22:33:18.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 93254 7.82 MB/sec execute 515 sec latency 170.076 ms 2024-09-15T22:33:19.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 93398 7.81 MB/sec execute 516 sec latency 151.070 ms 2024-09-15T22:33:20.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 93535 7.81 MB/sec execute 517 sec latency 187.451 ms 2024-09-15T22:33:21.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 93683 7.81 MB/sec execute 518 sec latency 114.302 ms 2024-09-15T22:33:22.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 93842 7.81 MB/sec execute 519 sec latency 136.246 ms 2024-09-15T22:33:23.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 94001 7.81 MB/sec execute 520 sec latency 123.248 ms 2024-09-15T22:33:24.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 94172 7.81 MB/sec execute 521 sec latency 79.956 ms 2024-09-15T22:33:25.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 94333 7.81 MB/sec execute 522 sec latency 117.397 ms 2024-09-15T22:33:26.321 INFO:tasks.workunit.client.0.smithi078.stdout: 10 94508 7.80 MB/sec execute 523 sec latency 106.365 ms 2024-09-15T22:33:27.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 94669 7.80 MB/sec execute 524 sec latency 118.104 ms 2024-09-15T22:33:28.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 94849 7.81 MB/sec execute 525 sec latency 132.655 ms 2024-09-15T22:33:29.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 95016 7.82 MB/sec execute 526 sec latency 104.628 ms 2024-09-15T22:33:30.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 95148 7.82 MB/sec execute 527 sec latency 127.119 ms 2024-09-15T22:33:31.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 95300 7.83 MB/sec execute 528 sec latency 119.450 ms 2024-09-15T22:33:32.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 95465 7.84 MB/sec execute 529 sec latency 117.894 ms 2024-09-15T22:33:33.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 95627 7.85 MB/sec execute 530 sec latency 126.878 ms 2024-09-15T22:33:34.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 95780 7.85 MB/sec execute 531 sec latency 107.654 ms 2024-09-15T22:33:35.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 95863 7.85 MB/sec execute 532 sec latency 170.721 ms 2024-09-15T22:33:36.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 95973 7.85 MB/sec execute 533 sec latency 84.820 ms 2024-09-15T22:33:37.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 96094 7.84 MB/sec execute 534 sec latency 119.918 ms 2024-09-15T22:33:38.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 96237 7.85 MB/sec execute 535 sec latency 154.458 ms 2024-09-15T22:33:39.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 96361 7.84 MB/sec execute 536 sec latency 143.908 ms 2024-09-15T22:33:40.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 96478 7.84 MB/sec execute 537 sec latency 189.679 ms 2024-09-15T22:33:41.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 96589 7.83 MB/sec execute 538 sec latency 160.676 ms 2024-09-15T22:33:42.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 96695 7.82 MB/sec execute 539 sec latency 192.354 ms 2024-09-15T22:33:43.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 96834 7.81 MB/sec execute 540 sec latency 143.054 ms 2024-09-15T22:33:44.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 96979 7.81 MB/sec execute 541 sec latency 185.804 ms 2024-09-15T22:33:45.322 INFO:tasks.workunit.client.0.smithi078.stdout: 10 97110 7.80 MB/sec execute 542 sec latency 133.677 ms 2024-09-15T22:33:46.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 97261 7.80 MB/sec execute 543 sec latency 168.562 ms 2024-09-15T22:33:47.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 97430 7.80 MB/sec execute 544 sec latency 101.972 ms 2024-09-15T22:33:48.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 97584 7.80 MB/sec execute 545 sec latency 134.644 ms 2024-09-15T22:33:49.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 97753 7.80 MB/sec execute 546 sec latency 89.011 ms 2024-09-15T22:33:50.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 97912 7.80 MB/sec execute 547 sec latency 118.754 ms 2024-09-15T22:33:51.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 98090 7.80 MB/sec execute 548 sec latency 96.619 ms 2024-09-15T22:33:52.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 98253 7.80 MB/sec execute 549 sec latency 114.986 ms 2024-09-15T22:33:53.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 98422 7.80 MB/sec execute 550 sec latency 124.995 ms 2024-09-15T22:33:54.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 98611 7.81 MB/sec execute 551 sec latency 87.977 ms 2024-09-15T22:33:55.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 98738 7.81 MB/sec execute 552 sec latency 124.887 ms 2024-09-15T22:33:56.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 98882 7.82 MB/sec execute 553 sec latency 140.490 ms 2024-09-15T22:33:57.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 99069 7.84 MB/sec execute 554 sec latency 93.159 ms 2024-09-15T22:33:58.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 99225 7.85 MB/sec execute 555 sec latency 132.908 ms 2024-09-15T22:33:59.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 99363 7.85 MB/sec execute 556 sec latency 137.797 ms 2024-09-15T22:34:00.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 99450 7.84 MB/sec execute 557 sec latency 107.863 ms 2024-09-15T22:34:01.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 99568 7.84 MB/sec execute 558 sec latency 109.147 ms 2024-09-15T22:34:02.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 99696 7.84 MB/sec execute 559 sec latency 146.275 ms 2024-09-15T22:34:03.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 99826 7.84 MB/sec execute 560 sec latency 186.805 ms 2024-09-15T22:34:04.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 99953 7.83 MB/sec execute 561 sec latency 111.864 ms 2024-09-15T22:34:05.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 100059 7.83 MB/sec execute 562 sec latency 153.391 ms 2024-09-15T22:34:06.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 100169 7.82 MB/sec execute 563 sec latency 162.620 ms 2024-09-15T22:34:07.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 100295 7.82 MB/sec execute 564 sec latency 156.887 ms 2024-09-15T22:34:08.326 INFO:tasks.workunit.client.0.smithi078.stdout: 10 100432 7.81 MB/sec execute 565 sec latency 145.869 ms 2024-09-15T22:34:09.325 INFO:tasks.workunit.client.0.smithi078.stdout: 10 100572 7.81 MB/sec execute 566 sec latency 167.299 ms 2024-09-15T22:34:10.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 100704 7.80 MB/sec execute 567 sec latency 165.485 ms 2024-09-15T22:34:11.324 INFO:tasks.workunit.client.0.smithi078.stdout: 10 100850 7.80 MB/sec execute 568 sec latency 132.303 ms 2024-09-15T22:34:12.325 INFO:tasks.workunit.client.0.smithi078.stdout: 10 101005 7.80 MB/sec execute 569 sec latency 110.526 ms 2024-09-15T22:34:13.327 INFO:tasks.workunit.client.0.smithi078.stdout: 10 101176 7.80 MB/sec execute 570 sec latency 101.334 ms 2024-09-15T22:34:14.327 INFO:tasks.workunit.client.0.smithi078.stdout: 10 101324 7.80 MB/sec execute 571 sec latency 113.331 ms 2024-09-15T22:34:15.327 INFO:tasks.workunit.client.0.smithi078.stdout: 10 101477 7.80 MB/sec execute 572 sec latency 101.894 ms 2024-09-15T22:34:16.327 INFO:tasks.workunit.client.0.smithi078.stdout: 10 101672 7.80 MB/sec execute 573 sec latency 112.865 ms 2024-09-15T22:34:17.327 INFO:tasks.workunit.client.0.smithi078.stdout: 10 101841 7.80 MB/sec execute 574 sec latency 87.933 ms 2024-09-15T22:34:18.327 INFO:tasks.workunit.client.0.smithi078.stdout: 10 102017 7.80 MB/sec execute 575 sec latency 121.758 ms 2024-09-15T22:34:19.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 102181 7.81 MB/sec execute 576 sec latency 101.657 ms 2024-09-15T22:34:20.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 102318 7.81 MB/sec execute 577 sec latency 93.224 ms 2024-09-15T22:34:21.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 102458 7.82 MB/sec execute 578 sec latency 128.005 ms 2024-09-15T22:34:22.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 102661 7.84 MB/sec execute 579 sec latency 97.244 ms 2024-09-15T22:34:23.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 102808 7.84 MB/sec execute 580 sec latency 99.145 ms 2024-09-15T22:34:24.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 102931 7.84 MB/sec execute 581 sec latency 171.937 ms 2024-09-15T22:34:25.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 102991 7.83 MB/sec execute 582 sec latency 205.342 ms 2024-09-15T22:34:26.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 103093 7.83 MB/sec execute 583 sec latency 132.286 ms 2024-09-15T22:34:27.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 103205 7.83 MB/sec execute 584 sec latency 135.340 ms 2024-09-15T22:34:28.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 103341 7.83 MB/sec execute 585 sec latency 153.374 ms 2024-09-15T22:34:29.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 103467 7.82 MB/sec execute 586 sec latency 196.468 ms 2024-09-15T22:34:30.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 103581 7.82 MB/sec execute 587 sec latency 182.152 ms 2024-09-15T22:34:31.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 103678 7.81 MB/sec execute 588 sec latency 222.726 ms 2024-09-15T22:34:32.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 103798 7.80 MB/sec execute 589 sec latency 153.983 ms 2024-09-15T22:34:33.329 INFO:tasks.workunit.client.0.smithi078.stdout: 10 103943 7.80 MB/sec execute 590 sec latency 103.986 ms 2024-09-15T22:34:34.329 INFO:tasks.workunit.client.0.smithi078.stdout: 10 104080 7.80 MB/sec execute 591 sec latency 187.559 ms 2024-09-15T22:34:35.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 104223 7.80 MB/sec execute 592 sec latency 151.380 ms 2024-09-15T22:34:36.329 INFO:tasks.workunit.client.0.smithi078.stdout: 10 104363 7.79 MB/sec execute 593 sec latency 147.686 ms 2024-09-15T22:34:37.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 104521 7.79 MB/sec execute 594 sec latency 102.479 ms 2024-09-15T22:34:38.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 104685 7.79 MB/sec execute 595 sec latency 98.296 ms 2024-09-15T22:34:39.328 INFO:tasks.workunit.client.0.smithi078.stdout: 10 104846 7.79 MB/sec execute 596 sec latency 117.738 ms 2024-09-15T22:34:40.329 INFO:tasks.workunit.client.0.smithi078.stdout: 10 105011 7.79 MB/sec execute 597 sec latency 116.507 ms 2024-09-15T22:34:41.329 INFO:tasks.workunit.client.0.smithi078.stdout: 10 105185 7.78 MB/sec execute 598 sec latency 106.890 ms 2024-09-15T22:34:42.329 INFO:tasks.workunit.client.0.smithi078.stdout: 10 105345 7.79 MB/sec execute 599 sec latency 101.889 ms 2024-09-15T22:34:43.329 INFO:tasks.workunit.client.0.smithi078.stdout: 10 cleanup 600 sec 2024-09-15T22:34:44.329 INFO:tasks.workunit.client.0.smithi078.stdout: 10 cleanup 601 sec 2024-09-15T22:34:45.185 INFO:tasks.workunit.client.0.smithi078.stdout: 0 cleanup 602 sec 2024-09-15T22:34:45.194 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-15T22:34:45.194 INFO:tasks.workunit.client.0.smithi078.stdout: Operation Count AvgLat MaxLat 2024-09-15T22:34:45.194 INFO:tasks.workunit.client.0.smithi078.stdout: ---------------------------------------- 2024-09-15T22:34:45.194 INFO:tasks.workunit.client.0.smithi078.stdout: NTCreateX 150440 9.229 228.982 2024-09-15T22:34:45.195 INFO:tasks.workunit.client.0.smithi078.stdout: Close 110796 0.129 12.520 2024-09-15T22:34:45.195 INFO:tasks.workunit.client.0.smithi078.stdout: Rename 6377 25.693 391.840 2024-09-15T22:34:45.195 INFO:tasks.workunit.client.0.smithi078.stdout: Unlink 30080 7.258 139.130 2024-09-15T22:34:45.195 INFO:tasks.workunit.client.0.smithi078.stdout: Qpathinfo 136588 5.320 156.886 2024-09-15T22:34:45.195 INFO:tasks.workunit.client.0.smithi078.stdout: Qfileinfo 23862 0.221 4.817 2024-09-15T22:34:45.195 INFO:tasks.workunit.client.0.smithi078.stdout: Qfsinfo 24808 0.593 65.832 2024-09-15T22:34:45.195 INFO:tasks.workunit.client.0.smithi078.stdout: Sfileinfo 12334 1.667 68.231 2024-09-15T22:34:45.195 INFO:tasks.workunit.client.0.smithi078.stdout: Find 52611 62.452 293.792 2024-09-15T22:34:45.195 INFO:tasks.workunit.client.0.smithi078.stdout: WriteX 74381 0.427 75.455 2024-09-15T22:34:45.195 INFO:tasks.workunit.client.0.smithi078.stdout: ReadX 235574 0.006 6.355 2024-09-15T22:34:45.195 INFO:tasks.workunit.client.0.smithi078.stdout: LockX 487 3.100 62.467 2024-09-15T22:34:45.195 INFO:tasks.workunit.client.0.smithi078.stdout: UnlockX 486 2.865 20.249 2024-09-15T22:34:45.195 INFO:tasks.workunit.client.0.smithi078.stdout: Flush 10501 11.798 99.467 2024-09-15T22:34:45.195 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-15T22:34:45.195 INFO:tasks.workunit.client.0.smithi078.stdout:Throughput 7.78864 MB/sec 10 clients 10 procs max_latency=391.850 ms 2024-09-15T22:34:45.196 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-15T22:34:45.196 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-15T22:34:45.831 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-09-15T22:34:45.831 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-15T22:34:46.497 DEBUG:teuthology.parallel:result is None 2024-09-15T22:34:46.497 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T22:34:46.527 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T22:34:46.527 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-15T22:34:46.538 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-15T22:34:46.538 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:34:46.539 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:34:46.593 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:34:46.593 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:34:46.649 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:34:47.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.010+0000 7facce19f640 1 Processor -- start 2024-09-15T22:34:47.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.011+0000 7facce19f640 1 -- start start 2024-09-15T22:34:47.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.011+0000 7facce19f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7facc81414f0 0x7facc8141910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:47.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.011+0000 7facce19f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7facc81501c0 0x7facc81525b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:47.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.011+0000 7facce19f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facc80b5c10 con 0x7facc80b5830 2024-09-15T22:34:47.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.011+0000 7facce19f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7facc80b6d50 con 0x7facc81501c0 2024-09-15T22:34:47.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.011+0000 7facce19f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7facc80b7960 con 0x7facc81414f0 2024-09-15T22:34:47.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.011+0000 7faccd99e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7facc81501c0 0x7facc81525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:47.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.011+0000 7faccd19d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7facc80b5830 0x7facc80b9550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48446/0 (socket says 172.21.15.78:48446) 2024-09-15T22:34:47.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.011+0000 7faccd99e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7facc81501c0 0x7facc81525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56130/0 (socket says 172.21.15.78:56130) 2024-09-15T22:34:47.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.011+0000 7faccd19d640 1 -- 172.21.15.78:0/620087826 learned_addr learned my addr 172.21.15.78:0/620087826 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:34:47.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.011+0000 7faccc99c640 1 --2- 172.21.15.78:0/620087826 >> v2:172.21.15.175:3300/0 conn(0x7facc81414f0 0x7facc8141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:47.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.012+0000 7faccd99e640 1 -- 172.21.15.78:0/620087826 >> v2:172.21.15.175:3300/0 conn(0x7facc81414f0 msgr2=0x7facc8141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:47.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.012+0000 7faccd99e640 1 --2- 172.21.15.78:0/620087826 >> v2:172.21.15.175:3300/0 conn(0x7facc81414f0 0x7facc8141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.012+0000 7faccd99e640 1 -- 172.21.15.78:0/620087826 >> v1:172.21.15.78:6789/0 conn(0x7facc80b5830 legacy=0x7facc80b9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:47.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.012+0000 7facbffff640 1 -- 172.21.15.78:0/620087826 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 379198237 0 0) 0x7facc80b5c10 con 0x7facc80b5830 2024-09-15T22:34:47.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.012+0000 7faccd99e640 1 -- 172.21.15.78:0/620087826 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc80b6a70 con 0x7facc81501c0 2024-09-15T22:34:47.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.012+0000 7faccd99e640 1 --2- 172.21.15.78:0/620087826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc81501c0 0x7facc81525b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7facc80b4860 tx=0x7facc002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d89e4caba1395f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:47.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.013+0000 7facbffff640 1 -- 172.21.15.78:0/620087826 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0007740 con 0x7facc81501c0 2024-09-15T22:34:47.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.013+0000 7facbffff640 1 -- 172.21.15.78:0/620087826 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc00078e0 con 0x7facc81501c0 2024-09-15T22:34:47.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.013+0000 7facbffff640 1 -- 172.21.15.78:0/620087826 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0007cb0 con 0x7facc81501c0 2024-09-15T22:34:47.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.013+0000 7facce19f640 1 -- 172.21.15.78:0/620087826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc81501c0 msgr2=0x7facc81525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:47.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.013+0000 7facce19f640 1 --2- 172.21.15.78:0/620087826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc81501c0 0x7facc81525b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7facc80b4860 tx=0x7facc002a680 comp rx=0 tx=0).stop 2024-09-15T22:34:47.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.013+0000 7facce19f640 1 -- 172.21.15.78:0/620087826 shutdown_connections 2024-09-15T22:34:47.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.013+0000 7facce19f640 1 --2- 172.21.15.78:0/620087826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc81501c0 0x7facc81525b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.013+0000 7facce19f640 1 --2- 172.21.15.78:0/620087826 >> v2:172.21.15.175:3300/0 conn(0x7facc81414f0 0x7facc8141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.013+0000 7facce19f640 1 -- 172.21.15.78:0/620087826 >> 172.21.15.78:0/620087826 conn(0x7facc8073f50 msgr2=0x7facc802c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:47.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.013+0000 7facce19f640 1 -- 172.21.15.78:0/620087826 shutdown_connections 2024-09-15T22:34:47.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.013+0000 7facce19f640 1 -- 172.21.15.78:0/620087826 wait complete. 2024-09-15T22:34:47.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.014+0000 7facce19f640 1 Processor -- start 2024-09-15T22:34:47.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.014+0000 7facce19f640 1 -- start start 2024-09-15T22:34:47.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7facce19f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc80b5830 0x7facc813abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:47.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7facce19f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc81414f0 0x7facc81ddce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:47.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7facce19f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facc81501c0 0x7facc81e0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:47.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7facce19f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7facc80b9c60 con 0x7facc80b5830 2024-09-15T22:34:47.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7facce19f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7facc80b7680 con 0x7facc81414f0 2024-09-15T22:34:47.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7facce19f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7facc8147850 con 0x7facc81501c0 2024-09-15T22:34:47.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7faccd19d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc80b5830 0x7facc813abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:47.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7faccd19d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc80b5830 0x7facc813abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56142/0 (socket says 172.21.15.78:56142) 2024-09-15T22:34:47.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7faccd19d640 1 -- 172.21.15.78:0/3717462806 learned_addr learned my addr 172.21.15.78:0/3717462806 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:47.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7faccc99c640 1 --2- 172.21.15.78:0/3717462806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc81414f0 0x7facc81ddce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:47.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7faccd99e640 1 --2- 172.21.15.78:0/3717462806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facc81501c0 0x7facc81e0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:47.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7faccd19d640 1 -- 172.21.15.78:0/3717462806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facc81501c0 msgr2=0x7facc81e0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:47.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7faccd19d640 1 --2- 172.21.15.78:0/3717462806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facc81501c0 0x7facc81e0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7faccd19d640 1 -- 172.21.15.78:0/3717462806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc81414f0 msgr2=0x7facc81ddce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:47.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7faccd19d640 1 --2- 172.21.15.78:0/3717462806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc81414f0 0x7facc81ddce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7faccd19d640 1 -- 172.21.15.78:0/3717462806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc8142960 con 0x7facc80b5830 2024-09-15T22:34:47.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7faccd19d640 1 --2- 172.21.15.78:0/3717462806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc80b5830 0x7facc813abb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7facc400c4d0 tx=0x7facc400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:47.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7facbdffb640 1 -- 172.21.15.78:0/3717462806 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4018070 con 0x7facc80b5830 2024-09-15T22:34:47.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7facbdffb640 1 -- 172.21.15.78:0/3717462806 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc4007500 con 0x7facc80b5830 2024-09-15T22:34:47.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7facce19f640 1 -- 172.21.15.78:0/3717462806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc81dd540 con 0x7facc80b5830 2024-09-15T22:34:47.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.015+0000 7facbdffb640 1 -- 172.21.15.78:0/3717462806 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4004a20 con 0x7facc80b5830 2024-09-15T22:34:47.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.016+0000 7facce19f640 1 -- 172.21.15.78:0/3717462806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc813b0f0 con 0x7facc80b5830 2024-09-15T22:34:47.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.017+0000 7facce19f640 1 -- 172.21.15.78:0/3717462806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc80b4990 con 0x7facc80b5830 2024-09-15T22:34:47.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.017+0000 7facbdffb640 1 -- 172.21.15.78:0/3717462806 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7facc401b070 con 0x7facc80b5830 2024-09-15T22:34:47.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.018+0000 7facbdffb640 1 --2- 172.21.15.78:0/3717462806 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7facac06c2b0 0x7facac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:47.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.018+0000 7faccc99c640 1 --2- 172.21.15.78:0/3717462806 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7facac06c2b0 0x7facac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:47.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.018+0000 7facbdffb640 1 -- 172.21.15.78:0/3717462806 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7facc408aad0 con 0x7facc80b5830 2024-09-15T22:34:47.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.018+0000 7faccc99c640 1 --2- 172.21.15.78:0/3717462806 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7facac06c2b0 0x7facac06e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7facc81441a0 tx=0x7facb8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:47.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.022+0000 7facbdffb640 1 -- 172.21.15.78:0/3717462806 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7facc81dd540 con 0x7facc80b5830 2024-09-15T22:34:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.294+0000 7facce19f640 1 -- 172.21.15.78:0/3717462806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7facc80bad60 con 0x7facc80b5830 2024-09-15T22:34:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.295+0000 7facbdffb640 1 -- 172.21.15.78:0/3717462806 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7facc8142960 con 0x7facc80b5830 2024-09-15T22:34:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-09-15T22:34:47.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.301+0000 7facce19f640 1 -- 172.21.15.78:0/3717462806 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7facac06c2b0 msgr2=0x7facac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:47.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.301+0000 7facce19f640 1 --2- 172.21.15.78:0/3717462806 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7facac06c2b0 0x7facac06e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7facc81441a0 tx=0x7facb8009190 comp rx=0 tx=0).stop 2024-09-15T22:34:47.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.301+0000 7facce19f640 1 -- 172.21.15.78:0/3717462806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc80b5830 msgr2=0x7facc813abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:47.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.301+0000 7facce19f640 1 --2- 172.21.15.78:0/3717462806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc80b5830 0x7facc813abb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7facc400c4d0 tx=0x7facc400c990 comp rx=0 tx=0).stop 2024-09-15T22:34:47.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.302+0000 7facce19f640 1 -- 172.21.15.78:0/3717462806 shutdown_connections 2024-09-15T22:34:47.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.302+0000 7facce19f640 1 --2- 172.21.15.78:0/3717462806 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7facac06c2b0 0x7facac06e770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.302+0000 7facce19f640 1 --2- 172.21.15.78:0/3717462806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facc81501c0 0x7facc81e0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.302+0000 7facce19f640 1 --2- 172.21.15.78:0/3717462806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc81414f0 0x7facc81ddce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.302+0000 7facce19f640 1 --2- 172.21.15.78:0/3717462806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc80b5830 0x7facc813abb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.302+0000 7facce19f640 1 -- 172.21.15.78:0/3717462806 >> 172.21.15.78:0/3717462806 conn(0x7facc8073f50 msgr2=0x7facc813ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:47.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.302+0000 7facce19f640 1 -- 172.21.15.78:0/3717462806 shutdown_connections 2024-09-15T22:34:47.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.302+0000 7facce19f640 1 -- 172.21.15.78:0/3717462806 wait complete. 2024-09-15T22:34:47.322 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-15T22:34:47.323 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:34:47.357 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:34:47.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.576+0000 7f5b3c95e640 1 Processor -- start 2024-09-15T22:34:47.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.576+0000 7f5b3c95e640 1 -- start start 2024-09-15T22:34:47.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.577+0000 7f5b3c95e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b30009c50 0x7f5b3001ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:47.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.577+0000 7f5b3c95e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b300ca030 0x7f5b300ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:47.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.577+0000 7f5b3c95e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b3001b040 con 0x7f5b300d0720 2024-09-15T22:34:47.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.577+0000 7f5b3c95e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f5b3001b9e0 con 0x7f5b300ca030 2024-09-15T22:34:47.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.577+0000 7f5b3c95e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3000a030 con 0x7f5b30009c50 2024-09-15T22:34:47.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.577+0000 7f5b37fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b300ca030 0x7f5b300ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:47.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.577+0000 7f5b37fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b300ca030 0x7f5b300ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56148/0 (socket says 172.21.15.78:56148) 2024-09-15T22:34:47.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.577+0000 7f5b37fff640 1 -- 172.21.15.78:0/521161638 learned_addr learned my addr 172.21.15.78:0/521161638 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:47.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.578+0000 7f5b37fff640 1 -- 172.21.15.78:0/521161638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b30009c50 msgr2=0x7f5b3001ab00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:34:47.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.578+0000 7f5b37fff640 1 --2- 172.21.15.78:0/521161638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b30009c50 0x7f5b3001ab00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.578+0000 7f5b37fff640 1 -- 172.21.15.78:0/521161638 >> v1:172.21.15.78:6789/0 conn(0x7f5b300d0720 legacy=0x7f5b300d0b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:34:47.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.578+0000 7f5b37fff640 1 -- 172.21.15.78:0/521161638 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3001b320 con 0x7f5b300ca030 2024-09-15T22:34:47.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.579+0000 7f5b37fff640 1 --2- 172.21.15.78:0/521161638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b300ca030 0x7f5b300ca4e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b3806a380 tx=0x7f5b380a6500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d1be700b151afb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:47.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.579+0000 7f5b367fc640 1 -- 172.21.15.78:0/521161638 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b380b2070 con 0x7f5b300ca030 2024-09-15T22:34:47.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.579+0000 7f5b367fc640 1 -- 172.21.15.78:0/521161638 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b380ad600 con 0x7f5b300ca030 2024-09-15T22:34:47.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.580+0000 7f5b3c95e640 1 -- 172.21.15.78:0/521161638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b300ca030 msgr2=0x7f5b300ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:47.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.580+0000 7f5b3c95e640 1 --2- 172.21.15.78:0/521161638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b300ca030 0x7f5b300ca4e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b3806a380 tx=0x7f5b380a6500 comp rx=0 tx=0).stop 2024-09-15T22:34:47.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.581+0000 7f5b3c95e640 1 -- 172.21.15.78:0/521161638 shutdown_connections 2024-09-15T22:34:47.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.581+0000 7f5b3c95e640 1 --2- 172.21.15.78:0/521161638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b300ca030 0x7f5b300ca4e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.581+0000 7f5b3c95e640 1 --2- 172.21.15.78:0/521161638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b30009c50 0x7f5b3001ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.581+0000 7f5b3c95e640 1 -- 172.21.15.78:0/521161638 >> 172.21.15.78:0/521161638 conn(0x7f5b30008e90 msgr2=0x7f5b30009270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:47.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.584+0000 7f5b3c95e640 1 -- 172.21.15.78:0/521161638 shutdown_connections 2024-09-15T22:34:47.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.587+0000 7f5b3c95e640 1 -- 172.21.15.78:0/521161638 wait complete. 2024-09-15T22:34:47.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.588+0000 7f5b3c95e640 1 Processor -- start 2024-09-15T22:34:47.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.589+0000 7f5b3c95e640 1 -- start start 2024-09-15T22:34:47.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.590+0000 7f5b3c95e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b30009c50 0x7f5b300cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:47.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.590+0000 7f5b3c95e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b300d0720 0x7f5b300cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:47.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.590+0000 7f5b3c95e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b300cdbc0 0x7f5b3001fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:47.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.590+0000 7f5b3c95e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5b30039b90 con 0x7f5b300d0720 2024-09-15T22:34:47.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.590+0000 7f5b3c95e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b300caa20 con 0x7f5b30009c50 2024-09-15T22:34:47.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.590+0000 7f5b3c95e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5b30039d10 con 0x7f5b300cdbc0 2024-09-15T22:34:47.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.590+0000 7f5b36ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b300d0720 0x7f5b300cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:47.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.590+0000 7f5b37fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b300cdbc0 0x7f5b3001fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:47.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.591+0000 7f5b37fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b300cdbc0 0x7f5b3001fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.78:44496/0 (socket says 172.21.15.78:44496) 2024-09-15T22:34:47.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.591+0000 7f5b37fff640 1 -- 172.21.15.78:0/3904569303 learned_addr learned my addr 172.21.15.78:0/3904569303 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:47.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.591+0000 7f5b36ffd640 1 -- 172.21.15.78:0/3904569303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b300cdbc0 msgr2=0x7f5b3001fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.591+0000 7f5b36ffd640 1 --2- 172.21.15.78:0/3904569303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b300cdbc0 0x7f5b3001fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.591+0000 7f5b36ffd640 1 -- 172.21.15.78:0/3904569303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b30009c50 msgr2=0x7f5b300cd550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:34:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.591+0000 7f5b36ffd640 1 --2- 172.21.15.78:0/3904569303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b30009c50 0x7f5b300cd550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.591+0000 7f5b36ffd640 1 -- 172.21.15.78:0/3904569303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b300cc9e0 con 0x7f5b300d0720 2024-09-15T22:34:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.591+0000 7f5b36ffd640 1 --2- 172.21.15.78:0/3904569303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b300d0720 0x7f5b300cacf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00b3e0 tx=0x7f5b2c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.593+0000 7f5b23fff640 1 -- 172.21.15.78:0/3904569303 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c015020 con 0x7f5b300d0720 2024-09-15T22:34:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.593+0000 7f5b23fff640 1 -- 172.21.15.78:0/3904569303 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b2c011830 con 0x7f5b300d0720 2024-09-15T22:34:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.593+0000 7f5b23fff640 1 -- 172.21.15.78:0/3904569303 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c011c00 con 0x7f5b300d0720 2024-09-15T22:34:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.593+0000 7f5b3c95e640 1 -- 172.21.15.78:0/3904569303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b300c98f0 con 0x7f5b300d0720 2024-09-15T22:34:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.593+0000 7f5b3c95e640 1 -- 172.21.15.78:0/3904569303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b300cc700 con 0x7f5b300d0720 2024-09-15T22:34:47.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.595+0000 7f5b3c95e640 1 -- 172.21.15.78:0/3904569303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b300ca030 con 0x7f5b300d0720 2024-09-15T22:34:47.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.605+0000 7f5b23fff640 1 -- 172.21.15.78:0/3904569303 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5b2c018020 con 0x7f5b300d0720 2024-09-15T22:34:47.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.605+0000 7f5b23fff640 1 --2- 172.21.15.78:0/3904569303 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5b1c06c330 0x7f5b1c06e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:47.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.606+0000 7f5b23fff640 1 -- 172.21.15.78:0/3904569303 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7f5b2c08bc20 con 0x7f5b300d0720 2024-09-15T22:34:47.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.606+0000 7f5b377fe640 1 --2- 172.21.15.78:0/3904569303 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5b1c06c330 0x7f5b1c06e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:47.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.606+0000 7f5b23fff640 1 -- 172.21.15.78:0/3904569303 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b2c08be20 con 0x7f5b300d0720 2024-09-15T22:34:47.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.607+0000 7f5b377fe640 1 --2- 172.21.15.78:0/3904569303 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5b1c06c330 0x7f5b1c06e7f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009670 tx=0x7f5b24006bd0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:47.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.841+0000 7f5b3c95e640 1 -- 172.21.15.78:0/3904569303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5b300d12c0 con 0x7f5b300d0720 2024-09-15T22:34:47.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.842+0000 7f5b23fff640 1 -- 172.21.15.78:0/3904569303 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f5b2c08be20 con 0x7f5b300d0720 2024-09-15T22:34:47.844 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-09-15T22:34:47.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.844+0000 7f5b3c95e640 1 -- 172.21.15.78:0/3904569303 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5b1c06c330 msgr2=0x7f5b1c06e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:47.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.844+0000 7f5b3c95e640 1 --2- 172.21.15.78:0/3904569303 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5b1c06c330 0x7f5b1c06e7f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009670 tx=0x7f5b24006bd0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.844+0000 7f5b3c95e640 1 -- 172.21.15.78:0/3904569303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b300d0720 msgr2=0x7f5b300cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:47.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.844+0000 7f5b3c95e640 1 --2- 172.21.15.78:0/3904569303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b300d0720 0x7f5b300cacf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00b3e0 tx=0x7f5b2c00b8a0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.844+0000 7f5b3c95e640 1 -- 172.21.15.78:0/3904569303 shutdown_connections 2024-09-15T22:34:47.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.844+0000 7f5b3c95e640 1 --2- 172.21.15.78:0/3904569303 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5b1c06c330 0x7f5b1c06e7f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.844+0000 7f5b3c95e640 1 --2- 172.21.15.78:0/3904569303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b300cdbc0 0x7f5b3001fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.844+0000 7f5b3c95e640 1 --2- 172.21.15.78:0/3904569303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b300d0720 0x7f5b300cacf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.844+0000 7f5b3c95e640 1 --2- 172.21.15.78:0/3904569303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b30009c50 0x7f5b300cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:47.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.844+0000 7f5b3c95e640 1 -- 172.21.15.78:0/3904569303 >> 172.21.15.78:0/3904569303 conn(0x7f5b30008e90 msgr2=0x7f5b300385a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:47.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.844+0000 7f5b3c95e640 1 -- 172.21.15.78:0/3904569303 shutdown_connections 2024-09-15T22:34:47.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:47.844+0000 7f5b3c95e640 1 -- 172.21.15.78:0/3904569303 wait complete. 2024-09-15T22:34:47.856 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi078.front.sepia.ceph.com... 2024-09-15T22:34:47.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:34:47.857 DEBUG:teuthology.orchestra.run.smithi078:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T22:34:47.888 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[43838]: fuse finished with error 0 and tester_r 0 2024-09-15T22:34:47.889 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:34:53.992 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2024-09-15T22:34:53.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:34:53.992 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:34:54.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:34:54.097 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-15T22:34:54.135 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:34:54.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:34:54.136 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:34:54.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:34:54.205 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2024-09-15T22:34:54.317 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-15T22:34:54.326 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:34:54.326 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:34:54.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.428+0000 7fe0ec0f1640 1 Processor -- start 2024-09-15T22:34:54.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.428+0000 7fe0ec0f1640 1 -- start start 2024-09-15T22:34:54.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0ec0f1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe0e40bbdf0 0x7fe0e4072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:54.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0ec0f1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe0e4072ff0 0x7fe0e40b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:54.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0ec0f1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40b6340 0x7fe0e40b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:54.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0ec0f1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e4072220 con 0x7fe0e4072ff0 2024-09-15T22:34:54.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0ec0f1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e40bc1d0 con 0x7fe0e40bbdf0 2024-09-15T22:34:54.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0ec0f1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e406d290 con 0x7fe0e40b6340 2024-09-15T22:34:54.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0e968c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe0e4072ff0 0x7fe0e40b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:54.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0e968c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe0e4072ff0 0x7fe0e40b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54326/0 (socket says 172.21.15.78:54326) 2024-09-15T22:34:54.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0e968c640 1 -- 172.21.15.78:0/350403400 learned_addr learned my addr 172.21.15.78:0/350403400 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:54.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0e9e8d640 1 --2- 172.21.15.78:0/350403400 >> v2:172.21.15.175:3300/0 conn(0x7fe0e40bbdf0 0x7fe0e4072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:54.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0ea68e640 1 --2- 172.21.15.78:0/350403400 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40b6340 0x7fe0e40b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:54.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0e968c640 1 -- 172.21.15.78:0/350403400 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40b6340 msgr2=0x7fe0e40b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:54.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0e968c640 1 --2- 172.21.15.78:0/350403400 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40b6340 0x7fe0e40b67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0e968c640 1 -- 172.21.15.78:0/350403400 >> v2:172.21.15.175:3300/0 conn(0x7fe0e40bbdf0 msgr2=0x7fe0e4072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:54.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0e968c640 1 --2- 172.21.15.78:0/350403400 >> v2:172.21.15.175:3300/0 conn(0x7fe0e40bbdf0 0x7fe0e4072ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.429+0000 7fe0e968c640 1 -- 172.21.15.78:0/350403400 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e4072500 con 0x7fe0e4072ff0 2024-09-15T22:34:54.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.430+0000 7fe0e968c640 1 --2- 172.21.15.78:0/350403400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0e4072ff0 0x7fe0e40b5e00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40b6ea0 tx=0x7fe0d402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924e3a23d25f9c06 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:54.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.430+0000 7fe0e8e8b640 1 -- 172.21.15.78:0/350403400 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4037070 con 0x7fe0e4072ff0 2024-09-15T22:34:54.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.430+0000 7fe0e8e8b640 1 -- 172.21.15.78:0/350403400 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d4032440 con 0x7fe0e4072ff0 2024-09-15T22:34:54.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.430+0000 7fe0e8e8b640 1 -- 172.21.15.78:0/350403400 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4032810 con 0x7fe0e4072ff0 2024-09-15T22:34:54.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.430+0000 7fe0ec0f1640 1 -- 172.21.15.78:0/350403400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0e4072ff0 msgr2=0x7fe0e40b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.430+0000 7fe0ec0f1640 1 --2- 172.21.15.78:0/350403400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0e4072ff0 0x7fe0e40b5e00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40b6ea0 tx=0x7fe0d402a140 comp rx=0 tx=0).stop 2024-09-15T22:34:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.430+0000 7fe0ec0f1640 1 -- 172.21.15.78:0/350403400 shutdown_connections 2024-09-15T22:34:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.430+0000 7fe0ec0f1640 1 --2- 172.21.15.78:0/350403400 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40b6340 0x7fe0e40b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.430+0000 7fe0ec0f1640 1 --2- 172.21.15.78:0/350403400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0e4072ff0 0x7fe0e40b5e00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.430+0000 7fe0ec0f1640 1 --2- 172.21.15.78:0/350403400 >> v2:172.21.15.175:3300/0 conn(0x7fe0e40bbdf0 0x7fe0e4072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.430+0000 7fe0ec0f1640 1 -- 172.21.15.78:0/350403400 >> 172.21.15.78:0/350403400 conn(0x7fe0e4075360 msgr2=0x7fe0e40bb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.431+0000 7fe0ec0f1640 1 -- 172.21.15.78:0/350403400 shutdown_connections 2024-09-15T22:34:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.431+0000 7fe0ec0f1640 1 -- 172.21.15.78:0/350403400 wait complete. 2024-09-15T22:34:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0ec0f1640 1 Processor -- start 2024-09-15T22:34:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0ec0f1640 1 -- start start 2024-09-15T22:34:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0ec0f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0e4072ff0 0x7fe0e40b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:54.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0ec0f1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0e40b6340 0x7fe0e4125670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:54.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0ec0f1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40bbdf0 0x7fe0e41235a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:54.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0ec0f1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e406d830 con 0x7fe0e4072ff0 2024-09-15T22:34:54.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0ec0f1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e406d550 con 0x7fe0e40b6340 2024-09-15T22:34:54.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0ec0f1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e406bc50 con 0x7fe0e40bbdf0 2024-09-15T22:34:54.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0e9e8d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0e4072ff0 0x7fe0e40b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:54.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0e9e8d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0e4072ff0 0x7fe0e40b08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54340/0 (socket says 172.21.15.78:54340) 2024-09-15T22:34:54.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0e9e8d640 1 -- 172.21.15.78:0/332403000 learned_addr learned my addr 172.21.15.78:0/332403000 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:54.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0ea68e640 1 --2- 172.21.15.78:0/332403000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40bbdf0 0x7fe0e41235a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:54.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0e968c640 1 --2- 172.21.15.78:0/332403000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0e40b6340 0x7fe0e4125670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:54.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0e9e8d640 1 -- 172.21.15.78:0/332403000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40bbdf0 msgr2=0x7fe0e41235a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:54.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0e9e8d640 1 --2- 172.21.15.78:0/332403000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40bbdf0 0x7fe0e41235a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0e9e8d640 1 -- 172.21.15.78:0/332403000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0e40b6340 msgr2=0x7fe0e4125670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:54.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0e9e8d640 1 --2- 172.21.15.78:0/332403000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0e40b6340 0x7fe0e4125670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.432+0000 7fe0e9e8d640 1 -- 172.21.15.78:0/332403000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e4125bb0 con 0x7fe0e4072ff0 2024-09-15T22:34:54.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.433+0000 7fe0e9e8d640 1 --2- 172.21.15.78:0/332403000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0e4072ff0 0x7fe0e40b08b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000e870 tx=0x7fe0e000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:54.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.433+0000 7fe0da7fc640 1 -- 172.21.15.78:0/332403000 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0017070 con 0x7fe0e4072ff0 2024-09-15T22:34:54.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.433+0000 7fe0da7fc640 1 -- 172.21.15.78:0/332403000 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e000c940 con 0x7fe0e4072ff0 2024-09-15T22:34:54.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.433+0000 7fe0ec0f1640 1 -- 172.21.15.78:0/332403000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e4125ea0 con 0x7fe0e4072ff0 2024-09-15T22:34:54.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.433+0000 7fe0da7fc640 1 -- 172.21.15.78:0/332403000 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e000cd30 con 0x7fe0e4072ff0 2024-09-15T22:34:54.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.433+0000 7fe0ec0f1640 1 -- 172.21.15.78:0/332403000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e4127000 con 0x7fe0e4072ff0 2024-09-15T22:34:54.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.434+0000 7fe0ec0f1640 1 -- 172.21.15.78:0/332403000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e40b7c50 con 0x7fe0e4072ff0 2024-09-15T22:34:54.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.434+0000 7fe0da7fc640 1 -- 172.21.15.78:0/332403000 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe0e001a070 con 0x7fe0e4072ff0 2024-09-15T22:34:54.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.435+0000 7fe0da7fc640 1 --2- 172.21.15.78:0/332403000 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe0c806c2b0 0x7fe0c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:54.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.435+0000 7fe0da7fc640 1 -- 172.21.15.78:0/332403000 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7fe0e008b6e0 con 0x7fe0e4072ff0 2024-09-15T22:34:54.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.435+0000 7fe0e968c640 1 --2- 172.21.15.78:0/332403000 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe0c806c2b0 0x7fe0c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:54.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.435+0000 7fe0e968c640 1 --2- 172.21.15.78:0/332403000 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe0c806c2b0 0x7fe0c806e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4034000 tx=0x7fe0d402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:54.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.439+0000 7fe0da7fc640 1 -- 172.21.15.78:0/332403000 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe0e4125ea0 con 0x7fe0e4072ff0 2024-09-15T22:34:54.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.608+0000 7fe0ec0f1640 1 -- 172.21.15.78:0/332403000 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0e4071c60 con 0x7fe0c806c2b0 2024-09-15T22:34:54.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.616+0000 7fe0da7fc640 1 -- 172.21.15.78:0/332403000 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335299 (secure 0 0 0) 0x7fe0e4071c60 con 0x7fe0c806c2b0 2024-09-15T22:34:54.621 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:34:54.624 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-15T22:34:54.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.620+0000 7fe0ec0f1640 1 -- 172.21.15.78:0/332403000 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe0c806c2b0 msgr2=0x7fe0c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:54.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.620+0000 7fe0ec0f1640 1 --2- 172.21.15.78:0/332403000 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe0c806c2b0 0x7fe0c806e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4034000 tx=0x7fe0d402e000 comp rx=0 tx=0).stop 2024-09-15T22:34:54.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.620+0000 7fe0ec0f1640 1 -- 172.21.15.78:0/332403000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0e4072ff0 msgr2=0x7fe0e40b08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:54.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.620+0000 7fe0ec0f1640 1 --2- 172.21.15.78:0/332403000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0e4072ff0 0x7fe0e40b08b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000e870 tx=0x7fe0e000ed30 comp rx=0 tx=0).stop 2024-09-15T22:34:54.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.620+0000 7fe0ec0f1640 1 -- 172.21.15.78:0/332403000 shutdown_connections 2024-09-15T22:34:54.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.620+0000 7fe0ec0f1640 1 --2- 172.21.15.78:0/332403000 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe0c806c2b0 0x7fe0c806e770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.620+0000 7fe0ec0f1640 1 --2- 172.21.15.78:0/332403000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40bbdf0 0x7fe0e41235a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.620+0000 7fe0ec0f1640 1 --2- 172.21.15.78:0/332403000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0e40b6340 0x7fe0e4125670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.620+0000 7fe0ec0f1640 1 --2- 172.21.15.78:0/332403000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0e4072ff0 0x7fe0e40b08b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.620+0000 7fe0ec0f1640 1 -- 172.21.15.78:0/332403000 >> 172.21.15.78:0/332403000 conn(0x7fe0e4075360 msgr2=0x7fe0e40b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:54.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.620+0000 7fe0ec0f1640 1 -- 172.21.15.78:0/332403000 shutdown_connections 2024-09-15T22:34:54.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.620+0000 7fe0ec0f1640 1 -- 172.21.15.78:0/332403000 wait complete. 2024-09-15T22:34:54.632 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":795,"stamp":"2024-09-15T22:34:54.300666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":249372333,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":3046,"num_read_kb":8096,"num_write":191653,"num_write_kb":4329880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273662,"ondisk_log_size":273662,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4119276,"kb_used_data":322092,"kb_used_omap":12,"kb_used_meta":3797043,"kb_avail":750855444,"statfs":{"total":773094113280,"available":768875974656,"internally_reserved":0,"allocated":329822208,"data_stored":499767724,"data_compressed":51505869,"data_compressed_allocated":79249408,"data_compressed_original":250613760,"omap_allocated":12747,"internal_metadata":3888172597},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-209229419,"num_objects":-1368,"num_object_clones":0,"num_object_copies":-4128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1368,"num_whiteouts":0,"num_read":19,"num_read_kb":113,"num_write":2168,"num_write_kb":18787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-113,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003093"},"pg_stats":[{"pgid":"2.1f","version":"27'1783","reported_seq":1821,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.144511+0000","last_change":"2024-09-15T22:09:16.403008+0000","last_active":"2024-09-15T22:34:48.144511+0000","last_peered":"2024-09-15T22:34:48.144511+0000","last_clean":"2024-09-15T22:34:48.144511+0000","last_became_active":"2024-09-15T22:09:16.402725+0000","last_became_peered":"2024-09-15T22:09:16.402725+0000","last_unstale":"2024-09-15T22:34:48.144511+0000","last_undegraded":"2024-09-15T22:34:48.144511+0000","last_fullsized":"2024-09-15T22:34:48.144511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:32.659951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1792,"num_write_kb":13194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'869","reported_seq":905,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.157563+0000","last_change":"2024-09-15T22:09:17.400698+0000","last_active":"2024-09-15T22:34:48.157563+0000","last_peered":"2024-09-15T22:34:48.157563+0000","last_clean":"2024-09-15T22:34:48.157563+0000","last_became_active":"2024-09-15T22:09:17.400428+0000","last_became_peered":"2024-09-15T22:09:17.400428+0000","last_unstale":"2024-09-15T22:34:48.157563+0000","last_undegraded":"2024-09-15T22:34:48.157563+0000","last_fullsized":"2024-09-15T22:34:48.157563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:15.431072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4221","reported_seq":4249,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.657041+0000","last_change":"2024-09-15T22:09:21.449737+0000","last_active":"2024-09-15T22:34:47.657041+0000","last_peered":"2024-09-15T22:34:47.657041+0000","last_clean":"2024-09-15T22:34:47.657041+0000","last_became_active":"2024-09-15T22:09:21.449376+0000","last_became_peered":"2024-09-15T22:09:21.449376+0000","last_unstale":"2024-09-15T22:34:47.657041+0000","last_undegraded":"2024-09-15T22:34:47.657041+0000","last_fullsized":"2024-09-15T22:34:47.657041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4221,"log_dups_size":0,"ondisk_log_size":4221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:13.943283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3323,"num_write_kb":95202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3536","reported_seq":3574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.121078+0000","last_change":"2024-09-15T22:09:16.407728+0000","last_active":"2024-09-15T22:34:48.121078+0000","last_peered":"2024-09-15T22:34:48.121078+0000","last_clean":"2024-09-15T22:34:48.121078+0000","last_became_active":"2024-09-15T22:09:16.407458+0000","last_became_peered":"2024-09-15T22:09:16.407458+0000","last_unstale":"2024-09-15T22:34:48.121078+0000","last_undegraded":"2024-09-15T22:34:48.121078+0000","last_fullsized":"2024-09-15T22:34:48.121078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3536,"log_dups_size":0,"ondisk_log_size":3536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":30404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'865","reported_seq":901,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.000407+0000","last_change":"2024-09-15T22:09:17.415311+0000","last_active":"2024-09-15T22:34:48.000407+0000","last_peered":"2024-09-15T22:34:48.000407+0000","last_clean":"2024-09-15T22:34:48.000407+0000","last_became_active":"2024-09-15T22:09:17.414966+0000","last_became_peered":"2024-09-15T22:09:17.414966+0000","last_unstale":"2024-09-15T22:34:48.000407+0000","last_undegraded":"2024-09-15T22:34:48.000407+0000","last_fullsized":"2024-09-15T22:34:48.000407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":865,"log_dups_size":0,"ondisk_log_size":865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'3714","reported_seq":3742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.633395+0000","last_change":"2024-09-15T22:09:21.454087+0000","last_active":"2024-09-15T22:34:47.633395+0000","last_peered":"2024-09-15T22:34:47.633395+0000","last_clean":"2024-09-15T22:34:47.633395+0000","last_became_active":"2024-09-15T22:09:21.453701+0000","last_became_peered":"2024-09-15T22:09:21.453701+0000","last_unstale":"2024-09-15T22:34:47.633395+0000","last_undegraded":"2024-09-15T22:34:47.633395+0000","last_fullsized":"2024-09-15T22:34:47.633395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3714,"log_dups_size":0,"ondisk_log_size":3714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:29.697947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2789,"num_write_kb":63634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'4509","reported_seq":4545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.133997+0000","last_change":"2024-09-15T22:09:16.405902+0000","last_active":"2024-09-15T22:34:48.133997+0000","last_peered":"2024-09-15T22:34:48.133997+0000","last_clean":"2024-09-15T22:34:48.133997+0000","last_became_active":"2024-09-15T22:09:16.405626+0000","last_became_peered":"2024-09-15T22:09:16.405626+0000","last_unstale":"2024-09-15T22:34:48.133997+0000","last_undegraded":"2024-09-15T22:34:48.133997+0000","last_fullsized":"2024-09-15T22:34:48.133997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4509,"log_dups_size":0,"ondisk_log_size":4509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:03.001838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4510,"num_write_kb":35033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'918","reported_seq":957,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.992605+0000","last_change":"2024-09-15T22:09:59.805432+0000","last_active":"2024-09-15T22:34:47.992605+0000","last_peered":"2024-09-15T22:34:47.992605+0000","last_clean":"2024-09-15T22:34:47.992605+0000","last_became_active":"2024-09-15T22:09:59.804970+0000","last_became_peered":"2024-09-15T22:09:59.804970+0000","last_unstale":"2024-09-15T22:34:47.992605+0000","last_undegraded":"2024-09-15T22:34:47.992605+0000","last_fullsized":"2024-09-15T22:34:47.992605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:41.901744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3619","reported_seq":3647,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.710065+0000","last_change":"2024-09-15T22:09:21.455260+0000","last_active":"2024-09-15T22:34:47.710065+0000","last_peered":"2024-09-15T22:34:47.710065+0000","last_clean":"2024-09-15T22:34:47.710065+0000","last_became_active":"2024-09-15T22:09:21.454850+0000","last_became_peered":"2024-09-15T22:09:21.454850+0000","last_unstale":"2024-09-15T22:34:47.710065+0000","last_undegraded":"2024-09-15T22:34:47.710065+0000","last_fullsized":"2024-09-15T22:34:47.710065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3619,"log_dups_size":0,"ondisk_log_size":3619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:08.904123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2687,"num_write_kb":123513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'2007","reported_seq":2043,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:35.617698+0000","last_change":"2024-09-15T22:09:16.407670+0000","last_active":"2024-09-15T22:34:35.617698+0000","last_peered":"2024-09-15T22:34:35.617698+0000","last_clean":"2024-09-15T22:34:35.617698+0000","last_became_active":"2024-09-15T22:09:16.407364+0000","last_became_peered":"2024-09-15T22:09:16.407364+0000","last_unstale":"2024-09-15T22:34:35.617698+0000","last_undegraded":"2024-09-15T22:34:35.617698+0000","last_fullsized":"2024-09-15T22:34:35.617698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2007,"log_dups_size":0,"ondisk_log_size":2007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:01.284777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2007,"num_write_kb":17393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'890","reported_seq":924,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.007199+0000","last_change":"2024-09-15T22:09:17.408224+0000","last_active":"2024-09-15T22:34:48.007199+0000","last_peered":"2024-09-15T22:34:48.007199+0000","last_clean":"2024-09-15T22:34:48.007199+0000","last_became_active":"2024-09-15T22:09:17.407881+0000","last_became_peered":"2024-09-15T22:09:17.407881+0000","last_unstale":"2024-09-15T22:34:48.007199+0000","last_undegraded":"2024-09-15T22:34:48.007199+0000","last_fullsized":"2024-09-15T22:34:48.007199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":890,"log_dups_size":0,"ondisk_log_size":890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:22.003479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'3863","reported_seq":3891,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.164932+0000","last_change":"2024-09-15T22:09:21.450705+0000","last_active":"2024-09-15T22:34:48.164932+0000","last_peered":"2024-09-15T22:34:48.164932+0000","last_clean":"2024-09-15T22:34:48.164932+0000","last_became_active":"2024-09-15T22:09:21.450265+0000","last_became_peered":"2024-09-15T22:09:21.450265+0000","last_unstale":"2024-09-15T22:34:48.164932+0000","last_undegraded":"2024-09-15T22:34:48.164932+0000","last_fullsized":"2024-09-15T22:34:48.164932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3863,"log_dups_size":0,"ondisk_log_size":3863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:21.477522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3014,"num_write_kb":86107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'883","reported_seq":918,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.970600+0000","last_change":"2024-09-15T22:09:17.410686+0000","last_active":"2024-09-15T22:34:47.970600+0000","last_peered":"2024-09-15T22:34:47.970600+0000","last_clean":"2024-09-15T22:34:47.970600+0000","last_became_active":"2024-09-15T22:09:17.410383+0000","last_became_peered":"2024-09-15T22:09:17.410383+0000","last_unstale":"2024-09-15T22:34:47.970600+0000","last_undegraded":"2024-09-15T22:34:47.970600+0000","last_fullsized":"2024-09-15T22:34:47.970600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'3968","reported_seq":4005,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.155998+0000","last_change":"2024-09-15T22:09:16.405335+0000","last_active":"2024-09-15T22:34:48.155998+0000","last_peered":"2024-09-15T22:34:48.155998+0000","last_clean":"2024-09-15T22:34:48.155998+0000","last_became_active":"2024-09-15T22:09:16.405010+0000","last_became_peered":"2024-09-15T22:09:16.405010+0000","last_unstale":"2024-09-15T22:34:48.155998+0000","last_undegraded":"2024-09-15T22:34:48.155998+0000","last_fullsized":"2024-09-15T22:34:48.155998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3968,"log_dups_size":0,"ondisk_log_size":3968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:00.202736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3969,"num_write_kb":30662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'3504","reported_seq":3540,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.346344+0000","last_change":"2024-09-15T22:09:59.534148+0000","last_active":"2024-09-15T22:34:47.346344+0000","last_peered":"2024-09-15T22:34:47.346344+0000","last_clean":"2024-09-15T22:34:47.346344+0000","last_became_active":"2024-09-15T22:09:59.533675+0000","last_became_peered":"2024-09-15T22:09:59.533675+0000","last_unstale":"2024-09-15T22:34:47.346344+0000","last_undegraded":"2024-09-15T22:34:47.346344+0000","last_fullsized":"2024-09-15T22:34:47.346344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3504,"log_dups_size":0,"ondisk_log_size":3504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.055754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2557,"num_write_kb":53761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'919","reported_seq":954,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.975733+0000","last_change":"2024-09-15T22:09:17.405327+0000","last_active":"2024-09-15T22:34:47.975733+0000","last_peered":"2024-09-15T22:34:47.975733+0000","last_clean":"2024-09-15T22:34:47.975733+0000","last_became_active":"2024-09-15T22:09:17.405065+0000","last_became_peered":"2024-09-15T22:09:17.405065+0000","last_unstale":"2024-09-15T22:34:47.975733+0000","last_undegraded":"2024-09-15T22:34:47.975733+0000","last_fullsized":"2024-09-15T22:34:47.975733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3442","reported_seq":3479,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.145460+0000","last_change":"2024-09-15T22:09:16.406705+0000","last_active":"2024-09-15T22:34:48.145460+0000","last_peered":"2024-09-15T22:34:48.145460+0000","last_clean":"2024-09-15T22:34:48.145460+0000","last_became_active":"2024-09-15T22:09:16.406454+0000","last_became_peered":"2024-09-15T22:09:16.406454+0000","last_unstale":"2024-09-15T22:34:48.145460+0000","last_undegraded":"2024-09-15T22:34:48.145460+0000","last_fullsized":"2024-09-15T22:34:48.145460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3442,"log_dups_size":0,"ondisk_log_size":3442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:02.444245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3448,"num_write_kb":30365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'4173","reported_seq":4209,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.694112+0000","last_change":"2024-09-15T22:09:59.805673+0000","last_active":"2024-09-15T22:34:47.694112+0000","last_peered":"2024-09-15T22:34:47.694112+0000","last_clean":"2024-09-15T22:34:47.694112+0000","last_became_active":"2024-09-15T22:09:59.805100+0000","last_became_peered":"2024-09-15T22:09:59.805100+0000","last_unstale":"2024-09-15T22:34:47.694112+0000","last_undegraded":"2024-09-15T22:34:47.694112+0000","last_fullsized":"2024-09-15T22:34:47.694112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4173,"log_dups_size":0,"ondisk_log_size":4173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:10.812526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3298,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'955","reported_seq":990,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.982724+0000","last_change":"2024-09-15T22:09:17.399551+0000","last_active":"2024-09-15T22:34:47.982724+0000","last_peered":"2024-09-15T22:34:47.982724+0000","last_clean":"2024-09-15T22:34:47.982724+0000","last_became_active":"2024-09-15T22:09:17.399290+0000","last_became_peered":"2024-09-15T22:09:17.399290+0000","last_unstale":"2024-09-15T22:34:47.982724+0000","last_undegraded":"2024-09-15T22:34:47.982724+0000","last_fullsized":"2024-09-15T22:34:47.982724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2082","reported_seq":2119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.144890+0000","last_change":"2024-09-15T22:09:16.408974+0000","last_active":"2024-09-15T22:34:48.144890+0000","last_peered":"2024-09-15T22:34:48.144890+0000","last_clean":"2024-09-15T22:34:48.144890+0000","last_became_active":"2024-09-15T22:09:16.408691+0000","last_became_peered":"2024-09-15T22:09:16.408691+0000","last_unstale":"2024-09-15T22:34:48.144890+0000","last_undegraded":"2024-09-15T22:34:48.144890+0000","last_fullsized":"2024-09-15T22:34:48.144890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2082,"log_dups_size":0,"ondisk_log_size":2082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:26:32.412274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2101,"num_write_kb":17400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'3631","reported_seq":3660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.474619+0000","last_change":"2024-09-15T22:09:21.458893+0000","last_active":"2024-09-15T22:34:47.474619+0000","last_peered":"2024-09-15T22:34:47.474619+0000","last_clean":"2024-09-15T22:34:47.474619+0000","last_became_active":"2024-09-15T22:09:21.458548+0000","last_became_peered":"2024-09-15T22:09:21.458548+0000","last_unstale":"2024-09-15T22:34:47.474619+0000","last_undegraded":"2024-09-15T22:34:47.474619+0000","last_fullsized":"2024-09-15T22:34:47.474619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3631,"log_dups_size":0,"ondisk_log_size":3631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:29.163692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2705,"num_write_kb":61946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'892","reported_seq":927,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.603569+0000","last_change":"2024-09-15T22:09:17.400823+0000","last_active":"2024-09-15T22:34:47.603569+0000","last_peered":"2024-09-15T22:34:47.603569+0000","last_clean":"2024-09-15T22:34:47.603569+0000","last_became_active":"2024-09-15T22:09:17.400494+0000","last_became_peered":"2024-09-15T22:09:17.400494+0000","last_unstale":"2024-09-15T22:34:47.603569+0000","last_undegraded":"2024-09-15T22:34:47.603569+0000","last_fullsized":"2024-09-15T22:34:47.603569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:02.290840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1674","reported_seq":1711,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.125462+0000","last_change":"2024-09-15T22:09:16.409156+0000","last_active":"2024-09-15T22:34:48.125462+0000","last_peered":"2024-09-15T22:34:48.125462+0000","last_clean":"2024-09-15T22:34:48.125462+0000","last_became_active":"2024-09-15T22:09:16.408603+0000","last_became_peered":"2024-09-15T22:09:16.408603+0000","last_unstale":"2024-09-15T22:34:48.125462+0000","last_undegraded":"2024-09-15T22:34:48.125462+0000","last_fullsized":"2024-09-15T22:34:48.125462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1674,"log_dups_size":0,"ondisk_log_size":1674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:12.245902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1676,"num_write_kb":13088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'3587","reported_seq":3616,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.170565+0000","last_change":"2024-09-15T22:09:21.447940+0000","last_active":"2024-09-15T22:34:48.170565+0000","last_peered":"2024-09-15T22:34:48.170565+0000","last_clean":"2024-09-15T22:34:48.170565+0000","last_became_active":"2024-09-15T22:09:21.447348+0000","last_became_peered":"2024-09-15T22:09:21.447348+0000","last_unstale":"2024-09-15T22:34:48.170565+0000","last_undegraded":"2024-09-15T22:34:48.170565+0000","last_fullsized":"2024-09-15T22:34:48.170565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3587,"log_dups_size":0,"ondisk_log_size":3587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:19.466950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2651,"num_write_kb":118894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'899","reported_seq":934,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.973665+0000","last_change":"2024-09-15T22:09:17.402826+0000","last_active":"2024-09-15T22:34:47.973665+0000","last_peered":"2024-09-15T22:34:47.973665+0000","last_clean":"2024-09-15T22:34:47.973665+0000","last_became_active":"2024-09-15T22:09:17.402585+0000","last_became_peered":"2024-09-15T22:09:17.402585+0000","last_unstale":"2024-09-15T22:34:47.973665+0000","last_undegraded":"2024-09-15T22:34:47.973665+0000","last_fullsized":"2024-09-15T22:34:47.973665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'1634","reported_seq":1671,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.142630+0000","last_change":"2024-09-15T22:09:16.408097+0000","last_active":"2024-09-15T22:34:48.142630+0000","last_peered":"2024-09-15T22:34:48.142630+0000","last_clean":"2024-09-15T22:34:48.142630+0000","last_became_active":"2024-09-15T22:09:16.407657+0000","last_became_peered":"2024-09-15T22:09:16.407657+0000","last_unstale":"2024-09-15T22:34:48.142630+0000","last_undegraded":"2024-09-15T22:34:48.142630+0000","last_fullsized":"2024-09-15T22:34:48.142630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1634,"log_dups_size":0,"ondisk_log_size":1634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":13124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'3592","reported_seq":3622,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.680644+0000","last_change":"2024-09-15T22:09:21.451205+0000","last_active":"2024-09-15T22:34:47.680644+0000","last_peered":"2024-09-15T22:34:47.680644+0000","last_clean":"2024-09-15T22:34:47.680644+0000","last_became_active":"2024-09-15T22:09:21.450731+0000","last_became_peered":"2024-09-15T22:09:21.450731+0000","last_unstale":"2024-09-15T22:34:47.680644+0000","last_undegraded":"2024-09-15T22:34:47.680644+0000","last_fullsized":"2024-09-15T22:34:47.680644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:38.650786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2678,"num_write_kb":64130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'844","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.996996+0000","last_change":"2024-09-15T22:09:17.421690+0000","last_active":"2024-09-15T22:34:47.996996+0000","last_peered":"2024-09-15T22:34:47.996996+0000","last_clean":"2024-09-15T22:34:47.996996+0000","last_became_active":"2024-09-15T22:09:17.421379+0000","last_became_peered":"2024-09-15T22:09:17.421379+0000","last_unstale":"2024-09-15T22:34:47.996996+0000","last_undegraded":"2024-09-15T22:34:47.996996+0000","last_fullsized":"2024-09-15T22:34:47.996996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2976","reported_seq":3013,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.143681+0000","last_change":"2024-09-15T22:09:16.408662+0000","last_active":"2024-09-15T22:34:48.143681+0000","last_peered":"2024-09-15T22:34:48.143681+0000","last_clean":"2024-09-15T22:34:48.143681+0000","last_became_active":"2024-09-15T22:09:16.408068+0000","last_became_peered":"2024-09-15T22:09:16.408068+0000","last_unstale":"2024-09-15T22:34:48.143681+0000","last_undegraded":"2024-09-15T22:34:48.143681+0000","last_fullsized":"2024-09-15T22:34:48.143681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2976,"log_dups_size":0,"ondisk_log_size":2976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:29.217773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5729,"num_write_kb":16111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'3599","reported_seq":3629,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.663354+0000","last_change":"2024-09-15T22:09:21.457447+0000","last_active":"2024-09-15T22:34:47.663354+0000","last_peered":"2024-09-15T22:34:47.663354+0000","last_clean":"2024-09-15T22:34:47.663354+0000","last_became_active":"2024-09-15T22:09:21.457031+0000","last_became_peered":"2024-09-15T22:09:21.457031+0000","last_unstale":"2024-09-15T22:34:47.663354+0000","last_undegraded":"2024-09-15T22:34:47.663354+0000","last_fullsized":"2024-09-15T22:34:47.663354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:45.457068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":57002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'901","reported_seq":937,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.973110+0000","last_change":"2024-09-15T22:09:17.400043+0000","last_active":"2024-09-15T22:34:47.973110+0000","last_peered":"2024-09-15T22:34:47.973110+0000","last_clean":"2024-09-15T22:34:47.973110+0000","last_became_active":"2024-09-15T22:09:17.399815+0000","last_became_peered":"2024-09-15T22:09:17.399815+0000","last_unstale":"2024-09-15T22:34:47.973110+0000","last_undegraded":"2024-09-15T22:34:47.973110+0000","last_fullsized":"2024-09-15T22:34:47.973110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:38.779044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2759","reported_seq":2797,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:20.157772+0000","last_change":"2024-09-15T22:09:16.407483+0000","last_active":"2024-09-15T22:34:20.157772+0000","last_peered":"2024-09-15T22:34:20.157772+0000","last_clean":"2024-09-15T22:34:20.157772+0000","last_became_active":"2024-09-15T22:09:16.407199+0000","last_became_peered":"2024-09-15T22:09:16.407199+0000","last_unstale":"2024-09-15T22:34:20.157772+0000","last_undegraded":"2024-09-15T22:34:20.157772+0000","last_fullsized":"2024-09-15T22:34:20.157772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2759,"log_dups_size":0,"ondisk_log_size":2759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:24.102281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2756,"num_write_kb":21836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'4104","reported_seq":4134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.647277+0000","last_change":"2024-09-15T22:09:21.449620+0000","last_active":"2024-09-15T22:34:47.647277+0000","last_peered":"2024-09-15T22:34:47.647277+0000","last_clean":"2024-09-15T22:34:47.647277+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:34:47.647277+0000","last_undegraded":"2024-09-15T22:34:47.647277+0000","last_fullsized":"2024-09-15T22:34:47.647277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4104,"log_dups_size":0,"ondisk_log_size":4104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:40.690811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3164,"num_write_kb":141390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'867","reported_seq":903,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.005792+0000","last_change":"2024-09-15T22:09:17.414930+0000","last_active":"2024-09-15T22:34:48.005792+0000","last_peered":"2024-09-15T22:34:48.005792+0000","last_clean":"2024-09-15T22:34:48.005792+0000","last_became_active":"2024-09-15T22:09:17.414645+0000","last_became_peered":"2024-09-15T22:09:17.414645+0000","last_unstale":"2024-09-15T22:34:48.005792+0000","last_undegraded":"2024-09-15T22:34:48.005792+0000","last_fullsized":"2024-09-15T22:34:48.005792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:22.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'2263","reported_seq":2301,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.120454+0000","last_change":"2024-09-15T22:09:16.408794+0000","last_active":"2024-09-15T22:34:48.120454+0000","last_peered":"2024-09-15T22:34:48.120454+0000","last_clean":"2024-09-15T22:34:48.120454+0000","last_became_active":"2024-09-15T22:09:16.408530+0000","last_became_peered":"2024-09-15T22:09:16.408530+0000","last_unstale":"2024-09-15T22:34:48.120454+0000","last_undegraded":"2024-09-15T22:34:48.120454+0000","last_fullsized":"2024-09-15T22:34:48.120454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2263,"log_dups_size":0,"ondisk_log_size":2263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:45.460989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2269,"num_write_kb":17504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'4348","reported_seq":4378,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.693261+0000","last_change":"2024-09-15T22:09:21.451875+0000","last_active":"2024-09-15T22:34:47.693261+0000","last_peered":"2024-09-15T22:34:47.693261+0000","last_clean":"2024-09-15T22:34:47.693261+0000","last_became_active":"2024-09-15T22:09:21.451491+0000","last_became_peered":"2024-09-15T22:09:21.451491+0000","last_unstale":"2024-09-15T22:34:47.693261+0000","last_undegraded":"2024-09-15T22:34:47.693261+0000","last_fullsized":"2024-09-15T22:34:47.693261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4348,"log_dups_size":0,"ondisk_log_size":4348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:11.279572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3466,"num_write_kb":69520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'894","reported_seq":930,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.974828+0000","last_change":"2024-09-15T22:09:17.409336+0000","last_active":"2024-09-15T22:34:47.974828+0000","last_peered":"2024-09-15T22:34:47.974828+0000","last_clean":"2024-09-15T22:34:47.974828+0000","last_became_active":"2024-09-15T22:09:17.409038+0000","last_became_peered":"2024-09-15T22:09:17.409038+0000","last_unstale":"2024-09-15T22:34:47.974828+0000","last_undegraded":"2024-09-15T22:34:47.974828+0000","last_fullsized":"2024-09-15T22:34:47.974828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:06.946537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5434","reported_seq":5472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.136131+0000","last_change":"2024-09-15T22:09:16.409869+0000","last_active":"2024-09-15T22:34:48.136131+0000","last_peered":"2024-09-15T22:34:48.136131+0000","last_clean":"2024-09-15T22:34:48.136131+0000","last_became_active":"2024-09-15T22:09:16.409532+0000","last_became_peered":"2024-09-15T22:09:16.409532+0000","last_unstale":"2024-09-15T22:34:48.136131+0000","last_undegraded":"2024-09-15T22:34:48.136131+0000","last_fullsized":"2024-09-15T22:34:48.136131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":5434,"log_dups_size":0,"ondisk_log_size":5434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:05.940474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20380159,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5429,"num_write_kb":47121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'4057","reported_seq":4087,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.703003+0000","last_change":"2024-09-15T22:09:21.458201+0000","last_active":"2024-09-15T22:34:47.703003+0000","last_peered":"2024-09-15T22:34:47.703003+0000","last_clean":"2024-09-15T22:34:47.703003+0000","last_became_active":"2024-09-15T22:09:21.457818+0000","last_became_peered":"2024-09-15T22:09:21.457818+0000","last_unstale":"2024-09-15T22:34:47.703003+0000","last_undegraded":"2024-09-15T22:34:47.703003+0000","last_fullsized":"2024-09-15T22:34:47.703003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4057,"log_dups_size":0,"ondisk_log_size":4057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:16.163530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3146,"num_write_kb":128629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'903","reported_seq":939,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.968435+0000","last_change":"2024-09-15T22:09:17.399405+0000","last_active":"2024-09-15T22:34:47.968435+0000","last_peered":"2024-09-15T22:34:47.968435+0000","last_clean":"2024-09-15T22:34:47.968435+0000","last_became_active":"2024-09-15T22:09:17.399148+0000","last_became_peered":"2024-09-15T22:09:17.399148+0000","last_unstale":"2024-09-15T22:34:47.968435+0000","last_undegraded":"2024-09-15T22:34:47.968435+0000","last_fullsized":"2024-09-15T22:34:47.968435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:29.126156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'4744","reported_seq":7015,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.147334+0000","last_change":"2024-09-15T22:09:16.402885+0000","last_active":"2024-09-15T22:34:48.147334+0000","last_peered":"2024-09-15T22:34:48.147334+0000","last_clean":"2024-09-15T22:34:48.147334+0000","last_became_active":"2024-09-15T22:09:16.402575+0000","last_became_peered":"2024-09-15T22:09:16.402575+0000","last_unstale":"2024-09-15T22:34:48.147334+0000","last_undegraded":"2024-09-15T22:34:48.147334+0000","last_fullsized":"2024-09-15T22:34:48.147334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4744,"log_dups_size":0,"ondisk_log_size":4744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2233,"num_read_kb":5661,"num_write":4757,"num_write_kb":27314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'3833","reported_seq":3862,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.687630+0000","last_change":"2024-09-15T22:09:21.457254+0000","last_active":"2024-09-15T22:34:47.687630+0000","last_peered":"2024-09-15T22:34:47.687630+0000","last_clean":"2024-09-15T22:34:47.687630+0000","last_became_active":"2024-09-15T22:09:21.456858+0000","last_became_peered":"2024-09-15T22:09:21.456858+0000","last_unstale":"2024-09-15T22:34:47.687630+0000","last_undegraded":"2024-09-15T22:34:47.687630+0000","last_fullsized":"2024-09-15T22:34:47.687630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:52.339264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2989,"num_write_kb":154181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'860","reported_seq":896,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.982932+0000","last_change":"2024-09-15T22:09:17.411196+0000","last_active":"2024-09-15T22:34:47.982932+0000","last_peered":"2024-09-15T22:34:47.982932+0000","last_clean":"2024-09-15T22:34:47.982932+0000","last_became_active":"2024-09-15T22:09:17.409905+0000","last_became_peered":"2024-09-15T22:09:17.409905+0000","last_unstale":"2024-09-15T22:34:47.982932+0000","last_undegraded":"2024-09-15T22:34:47.982932+0000","last_fullsized":"2024-09-15T22:34:47.982932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:10.299704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'3959","reported_seq":3997,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.122816+0000","last_change":"2024-09-15T22:09:16.409152+0000","last_active":"2024-09-15T22:34:48.122816+0000","last_peered":"2024-09-15T22:34:48.122816+0000","last_clean":"2024-09-15T22:34:48.122816+0000","last_became_active":"2024-09-15T22:09:16.408793+0000","last_became_peered":"2024-09-15T22:09:16.408793+0000","last_unstale":"2024-09-15T22:34:48.122816+0000","last_undegraded":"2024-09-15T22:34:48.122816+0000","last_fullsized":"2024-09-15T22:34:48.122816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3959,"log_dups_size":0,"ondisk_log_size":3959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:09.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3958,"num_write_kb":30646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'3858","reported_seq":3887,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.507795+0000","last_change":"2024-09-15T22:09:21.456804+0000","last_active":"2024-09-15T22:34:47.507795+0000","last_peered":"2024-09-15T22:34:47.507795+0000","last_clean":"2024-09-15T22:34:47.507795+0000","last_became_active":"2024-09-15T22:09:21.456416+0000","last_became_peered":"2024-09-15T22:09:21.456416+0000","last_unstale":"2024-09-15T22:34:47.507795+0000","last_undegraded":"2024-09-15T22:34:47.507795+0000","last_fullsized":"2024-09-15T22:34:47.507795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3858,"log_dups_size":0,"ondisk_log_size":3858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:28.462550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2949,"num_write_kb":92106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'903","reported_seq":924,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.995708+0000","last_change":"2024-09-15T22:09:59.531923+0000","last_active":"2024-09-15T22:34:47.995708+0000","last_peered":"2024-09-15T22:34:47.995708+0000","last_clean":"2024-09-15T22:34:47.995708+0000","last_became_active":"2024-09-15T22:09:59.531667+0000","last_became_peered":"2024-09-15T22:09:59.531667+0000","last_unstale":"2024-09-15T22:34:47.995708+0000","last_undegraded":"2024-09-15T22:34:47.995708+0000","last_fullsized":"2024-09-15T22:34:47.995708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'2199","reported_seq":2237,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.140187+0000","last_change":"2024-09-15T22:09:16.401625+0000","last_active":"2024-09-15T22:34:48.140187+0000","last_peered":"2024-09-15T22:34:48.140187+0000","last_clean":"2024-09-15T22:34:48.140187+0000","last_became_active":"2024-09-15T22:09:16.401328+0000","last_became_peered":"2024-09-15T22:09:16.401328+0000","last_unstale":"2024-09-15T22:34:48.140187+0000","last_undegraded":"2024-09-15T22:34:48.140187+0000","last_fullsized":"2024-09-15T22:34:48.140187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2199,"log_dups_size":0,"ondisk_log_size":2199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2201,"num_write_kb":17467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:31:10.136103+0000","last_change":"2024-09-15T22:09:07.243631+0000","last_active":"2024-09-15T22:31:10.136103+0000","last_peered":"2024-09-15T22:31:10.136103+0000","last_clean":"2024-09-15T22:31:10.136103+0000","last_became_active":"2024-09-15T22:09:07.243223+0000","last_became_peered":"2024-09-15T22:09:07.243223+0000","last_unstale":"2024-09-15T22:31:10.136103+0000","last_undegraded":"2024-09-15T22:31:10.136103+0000","last_fullsized":"2024-09-15T22:31:10.136103+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_clean_scrub_stamp":"2024-09-15T22:09:06.009777+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:17:18.429315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'4430","reported_seq":4460,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.619292+0000","last_change":"2024-09-15T22:09:21.453536+0000","last_active":"2024-09-15T22:34:47.619292+0000","last_peered":"2024-09-15T22:34:47.619292+0000","last_clean":"2024-09-15T22:34:47.619292+0000","last_became_active":"2024-09-15T22:09:21.453022+0000","last_became_peered":"2024-09-15T22:09:21.453022+0000","last_unstale":"2024-09-15T22:34:47.619292+0000","last_undegraded":"2024-09-15T22:34:47.619292+0000","last_fullsized":"2024-09-15T22:34:47.619292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4430,"log_dups_size":0,"ondisk_log_size":4430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:26.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3508,"num_write_kb":155329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'902","reported_seq":942,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.982222+0000","last_change":"2024-09-15T22:09:59.534250+0000","last_active":"2024-09-15T22:34:47.982222+0000","last_peered":"2024-09-15T22:34:47.982222+0000","last_clean":"2024-09-15T22:34:47.982222+0000","last_became_active":"2024-09-15T22:09:59.533885+0000","last_became_peered":"2024-09-15T22:09:59.533885+0000","last_unstale":"2024-09-15T22:34:47.982222+0000","last_undegraded":"2024-09-15T22:34:47.982222+0000","last_fullsized":"2024-09-15T22:34:47.982222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:26.642804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'3371","reported_seq":3408,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.132472+0000","last_change":"2024-09-15T22:09:16.404982+0000","last_active":"2024-09-15T22:34:48.132472+0000","last_peered":"2024-09-15T22:34:48.132472+0000","last_clean":"2024-09-15T22:34:48.132472+0000","last_became_active":"2024-09-15T22:09:16.404639+0000","last_became_peered":"2024-09-15T22:09:16.404639+0000","last_unstale":"2024-09-15T22:34:48.132472+0000","last_undegraded":"2024-09-15T22:34:48.132472+0000","last_fullsized":"2024-09-15T22:34:48.132472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3371,"log_dups_size":0,"ondisk_log_size":3371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3372,"num_write_kb":30249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'3562","reported_seq":3591,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.703425+0000","last_change":"2024-09-15T22:09:21.457352+0000","last_active":"2024-09-15T22:34:47.703425+0000","last_peered":"2024-09-15T22:34:47.703425+0000","last_clean":"2024-09-15T22:34:47.703425+0000","last_became_active":"2024-09-15T22:09:21.456906+0000","last_became_peered":"2024-09-15T22:09:21.456906+0000","last_unstale":"2024-09-15T22:34:47.703425+0000","last_undegraded":"2024-09-15T22:34:47.703425+0000","last_fullsized":"2024-09-15T22:34:47.703425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3562,"log_dups_size":0,"ondisk_log_size":3562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:28.271273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2654,"num_write_kb":61277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'891","reported_seq":926,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.985965+0000","last_change":"2024-09-15T22:09:17.416652+0000","last_active":"2024-09-15T22:34:47.985965+0000","last_peered":"2024-09-15T22:34:47.985965+0000","last_clean":"2024-09-15T22:34:47.985965+0000","last_became_active":"2024-09-15T22:09:17.415597+0000","last_became_peered":"2024-09-15T22:09:17.415597+0000","last_unstale":"2024-09-15T22:34:47.985965+0000","last_undegraded":"2024-09-15T22:34:47.985965+0000","last_fullsized":"2024-09-15T22:34:47.985965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:36.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'4278","reported_seq":4315,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.145535+0000","last_change":"2024-09-15T22:09:16.405689+0000","last_active":"2024-09-15T22:34:48.145535+0000","last_peered":"2024-09-15T22:34:48.145535+0000","last_clean":"2024-09-15T22:34:48.145535+0000","last_became_active":"2024-09-15T22:09:16.405433+0000","last_became_peered":"2024-09-15T22:09:16.405433+0000","last_unstale":"2024-09-15T22:34:48.145535+0000","last_undegraded":"2024-09-15T22:34:48.145535+0000","last_fullsized":"2024-09-15T22:34:48.145535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4278,"log_dups_size":0,"ondisk_log_size":4278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.332999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4278,"num_write_kb":34786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'3805","reported_seq":3841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.683777+0000","last_change":"2024-09-15T22:09:59.534678+0000","last_active":"2024-09-15T22:34:47.683777+0000","last_peered":"2024-09-15T22:34:47.683777+0000","last_clean":"2024-09-15T22:34:47.683777+0000","last_became_active":"2024-09-15T22:09:59.534224+0000","last_became_peered":"2024-09-15T22:09:59.534224+0000","last_unstale":"2024-09-15T22:34:47.683777+0000","last_undegraded":"2024-09-15T22:34:47.683777+0000","last_fullsized":"2024-09-15T22:34:47.683777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3805,"log_dups_size":0,"ondisk_log_size":3805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:29.093882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2836,"num_write_kb":60139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'879","reported_seq":914,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.006366+0000","last_change":"2024-09-15T22:09:17.412910+0000","last_active":"2024-09-15T22:34:48.006366+0000","last_peered":"2024-09-15T22:34:48.006366+0000","last_clean":"2024-09-15T22:34:48.006366+0000","last_became_active":"2024-09-15T22:09:17.412079+0000","last_became_peered":"2024-09-15T22:09:17.412079+0000","last_unstale":"2024-09-15T22:34:48.006366+0000","last_undegraded":"2024-09-15T22:34:48.006366+0000","last_fullsized":"2024-09-15T22:34:48.006366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:04.536343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'2409","reported_seq":2446,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.117233+0000","last_change":"2024-09-15T22:09:16.405941+0000","last_active":"2024-09-15T22:34:48.117233+0000","last_peered":"2024-09-15T22:34:48.117233+0000","last_clean":"2024-09-15T22:34:48.117233+0000","last_became_active":"2024-09-15T22:09:16.405621+0000","last_became_peered":"2024-09-15T22:09:16.405621+0000","last_unstale":"2024-09-15T22:34:48.117233+0000","last_undegraded":"2024-09-15T22:34:48.117233+0000","last_fullsized":"2024-09-15T22:34:48.117233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2409,"log_dups_size":0,"ondisk_log_size":2409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2412,"num_write_kb":21631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'4109","reported_seq":4138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.174045+0000","last_change":"2024-09-15T22:09:21.449669+0000","last_active":"2024-09-15T22:34:48.174045+0000","last_peered":"2024-09-15T22:34:48.174045+0000","last_clean":"2024-09-15T22:34:48.174045+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:34:48.174045+0000","last_undegraded":"2024-09-15T22:34:48.174045+0000","last_fullsized":"2024-09-15T22:34:48.174045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4109,"log_dups_size":0,"ondisk_log_size":4109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:45.457068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3191,"num_write_kb":110194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'910","reported_seq":945,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.981911+0000","last_change":"2024-09-15T22:09:17.410475+0000","last_active":"2024-09-15T22:34:47.981911+0000","last_peered":"2024-09-15T22:34:47.981911+0000","last_clean":"2024-09-15T22:34:47.981911+0000","last_became_active":"2024-09-15T22:09:17.410176+0000","last_became_peered":"2024-09-15T22:09:17.410176+0000","last_unstale":"2024-09-15T22:34:47.981911+0000","last_undegraded":"2024-09-15T22:34:47.981911+0000","last_fullsized":"2024-09-15T22:34:47.981911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'1504","reported_seq":1541,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.120787+0000","last_change":"2024-09-15T22:09:16.399090+0000","last_active":"2024-09-15T22:34:48.120787+0000","last_peered":"2024-09-15T22:34:48.120787+0000","last_clean":"2024-09-15T22:34:48.120787+0000","last_became_active":"2024-09-15T22:09:16.398789+0000","last_became_peered":"2024-09-15T22:09:16.398789+0000","last_unstale":"2024-09-15T22:34:48.120787+0000","last_undegraded":"2024-09-15T22:34:48.120787+0000","last_fullsized":"2024-09-15T22:34:48.120787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1504,"log_dups_size":0,"ondisk_log_size":1504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:14.477432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1509,"num_write_kb":13058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'3700","reported_seq":3729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.621769+0000","last_change":"2024-09-15T22:09:21.448270+0000","last_active":"2024-09-15T22:34:47.621769+0000","last_peered":"2024-09-15T22:34:47.621769+0000","last_clean":"2024-09-15T22:34:47.621769+0000","last_became_active":"2024-09-15T22:09:21.447541+0000","last_became_peered":"2024-09-15T22:09:21.447541+0000","last_unstale":"2024-09-15T22:34:47.621769+0000","last_undegraded":"2024-09-15T22:34:47.621769+0000","last_fullsized":"2024-09-15T22:34:47.621769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3700,"log_dups_size":0,"ondisk_log_size":3700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:51.175728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2791,"num_write_kb":90475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'922","reported_seq":956,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.992661+0000","last_change":"2024-09-15T22:09:17.410762+0000","last_active":"2024-09-15T22:34:47.992661+0000","last_peered":"2024-09-15T22:34:47.992661+0000","last_clean":"2024-09-15T22:34:47.992661+0000","last_became_active":"2024-09-15T22:09:17.410431+0000","last_became_peered":"2024-09-15T22:09:17.410431+0000","last_unstale":"2024-09-15T22:34:47.992661+0000","last_undegraded":"2024-09-15T22:34:47.992661+0000","last_fullsized":"2024-09-15T22:34:47.992661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:15.123863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'1787","reported_seq":1823,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.130026+0000","last_change":"2024-09-15T22:09:16.409298+0000","last_active":"2024-09-15T22:34:48.130026+0000","last_peered":"2024-09-15T22:34:48.130026+0000","last_clean":"2024-09-15T22:34:48.130026+0000","last_became_active":"2024-09-15T22:09:16.408991+0000","last_became_peered":"2024-09-15T22:09:16.408991+0000","last_unstale":"2024-09-15T22:34:48.130026+0000","last_undegraded":"2024-09-15T22:34:48.130026+0000","last_fullsized":"2024-09-15T22:34:48.130026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1787,"log_dups_size":0,"ondisk_log_size":1787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.799831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1802,"num_write_kb":13181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'3624","reported_seq":3652,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.703935+0000","last_change":"2024-09-15T22:09:21.453936+0000","last_active":"2024-09-15T22:34:47.703935+0000","last_peered":"2024-09-15T22:34:47.703935+0000","last_clean":"2024-09-15T22:34:47.703935+0000","last_became_active":"2024-09-15T22:09:21.453526+0000","last_became_peered":"2024-09-15T22:09:21.453526+0000","last_unstale":"2024-09-15T22:34:47.703935+0000","last_undegraded":"2024-09-15T22:34:47.703935+0000","last_fullsized":"2024-09-15T22:34:47.703935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:19.159742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2710,"num_write_kb":101760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'885","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.971021+0000","last_change":"2024-09-15T22:09:17.404617+0000","last_active":"2024-09-15T22:34:47.971021+0000","last_peered":"2024-09-15T22:34:47.971021+0000","last_clean":"2024-09-15T22:34:47.971021+0000","last_became_active":"2024-09-15T22:09:17.404310+0000","last_became_peered":"2024-09-15T22:09:17.404310+0000","last_unstale":"2024-09-15T22:34:47.971021+0000","last_undegraded":"2024-09-15T22:34:47.971021+0000","last_fullsized":"2024-09-15T22:34:47.971021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:17.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'963","reported_seq":999,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.117866+0000","last_change":"2024-09-15T22:09:16.403439+0000","last_active":"2024-09-15T22:34:48.117866+0000","last_peered":"2024-09-15T22:34:48.117866+0000","last_clean":"2024-09-15T22:34:48.117866+0000","last_became_active":"2024-09-15T22:09:16.403137+0000","last_became_peered":"2024-09-15T22:09:16.403137+0000","last_unstale":"2024-09-15T22:34:48.117866+0000","last_undegraded":"2024-09-15T22:34:48.117866+0000","last_fullsized":"2024-09-15T22:34:48.117866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:05.940474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":974,"num_write_kb":8662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'3775","reported_seq":3803,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.687144+0000","last_change":"2024-09-15T22:09:21.451370+0000","last_active":"2024-09-15T22:34:47.687144+0000","last_peered":"2024-09-15T22:34:47.687144+0000","last_clean":"2024-09-15T22:34:47.687144+0000","last_became_active":"2024-09-15T22:09:21.451016+0000","last_became_peered":"2024-09-15T22:09:21.451016+0000","last_unstale":"2024-09-15T22:34:47.687144+0000","last_undegraded":"2024-09-15T22:34:47.687144+0000","last_fullsized":"2024-09-15T22:34:47.687144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:54.480340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2843,"num_write_kb":133663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'906","reported_seq":940,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.006538+0000","last_change":"2024-09-15T22:09:17.412953+0000","last_active":"2024-09-15T22:34:48.006538+0000","last_peered":"2024-09-15T22:34:48.006538+0000","last_clean":"2024-09-15T22:34:48.006538+0000","last_became_active":"2024-09-15T22:09:17.412680+0000","last_became_peered":"2024-09-15T22:09:17.412680+0000","last_unstale":"2024-09-15T22:34:48.006538+0000","last_undegraded":"2024-09-15T22:34:48.006538+0000","last_fullsized":"2024-09-15T22:34:48.006538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":906,"log_dups_size":0,"ondisk_log_size":906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:36.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'443","reported_seq":479,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.126611+0000","last_change":"2024-09-15T22:09:16.406833+0000","last_active":"2024-09-15T22:34:48.126611+0000","last_peered":"2024-09-15T22:34:48.126611+0000","last_clean":"2024-09-15T22:34:48.126611+0000","last_became_active":"2024-09-15T22:09:16.406550+0000","last_became_peered":"2024-09-15T22:09:16.406550+0000","last_unstale":"2024-09-15T22:34:48.126611+0000","last_undegraded":"2024-09-15T22:34:48.126611+0000","last_fullsized":"2024-09-15T22:34:48.126611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":462,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'4060","reported_seq":4088,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.669028+0000","last_change":"2024-09-15T22:09:21.450825+0000","last_active":"2024-09-15T22:34:47.669028+0000","last_peered":"2024-09-15T22:34:47.669028+0000","last_clean":"2024-09-15T22:34:47.669028+0000","last_became_active":"2024-09-15T22:09:21.450200+0000","last_became_peered":"2024-09-15T22:09:21.450200+0000","last_unstale":"2024-09-15T22:34:47.669028+0000","last_undegraded":"2024-09-15T22:34:47.669028+0000","last_fullsized":"2024-09-15T22:34:47.669028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4060,"log_dups_size":0,"ondisk_log_size":4060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:10.812526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3182,"num_write_kb":92617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'876","reported_seq":910,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.986053+0000","last_change":"2024-09-15T22:09:17.421088+0000","last_active":"2024-09-15T22:34:47.986053+0000","last_peered":"2024-09-15T22:34:47.986053+0000","last_clean":"2024-09-15T22:34:47.986053+0000","last_became_active":"2024-09-15T22:09:17.420802+0000","last_became_peered":"2024-09-15T22:09:17.420802+0000","last_unstale":"2024-09-15T22:34:47.986053+0000","last_undegraded":"2024-09-15T22:34:47.986053+0000","last_fullsized":"2024-09-15T22:34:47.986053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:57.079300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'2258","reported_seq":2294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.131076+0000","last_change":"2024-09-15T22:09:16.395676+0000","last_active":"2024-09-15T22:34:48.131076+0000","last_peered":"2024-09-15T22:34:48.131076+0000","last_clean":"2024-09-15T22:34:48.131076+0000","last_became_active":"2024-09-15T22:09:16.394355+0000","last_became_peered":"2024-09-15T22:09:16.394355+0000","last_unstale":"2024-09-15T22:34:48.131076+0000","last_undegraded":"2024-09-15T22:34:48.131076+0000","last_fullsized":"2024-09-15T22:34:48.131076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2258,"log_dups_size":0,"ondisk_log_size":2258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:53.845610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2267,"num_write_kb":17573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'3672","reported_seq":3700,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.650001+0000","last_change":"2024-09-15T22:09:21.454458+0000","last_active":"2024-09-15T22:34:47.650001+0000","last_peered":"2024-09-15T22:34:47.650001+0000","last_clean":"2024-09-15T22:34:47.650001+0000","last_became_active":"2024-09-15T22:09:21.453992+0000","last_became_peered":"2024-09-15T22:09:21.453992+0000","last_unstale":"2024-09-15T22:34:47.650001+0000","last_undegraded":"2024-09-15T22:34:47.650001+0000","last_fullsized":"2024-09-15T22:34:47.650001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3672,"log_dups_size":0,"ondisk_log_size":3672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:08.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2764,"num_write_kb":64906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'863","reported_seq":897,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.982113+0000","last_change":"2024-09-15T22:09:17.404161+0000","last_active":"2024-09-15T22:34:47.982113+0000","last_peered":"2024-09-15T22:34:47.982113+0000","last_clean":"2024-09-15T22:34:47.982113+0000","last_became_active":"2024-09-15T22:09:17.403899+0000","last_became_peered":"2024-09-15T22:09:17.403899+0000","last_unstale":"2024-09-15T22:34:47.982113+0000","last_undegraded":"2024-09-15T22:34:47.982113+0000","last_fullsized":"2024-09-15T22:34:47.982113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:22.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'3996","reported_seq":4032,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.135010+0000","last_change":"2024-09-15T22:09:16.403905+0000","last_active":"2024-09-15T22:34:48.135010+0000","last_peered":"2024-09-15T22:34:48.135010+0000","last_clean":"2024-09-15T22:34:48.135010+0000","last_became_active":"2024-09-15T22:09:16.403624+0000","last_became_peered":"2024-09-15T22:09:16.403624+0000","last_unstale":"2024-09-15T22:34:48.135010+0000","last_undegraded":"2024-09-15T22:34:48.135010+0000","last_fullsized":"2024-09-15T22:34:48.135010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3999,"num_write_kb":30696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'3842","reported_seq":3870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.173105+0000","last_change":"2024-09-15T22:09:21.452045+0000","last_active":"2024-09-15T22:34:48.173105+0000","last_peered":"2024-09-15T22:34:48.173105+0000","last_clean":"2024-09-15T22:34:48.173105+0000","last_became_active":"2024-09-15T22:09:21.451617+0000","last_became_peered":"2024-09-15T22:09:21.451617+0000","last_unstale":"2024-09-15T22:34:48.173105+0000","last_undegraded":"2024-09-15T22:34:48.173105+0000","last_fullsized":"2024-09-15T22:34:48.173105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3842,"log_dups_size":0,"ondisk_log_size":3842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:32.189930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2980,"num_write_kb":152763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'896","reported_seq":930,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.978282+0000","last_change":"2024-09-15T22:09:17.399198+0000","last_active":"2024-09-15T22:34:47.978282+0000","last_peered":"2024-09-15T22:34:47.978282+0000","last_clean":"2024-09-15T22:34:47.978282+0000","last_became_active":"2024-09-15T22:09:17.398881+0000","last_became_peered":"2024-09-15T22:09:17.398881+0000","last_unstale":"2024-09-15T22:34:47.978282+0000","last_undegraded":"2024-09-15T22:34:47.978282+0000","last_fullsized":"2024-09-15T22:34:47.978282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:44.868956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'4322","reported_seq":4358,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.140696+0000","last_change":"2024-09-15T22:09:16.408365+0000","last_active":"2024-09-15T22:34:48.140696+0000","last_peered":"2024-09-15T22:34:48.140696+0000","last_clean":"2024-09-15T22:34:48.140696+0000","last_became_active":"2024-09-15T22:09:16.408064+0000","last_became_peered":"2024-09-15T22:09:16.408064+0000","last_unstale":"2024-09-15T22:34:48.140696+0000","last_undegraded":"2024-09-15T22:34:48.140696+0000","last_fullsized":"2024-09-15T22:34:48.140696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4322,"log_dups_size":0,"ondisk_log_size":4322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:01.032313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4321,"num_write_kb":23285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'4245","reported_seq":4273,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.171146+0000","last_change":"2024-09-15T22:09:21.455334+0000","last_active":"2024-09-15T22:34:48.171146+0000","last_peered":"2024-09-15T22:34:48.171146+0000","last_clean":"2024-09-15T22:34:48.171146+0000","last_became_active":"2024-09-15T22:09:21.454907+0000","last_became_peered":"2024-09-15T22:09:21.454907+0000","last_unstale":"2024-09-15T22:34:48.171146+0000","last_undegraded":"2024-09-15T22:34:48.171146+0000","last_fullsized":"2024-09-15T22:34:48.171146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4245,"log_dups_size":0,"ondisk_log_size":4245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:26.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3329,"num_write_kb":357256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'888","reported_seq":922,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.000309+0000","last_change":"2024-09-15T22:09:17.415215+0000","last_active":"2024-09-15T22:34:48.000309+0000","last_peered":"2024-09-15T22:34:48.000309+0000","last_clean":"2024-09-15T22:34:48.000309+0000","last_became_active":"2024-09-15T22:09:17.414951+0000","last_became_peered":"2024-09-15T22:09:17.414951+0000","last_unstale":"2024-09-15T22:34:48.000309+0000","last_undegraded":"2024-09-15T22:34:48.000309+0000","last_fullsized":"2024-09-15T22:34:48.000309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3258","reported_seq":3294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.140312+0000","last_change":"2024-09-15T22:09:16.405521+0000","last_active":"2024-09-15T22:34:48.140312+0000","last_peered":"2024-09-15T22:34:48.140312+0000","last_clean":"2024-09-15T22:34:48.140312+0000","last_became_active":"2024-09-15T22:09:16.405230+0000","last_became_peered":"2024-09-15T22:09:16.405230+0000","last_unstale":"2024-09-15T22:34:48.140312+0000","last_undegraded":"2024-09-15T22:34:48.140312+0000","last_fullsized":"2024-09-15T22:34:48.140312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3258,"log_dups_size":0,"ondisk_log_size":3258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:03.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3257,"num_write_kb":26116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'3612","reported_seq":3640,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.653194+0000","last_change":"2024-09-15T22:09:21.450431+0000","last_active":"2024-09-15T22:34:47.653194+0000","last_peered":"2024-09-15T22:34:47.653194+0000","last_clean":"2024-09-15T22:34:47.653194+0000","last_became_active":"2024-09-15T22:09:21.449896+0000","last_became_peered":"2024-09-15T22:09:21.449896+0000","last_unstale":"2024-09-15T22:34:47.653194+0000","last_undegraded":"2024-09-15T22:34:47.653194+0000","last_fullsized":"2024-09-15T22:34:47.653194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3612,"log_dups_size":0,"ondisk_log_size":3612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:18.430595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2735,"num_write_kb":71213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'873","reported_seq":907,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.003609+0000","last_change":"2024-09-15T22:09:17.422669+0000","last_active":"2024-09-15T22:34:48.003609+0000","last_peered":"2024-09-15T22:34:48.003609+0000","last_clean":"2024-09-15T22:34:48.003609+0000","last_became_active":"2024-09-15T22:09:17.422401+0000","last_became_peered":"2024-09-15T22:09:17.422401+0000","last_unstale":"2024-09-15T22:34:48.003609+0000","last_undegraded":"2024-09-15T22:34:48.003609+0000","last_fullsized":"2024-09-15T22:34:48.003609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2844","reported_seq":3576,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.146617+0000","last_change":"2024-09-15T22:09:16.405552+0000","last_active":"2024-09-15T22:34:48.146617+0000","last_peered":"2024-09-15T22:34:48.146617+0000","last_clean":"2024-09-15T22:34:48.146617+0000","last_became_active":"2024-09-15T22:09:16.405208+0000","last_became_peered":"2024-09-15T22:09:16.405208+0000","last_unstale":"2024-09-15T22:34:48.146617+0000","last_undegraded":"2024-09-15T22:34:48.146617+0000","last_fullsized":"2024-09-15T22:34:48.146617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2844,"log_dups_size":0,"ondisk_log_size":2844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18685136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":696,"num_read_kb":2335,"num_write":2846,"num_write_kb":23873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'3807","reported_seq":3835,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.585560+0000","last_change":"2024-09-15T22:09:21.448849+0000","last_active":"2024-09-15T22:34:47.585560+0000","last_peered":"2024-09-15T22:34:47.585560+0000","last_clean":"2024-09-15T22:34:47.585560+0000","last_became_active":"2024-09-15T22:09:21.448356+0000","last_became_peered":"2024-09-15T22:09:21.448356+0000","last_unstale":"2024-09-15T22:34:47.585560+0000","last_undegraded":"2024-09-15T22:34:47.585560+0000","last_fullsized":"2024-09-15T22:34:47.585560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3807,"log_dups_size":0,"ondisk_log_size":3807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:08.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2897,"num_write_kb":187512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'3625","reported_seq":3655,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.161586+0000","last_change":"2024-09-15T22:09:21.458815+0000","last_active":"2024-09-15T22:34:48.161586+0000","last_peered":"2024-09-15T22:34:48.161586+0000","last_clean":"2024-09-15T22:34:48.161586+0000","last_became_active":"2024-09-15T22:09:21.458418+0000","last_became_peered":"2024-09-15T22:09:21.458418+0000","last_unstale":"2024-09-15T22:34:48.161586+0000","last_undegraded":"2024-09-15T22:34:48.161586+0000","last_fullsized":"2024-09-15T22:34:48.161586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:26.187414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2737,"num_write_kb":87535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'902","reported_seq":936,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.973143+0000","last_change":"2024-09-15T22:09:17.401001+0000","last_active":"2024-09-15T22:34:47.973143+0000","last_peered":"2024-09-15T22:34:47.973143+0000","last_clean":"2024-09-15T22:34:47.973143+0000","last_became_active":"2024-09-15T22:09:17.400754+0000","last_became_peered":"2024-09-15T22:09:17.400754+0000","last_unstale":"2024-09-15T22:34:47.973143+0000","last_undegraded":"2024-09-15T22:34:47.973143+0000","last_fullsized":"2024-09-15T22:34:47.973143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:33.878828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'4403","reported_seq":4439,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.130690+0000","last_change":"2024-09-15T22:09:16.404987+0000","last_active":"2024-09-15T22:34:48.130690+0000","last_peered":"2024-09-15T22:34:48.130690+0000","last_clean":"2024-09-15T22:34:48.130690+0000","last_became_active":"2024-09-15T22:09:16.404694+0000","last_became_peered":"2024-09-15T22:09:16.404694+0000","last_unstale":"2024-09-15T22:34:48.130690+0000","last_undegraded":"2024-09-15T22:34:48.130690+0000","last_fullsized":"2024-09-15T22:34:48.130690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4404,"num_write_kb":39122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'4168","reported_seq":4198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.608477+0000","last_change":"2024-09-15T22:09:21.457334+0000","last_active":"2024-09-15T22:34:47.608477+0000","last_peered":"2024-09-15T22:34:47.608477+0000","last_clean":"2024-09-15T22:34:47.608477+0000","last_became_active":"2024-09-15T22:09:21.456871+0000","last_became_peered":"2024-09-15T22:09:21.456871+0000","last_unstale":"2024-09-15T22:34:47.608477+0000","last_undegraded":"2024-09-15T22:34:47.608477+0000","last_fullsized":"2024-09-15T22:34:47.608477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4168,"log_dups_size":0,"ondisk_log_size":4168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:08.904123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3293,"num_write_kb":221802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'944","reported_seq":978,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.980106+0000","last_change":"2024-09-15T22:09:17.402872+0000","last_active":"2024-09-15T22:34:47.980106+0000","last_peered":"2024-09-15T22:34:47.980106+0000","last_clean":"2024-09-15T22:34:47.980106+0000","last_became_active":"2024-09-15T22:09:17.402625+0000","last_became_peered":"2024-09-15T22:09:17.402625+0000","last_unstale":"2024-09-15T22:34:47.980106+0000","last_undegraded":"2024-09-15T22:34:47.980106+0000","last_fullsized":"2024-09-15T22:34:47.980106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":944,"log_dups_size":0,"ondisk_log_size":944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'2057","reported_seq":2093,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.127636+0000","last_change":"2024-09-15T22:09:16.405821+0000","last_active":"2024-09-15T22:34:48.127636+0000","last_peered":"2024-09-15T22:34:48.127636+0000","last_clean":"2024-09-15T22:34:48.127636+0000","last_became_active":"2024-09-15T22:09:16.405561+0000","last_became_peered":"2024-09-15T22:09:16.405561+0000","last_unstale":"2024-09-15T22:34:48.127636+0000","last_undegraded":"2024-09-15T22:34:48.127636+0000","last_fullsized":"2024-09-15T22:34:48.127636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2057,"log_dups_size":0,"ondisk_log_size":2057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2062,"num_write_kb":17437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4667","reported_seq":4703,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.176514+0000","last_change":"2024-09-15T22:09:16.403455+0000","last_active":"2024-09-15T22:34:48.176514+0000","last_peered":"2024-09-15T22:34:48.176514+0000","last_clean":"2024-09-15T22:34:48.176514+0000","last_became_active":"2024-09-15T22:09:16.403172+0000","last_became_peered":"2024-09-15T22:09:16.403172+0000","last_unstale":"2024-09-15T22:34:48.176514+0000","last_undegraded":"2024-09-15T22:34:48.176514+0000","last_fullsized":"2024-09-15T22:34:48.176514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:03.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4675,"num_write_kb":35111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'885","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.985255+0000","last_change":"2024-09-15T22:09:17.416335+0000","last_active":"2024-09-15T22:34:47.985255+0000","last_peered":"2024-09-15T22:34:47.985255+0000","last_clean":"2024-09-15T22:34:47.985255+0000","last_became_active":"2024-09-15T22:09:17.416102+0000","last_became_peered":"2024-09-15T22:09:17.416102+0000","last_unstale":"2024-09-15T22:34:47.985255+0000","last_undegraded":"2024-09-15T22:34:47.985255+0000","last_fullsized":"2024-09-15T22:34:47.985255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3664","reported_seq":3692,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.677534+0000","last_change":"2024-09-15T22:09:21.448449+0000","last_active":"2024-09-15T22:34:47.677534+0000","last_peered":"2024-09-15T22:34:47.677534+0000","last_clean":"2024-09-15T22:34:47.677534+0000","last_became_active":"2024-09-15T22:09:21.448020+0000","last_became_peered":"2024-09-15T22:09:21.448020+0000","last_unstale":"2024-09-15T22:34:47.677534+0000","last_undegraded":"2024-09-15T22:34:47.677534+0000","last_fullsized":"2024-09-15T22:34:47.677534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3664,"log_dups_size":0,"ondisk_log_size":3664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:05.244676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2728,"num_write_kb":145400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1987","reported_seq":2023,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.135711+0000","last_change":"2024-09-15T22:09:16.401331+0000","last_active":"2024-09-15T22:34:48.135711+0000","last_peered":"2024-09-15T22:34:48.135711+0000","last_clean":"2024-09-15T22:34:48.135711+0000","last_became_active":"2024-09-15T22:09:16.401040+0000","last_became_peered":"2024-09-15T22:09:16.401040+0000","last_unstale":"2024-09-15T22:34:48.135711+0000","last_undegraded":"2024-09-15T22:34:48.135711+0000","last_fullsized":"2024-09-15T22:34:48.135711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.799831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1992,"num_write_kb":17367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'895","reported_seq":929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.971488+0000","last_change":"2024-09-15T22:09:17.405328+0000","last_active":"2024-09-15T22:34:47.971488+0000","last_peered":"2024-09-15T22:34:47.971488+0000","last_clean":"2024-09-15T22:34:47.971488+0000","last_became_active":"2024-09-15T22:09:17.404772+0000","last_became_peered":"2024-09-15T22:09:17.404772+0000","last_unstale":"2024-09-15T22:34:47.971488+0000","last_undegraded":"2024-09-15T22:34:47.971488+0000","last_fullsized":"2024-09-15T22:34:47.971488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:33.377260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3687","reported_seq":3715,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.161366+0000","last_change":"2024-09-15T22:09:21.458359+0000","last_active":"2024-09-15T22:34:48.161366+0000","last_peered":"2024-09-15T22:34:48.161366+0000","last_clean":"2024-09-15T22:34:48.161366+0000","last_became_active":"2024-09-15T22:09:21.457977+0000","last_became_peered":"2024-09-15T22:09:21.457977+0000","last_unstale":"2024-09-15T22:34:48.161366+0000","last_undegraded":"2024-09-15T22:34:48.161366+0000","last_fullsized":"2024-09-15T22:34:48.161366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3687,"log_dups_size":0,"ondisk_log_size":3687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.055754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2724,"num_write_kb":59138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'900","reported_seq":936,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.980406+0000","last_change":"2024-09-15T22:09:17.405556+0000","last_active":"2024-09-15T22:34:47.980406+0000","last_peered":"2024-09-15T22:34:47.980406+0000","last_clean":"2024-09-15T22:34:47.980406+0000","last_became_active":"2024-09-15T22:09:17.405129+0000","last_became_peered":"2024-09-15T22:09:17.405129+0000","last_unstale":"2024-09-15T22:34:47.980406+0000","last_undegraded":"2024-09-15T22:34:47.980406+0000","last_fullsized":"2024-09-15T22:34:47.980406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'940","reported_seq":976,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.994790+0000","last_change":"2024-09-15T22:09:17.408189+0000","last_active":"2024-09-15T22:34:47.994790+0000","last_peered":"2024-09-15T22:34:47.994790+0000","last_clean":"2024-09-15T22:34:47.994790+0000","last_became_active":"2024-09-15T22:09:17.407877+0000","last_became_peered":"2024-09-15T22:09:17.407877+0000","last_unstale":"2024-09-15T22:34:47.994790+0000","last_undegraded":"2024-09-15T22:34:47.994790+0000","last_fullsized":"2024-09-15T22:34:47.994790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":940,"log_dups_size":0,"ondisk_log_size":940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:02.290840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'881","reported_seq":922,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.995854+0000","last_change":"2024-09-15T22:09:59.534711+0000","last_active":"2024-09-15T22:34:47.995854+0000","last_peered":"2024-09-15T22:34:47.995854+0000","last_clean":"2024-09-15T22:34:47.995854+0000","last_became_active":"2024-09-15T22:09:59.534380+0000","last_became_peered":"2024-09-15T22:09:59.534380+0000","last_unstale":"2024-09-15T22:34:47.995854+0000","last_undegraded":"2024-09-15T22:34:47.995854+0000","last_fullsized":"2024-09-15T22:34:47.995854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:26.642804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'916","reported_seq":952,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.980268+0000","last_change":"2024-09-15T22:09:17.406140+0000","last_active":"2024-09-15T22:34:47.980268+0000","last_peered":"2024-09-15T22:34:47.980268+0000","last_clean":"2024-09-15T22:34:47.980268+0000","last_became_active":"2024-09-15T22:09:17.405142+0000","last_became_peered":"2024-09-15T22:09:17.405142+0000","last_unstale":"2024-09-15T22:34:47.980268+0000","last_undegraded":"2024-09-15T22:34:47.980268+0000","last_fullsized":"2024-09-15T22:34:47.980268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":916,"log_dups_size":0,"ondisk_log_size":916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:17.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'885","reported_seq":920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.974935+0000","last_change":"2024-09-15T22:09:17.411027+0000","last_active":"2024-09-15T22:34:47.974935+0000","last_peered":"2024-09-15T22:34:47.974935+0000","last_clean":"2024-09-15T22:34:47.974935+0000","last_became_active":"2024-09-15T22:09:17.408913+0000","last_became_peered":"2024-09-15T22:09:17.408913+0000","last_unstale":"2024-09-15T22:34:47.974935+0000","last_undegraded":"2024-09-15T22:34:47.974935+0000","last_fullsized":"2024-09-15T22:34:47.974935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:34.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'886","reported_seq":921,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.972194+0000","last_change":"2024-09-15T22:09:17.401385+0000","last_active":"2024-09-15T22:34:47.972194+0000","last_peered":"2024-09-15T22:34:47.972194+0000","last_clean":"2024-09-15T22:34:47.972194+0000","last_became_active":"2024-09-15T22:09:17.400916+0000","last_became_peered":"2024-09-15T22:09:17.400916+0000","last_unstale":"2024-09-15T22:34:47.972194+0000","last_undegraded":"2024-09-15T22:34:47.972194+0000","last_fullsized":"2024-09-15T22:34:47.972194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:31.994148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'934","reported_seq":969,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.003834+0000","last_change":"2024-09-15T22:09:17.405622+0000","last_active":"2024-09-15T22:34:48.003834+0000","last_peered":"2024-09-15T22:34:48.003834+0000","last_clean":"2024-09-15T22:34:48.003834+0000","last_became_active":"2024-09-15T22:09:17.405319+0000","last_became_peered":"2024-09-15T22:09:17.405319+0000","last_unstale":"2024-09-15T22:34:48.003834+0000","last_undegraded":"2024-09-15T22:34:48.003834+0000","last_fullsized":"2024-09-15T22:34:48.003834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'869","reported_seq":904,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.971623+0000","last_change":"2024-09-15T22:09:17.409317+0000","last_active":"2024-09-15T22:34:47.971623+0000","last_peered":"2024-09-15T22:34:47.971623+0000","last_clean":"2024-09-15T22:34:47.971623+0000","last_became_active":"2024-09-15T22:09:17.408949+0000","last_became_peered":"2024-09-15T22:09:17.408949+0000","last_unstale":"2024-09-15T22:34:47.971623+0000","last_undegraded":"2024-09-15T22:34:47.971623+0000","last_fullsized":"2024-09-15T22:34:47.971623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'872","reported_seq":907,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.145298+0000","last_change":"2024-09-15T22:09:17.416439+0000","last_active":"2024-09-15T22:34:48.145298+0000","last_peered":"2024-09-15T22:34:48.145298+0000","last_clean":"2024-09-15T22:34:48.145298+0000","last_became_active":"2024-09-15T22:09:17.416170+0000","last_became_peered":"2024-09-15T22:09:17.416170+0000","last_unstale":"2024-09-15T22:34:48.145298+0000","last_undegraded":"2024-09-15T22:34:48.145298+0000","last_fullsized":"2024-09-15T22:34:48.145298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'867","reported_seq":902,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.983659+0000","last_change":"2024-09-15T22:09:17.409471+0000","last_active":"2024-09-15T22:34:47.983659+0000","last_peered":"2024-09-15T22:34:47.983659+0000","last_clean":"2024-09-15T22:34:47.983659+0000","last_became_active":"2024-09-15T22:09:17.408969+0000","last_became_peered":"2024-09-15T22:09:17.408969+0000","last_unstale":"2024-09-15T22:34:47.983659+0000","last_undegraded":"2024-09-15T22:34:47.983659+0000","last_fullsized":"2024-09-15T22:34:47.983659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'894","reported_seq":929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.006416+0000","last_change":"2024-09-15T22:09:17.422118+0000","last_active":"2024-09-15T22:34:48.006416+0000","last_peered":"2024-09-15T22:34:48.006416+0000","last_clean":"2024-09-15T22:34:48.006416+0000","last_became_active":"2024-09-15T22:09:17.421846+0000","last_became_peered":"2024-09-15T22:09:17.421846+0000","last_unstale":"2024-09-15T22:34:48.006416+0000","last_undegraded":"2024-09-15T22:34:48.006416+0000","last_fullsized":"2024-09-15T22:34:48.006416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:34.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'909","reported_seq":944,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.997335+0000","last_change":"2024-09-15T22:09:17.421168+0000","last_active":"2024-09-15T22:34:47.997335+0000","last_peered":"2024-09-15T22:34:47.997335+0000","last_clean":"2024-09-15T22:34:47.997335+0000","last_became_active":"2024-09-15T22:09:17.420849+0000","last_became_peered":"2024-09-15T22:09:17.420849+0000","last_unstale":"2024-09-15T22:34:47.997335+0000","last_undegraded":"2024-09-15T22:34:47.997335+0000","last_fullsized":"2024-09-15T22:34:47.997335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:25.108343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'894","reported_seq":929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.001943+0000","last_change":"2024-09-15T22:09:17.410112+0000","last_active":"2024-09-15T22:34:48.001943+0000","last_peered":"2024-09-15T22:34:48.001943+0000","last_clean":"2024-09-15T22:34:48.001943+0000","last_became_active":"2024-09-15T22:09:17.409837+0000","last_became_peered":"2024-09-15T22:09:17.409837+0000","last_unstale":"2024-09-15T22:34:48.001943+0000","last_undegraded":"2024-09-15T22:34:48.001943+0000","last_fullsized":"2024-09-15T22:34:48.001943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'901","reported_seq":922,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.969763+0000","last_change":"2024-09-15T22:09:59.534976+0000","last_active":"2024-09-15T22:34:47.969763+0000","last_peered":"2024-09-15T22:34:47.969763+0000","last_clean":"2024-09-15T22:34:47.969763+0000","last_became_active":"2024-09-15T22:09:59.534485+0000","last_became_peered":"2024-09-15T22:09:59.534485+0000","last_unstale":"2024-09-15T22:34:47.969763+0000","last_undegraded":"2024-09-15T22:34:47.969763+0000","last_fullsized":"2024-09-15T22:34:47.969763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:42.051025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"27'851","reported_seq":885,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.971112+0000","last_change":"2024-09-15T22:09:17.401680+0000","last_active":"2024-09-15T22:34:47.971112+0000","last_peered":"2024-09-15T22:34:47.971112+0000","last_clean":"2024-09-15T22:34:47.971112+0000","last_became_active":"2024-09-15T22:09:17.401413+0000","last_became_peered":"2024-09-15T22:09:17.401413+0000","last_unstale":"2024-09-15T22:34:47.971112+0000","last_undegraded":"2024-09-15T22:34:47.971112+0000","last_fullsized":"2024-09-15T22:34:47.971112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:04.007901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'922","reported_seq":942,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.968907+0000","last_change":"2024-09-15T22:09:59.528330+0000","last_active":"2024-09-15T22:34:47.968907+0000","last_peered":"2024-09-15T22:34:47.968907+0000","last_clean":"2024-09-15T22:34:47.968907+0000","last_became_active":"2024-09-15T22:09:59.528000+0000","last_became_peered":"2024-09-15T22:09:59.528000+0000","last_unstale":"2024-09-15T22:34:47.968907+0000","last_undegraded":"2024-09-15T22:34:47.968907+0000","last_fullsized":"2024-09-15T22:34:47.968907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:15.431072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"27'882","reported_seq":916,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.993791+0000","last_change":"2024-09-15T22:09:17.411524+0000","last_active":"2024-09-15T22:34:47.993791+0000","last_peered":"2024-09-15T22:34:47.993791+0000","last_clean":"2024-09-15T22:34:47.993791+0000","last_became_active":"2024-09-15T22:09:17.411244+0000","last_became_peered":"2024-09-15T22:09:17.411244+0000","last_unstale":"2024-09-15T22:34:47.993791+0000","last_undegraded":"2024-09-15T22:34:47.993791+0000","last_fullsized":"2024-09-15T22:34:47.993791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'910","reported_seq":944,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.983245+0000","last_change":"2024-09-15T22:09:17.409933+0000","last_active":"2024-09-15T22:34:47.983245+0000","last_peered":"2024-09-15T22:34:47.983245+0000","last_clean":"2024-09-15T22:34:47.983245+0000","last_became_active":"2024-09-15T22:09:17.409681+0000","last_became_peered":"2024-09-15T22:09:17.409681+0000","last_unstale":"2024-09-15T22:34:47.983245+0000","last_undegraded":"2024-09-15T22:34:47.983245+0000","last_fullsized":"2024-09-15T22:34:47.983245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:37.130999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'858","reported_seq":892,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.974080+0000","last_change":"2024-09-15T22:09:17.403522+0000","last_active":"2024-09-15T22:34:47.974080+0000","last_peered":"2024-09-15T22:34:47.974080+0000","last_clean":"2024-09-15T22:34:47.974080+0000","last_became_active":"2024-09-15T22:09:17.403220+0000","last_became_peered":"2024-09-15T22:09:17.403220+0000","last_unstale":"2024-09-15T22:34:47.974080+0000","last_undegraded":"2024-09-15T22:34:47.974080+0000","last_fullsized":"2024-09-15T22:34:47.974080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:01.208798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'870","reported_seq":904,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.980323+0000","last_change":"2024-09-15T22:09:17.400537+0000","last_active":"2024-09-15T22:34:47.980323+0000","last_peered":"2024-09-15T22:34:47.980323+0000","last_clean":"2024-09-15T22:34:47.980323+0000","last_became_active":"2024-09-15T22:09:17.400288+0000","last_became_peered":"2024-09-15T22:09:17.400288+0000","last_unstale":"2024-09-15T22:34:47.980323+0000","last_undegraded":"2024-09-15T22:34:47.980323+0000","last_fullsized":"2024-09-15T22:34:47.980323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'857","reported_seq":891,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.984489+0000","last_change":"2024-09-15T22:09:17.404318+0000","last_active":"2024-09-15T22:34:47.984489+0000","last_peered":"2024-09-15T22:34:47.984489+0000","last_clean":"2024-09-15T22:34:47.984489+0000","last_became_active":"2024-09-15T22:09:17.404038+0000","last_became_peered":"2024-09-15T22:09:17.404038+0000","last_unstale":"2024-09-15T22:34:47.984489+0000","last_undegraded":"2024-09-15T22:34:47.984489+0000","last_fullsized":"2024-09-15T22:34:47.984489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:04.314746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'885","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.005482+0000","last_change":"2024-09-15T22:09:17.415645+0000","last_active":"2024-09-15T22:34:48.005482+0000","last_peered":"2024-09-15T22:34:48.005482+0000","last_clean":"2024-09-15T22:34:48.005482+0000","last_became_active":"2024-09-15T22:09:17.415354+0000","last_became_peered":"2024-09-15T22:09:17.415354+0000","last_unstale":"2024-09-15T22:34:48.005482+0000","last_undegraded":"2024-09-15T22:34:48.005482+0000","last_fullsized":"2024-09-15T22:34:48.005482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'874","reported_seq":908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.004288+0000","last_change":"2024-09-15T22:09:17.415171+0000","last_active":"2024-09-15T22:34:48.004288+0000","last_peered":"2024-09-15T22:34:48.004288+0000","last_clean":"2024-09-15T22:34:48.004288+0000","last_became_active":"2024-09-15T22:09:17.414875+0000","last_became_peered":"2024-09-15T22:09:17.414875+0000","last_unstale":"2024-09-15T22:34:48.004288+0000","last_undegraded":"2024-09-15T22:34:48.004288+0000","last_fullsized":"2024-09-15T22:34:48.004288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'913","reported_seq":947,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.006168+0000","last_change":"2024-09-15T22:09:17.420121+0000","last_active":"2024-09-15T22:34:48.006168+0000","last_peered":"2024-09-15T22:34:48.006168+0000","last_clean":"2024-09-15T22:34:48.006168+0000","last_became_active":"2024-09-15T22:09:17.419854+0000","last_became_peered":"2024-09-15T22:09:17.419854+0000","last_unstale":"2024-09-15T22:34:48.006168+0000","last_undegraded":"2024-09-15T22:34:48.006168+0000","last_fullsized":"2024-09-15T22:34:48.006168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":913,"log_dups_size":0,"ondisk_log_size":913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:41.421190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'862","reported_seq":896,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.992262+0000","last_change":"2024-09-15T22:09:17.414316+0000","last_active":"2024-09-15T22:34:47.992262+0000","last_peered":"2024-09-15T22:34:47.992262+0000","last_clean":"2024-09-15T22:34:47.992262+0000","last_became_active":"2024-09-15T22:09:17.414020+0000","last_became_peered":"2024-09-15T22:09:17.414020+0000","last_unstale":"2024-09-15T22:34:47.992262+0000","last_undegraded":"2024-09-15T22:34:47.992262+0000","last_fullsized":"2024-09-15T22:34:47.992262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'898","reported_seq":932,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.979726+0000","last_change":"2024-09-15T22:09:17.404509+0000","last_active":"2024-09-15T22:34:47.979726+0000","last_peered":"2024-09-15T22:34:47.979726+0000","last_clean":"2024-09-15T22:34:47.979726+0000","last_became_active":"2024-09-15T22:09:17.404181+0000","last_became_peered":"2024-09-15T22:09:17.404181+0000","last_unstale":"2024-09-15T22:34:47.979726+0000","last_undegraded":"2024-09-15T22:34:47.979726+0000","last_fullsized":"2024-09-15T22:34:47.979726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:22.003479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'835","reported_seq":869,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.004866+0000","last_change":"2024-09-15T22:09:17.414252+0000","last_active":"2024-09-15T22:34:48.004866+0000","last_peered":"2024-09-15T22:34:48.004866+0000","last_clean":"2024-09-15T22:34:48.004866+0000","last_became_active":"2024-09-15T22:09:17.413987+0000","last_became_peered":"2024-09-15T22:09:17.413987+0000","last_unstale":"2024-09-15T22:34:48.004866+0000","last_undegraded":"2024-09-15T22:34:48.004866+0000","last_fullsized":"2024-09-15T22:34:48.004866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'918","reported_seq":952,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.002775+0000","last_change":"2024-09-15T22:09:17.399744+0000","last_active":"2024-09-15T22:34:48.002775+0000","last_peered":"2024-09-15T22:34:48.002775+0000","last_clean":"2024-09-15T22:34:48.002775+0000","last_became_active":"2024-09-15T22:09:17.399470+0000","last_became_peered":"2024-09-15T22:09:17.399470+0000","last_unstale":"2024-09-15T22:34:48.002775+0000","last_undegraded":"2024-09-15T22:34:48.002775+0000","last_fullsized":"2024-09-15T22:34:48.002775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:04.868244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'877","reported_seq":899,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.973047+0000","last_change":"2024-09-15T22:09:59.804042+0000","last_active":"2024-09-15T22:34:47.973047+0000","last_peered":"2024-09-15T22:34:47.973047+0000","last_clean":"2024-09-15T22:34:47.973047+0000","last_became_active":"2024-09-15T22:09:59.803657+0000","last_became_peered":"2024-09-15T22:09:59.803657+0000","last_unstale":"2024-09-15T22:34:47.973047+0000","last_undegraded":"2024-09-15T22:34:47.973047+0000","last_fullsized":"2024-09-15T22:34:47.973047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'928","reported_seq":964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.967618+0000","last_change":"2024-09-15T22:09:17.404558+0000","last_active":"2024-09-15T22:34:47.967618+0000","last_peered":"2024-09-15T22:34:47.967618+0000","last_clean":"2024-09-15T22:34:47.967618+0000","last_became_active":"2024-09-15T22:09:17.404301+0000","last_became_peered":"2024-09-15T22:09:17.404301+0000","last_unstale":"2024-09-15T22:34:47.967618+0000","last_undegraded":"2024-09-15T22:34:47.967618+0000","last_fullsized":"2024-09-15T22:34:47.967618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'838","reported_seq":874,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.968650+0000","last_change":"2024-09-15T22:09:17.402881+0000","last_active":"2024-09-15T22:34:47.968650+0000","last_peered":"2024-09-15T22:34:47.968650+0000","last_clean":"2024-09-15T22:34:47.968650+0000","last_became_active":"2024-09-15T22:09:17.402632+0000","last_became_peered":"2024-09-15T22:09:17.402632+0000","last_unstale":"2024-09-15T22:34:47.968650+0000","last_undegraded":"2024-09-15T22:34:47.968650+0000","last_fullsized":"2024-09-15T22:34:47.968650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:30.142651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'834","reported_seq":870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.002340+0000","last_change":"2024-09-15T22:09:17.403017+0000","last_active":"2024-09-15T22:34:48.002340+0000","last_peered":"2024-09-15T22:34:48.002340+0000","last_clean":"2024-09-15T22:34:48.002340+0000","last_became_active":"2024-09-15T22:09:17.402751+0000","last_became_peered":"2024-09-15T22:09:17.402751+0000","last_unstale":"2024-09-15T22:34:48.002340+0000","last_undegraded":"2024-09-15T22:34:48.002340+0000","last_fullsized":"2024-09-15T22:34:48.002340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:26.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93952,"num_write_kb":3592319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123090,"ondisk_log_size":123090,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56939,"ondisk_log_size":56939,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":248781965,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2930,"num_read_kb":7996,"num_write":96422,"num_write_kb":735145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327397376,"data_stored":497646532,"data_compressed":51440825,"data_compressed_allocated":79159296,"data_compressed_original":249466880,"omap_allocated":0,"internal_metadata":0},"log_size":93516,"ondisk_log_size":93516,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542455,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":548100,"kb_used_data":43636,"kb_used_omap":1,"kb_used_meta":504446,"kb_avail":93823740,"statfs":{"total":96636764160,"available":96075509760,"internally_reserved":0,"allocated":44683264,"data_stored":67817371,"data_compressed":6954037,"data_compressed_allocated":10792960,"data_compressed_original":34103296,"omap_allocated":1590,"internal_metadata":516553162},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542455,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":562988,"kb_used_data":44636,"kb_used_omap":1,"kb_used_meta":518334,"kb_avail":93808852,"statfs":{"total":96636764160,"available":96060264448,"internally_reserved":0,"allocated":45707264,"data_stored":69135013,"data_compressed":7128351,"data_compressed_allocated":10952704,"data_compressed_original":34557952,"omap_allocated":1594,"internal_metadata":530774470},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542456,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":592620,"kb_used_data":61852,"kb_used_omap":1,"kb_used_meta":530750,"kb_avail":93779220,"statfs":{"total":96636764160,"available":96029921280,"internally_reserved":0,"allocated":63336448,"data_stored":97903198,"data_compressed":10447326,"data_compressed_allocated":15986688,"data_compressed_original":50728960,"omap_allocated":1594,"internal_metadata":543488454},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542457,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":450656,"kb_used_data":26640,"kb_used_omap":1,"kb_used_meta":423998,"kb_avail":93921184,"statfs":{"total":96636764160,"available":96175292416,"internally_reserved":0,"allocated":27279360,"data_stored":42060723,"data_compressed":4480082,"data_compressed_allocated":6909952,"data_compressed_original":21872640,"omap_allocated":1595,"internal_metadata":434174405},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542457,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":571996,"kb_used_data":41100,"kb_used_omap":1,"kb_used_meta":530878,"kb_avail":93799844,"statfs":{"total":96636764160,"available":96051040256,"internally_reserved":0,"allocated":42086400,"data_stored":63032789,"data_compressed":6347263,"data_compressed_allocated":9764864,"data_compressed_original":30887936,"omap_allocated":1593,"internal_metadata":543619527},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":336252,"kb_used_data":30188,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94035588,"statfs":{"total":96636764160,"available":96292442112,"internally_reserved":0,"allocated":30912512,"data_stored":46254901,"data_compressed":4726192,"data_compressed_allocated":7282688,"data_compressed_original":22794240,"omap_allocated":1592,"internal_metadata":313391560},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542456,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":399260,"kb_used_data":25228,"kb_used_omap":1,"kb_used_meta":374014,"kb_avail":93972580,"statfs":{"total":96636764160,"available":96227921920,"internally_reserved":0,"allocated":25833472,"data_stored":38457299,"data_compressed":3734837,"data_compressed_allocated":5775360,"data_compressed_original":18583552,"omap_allocated":1595,"internal_metadata":382990789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575161,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":657404,"kb_used_data":48812,"kb_used_omap":1,"kb_used_meta":608574,"kb_avail":93714436,"statfs":{"total":96636764160,"available":95963582464,"internally_reserved":0,"allocated":49983488,"data_stored":75106430,"data_compressed":7687781,"data_compressed_allocated":11784192,"data_compressed_original":37085184,"omap_allocated":1594,"internal_metadata":623180230},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25481216,"data_stored":37749374,"data_compressed":3702315,"data_compressed_allocated":5730304,"data_compressed_original":18010112,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49696768,"data_stored":74988873,"data_compressed":7687781,"data_compressed_allocated":11784192,"data_compressed_original":37085184,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30625792,"data_stored":46137344,"data_compressed":4726192,"data_compressed_allocated":7282688,"data_compressed_original":22794240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":41799680,"data_stored":62915232,"data_compressed":6347263,"data_compressed_allocated":9764864,"data_compressed_original":30887936,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26992640,"data_stored":41943166,"data_compressed":4480082,"data_compressed_allocated":6909952,"data_compressed_original":21872640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":63049728,"data_stored":97785641,"data_compressed":10447326,"data_compressed_allocated":15986688,"data_compressed_original":50728960,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45420544,"data_stored":69017456,"data_compressed":7128351,"data_compressed_allocated":10952704,"data_compressed_original":34557952,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":44331008,"data_stored":67109446,"data_compressed":6921515,"data_compressed_allocated":10747904,"data_compressed_original":33529856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:34:54.638 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:34:54.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.771+0000 7f8d74c96640 1 Processor -- start 2024-09-15T22:34:54.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.771+0000 7f8d74c96640 1 -- start start 2024-09-15T22:34:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.772+0000 7f8d74c96640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8d7009d1c0 0x7f8d70148200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.772+0000 7f8d74c96640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d7009c290 0x7f8d7013e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.772+0000 7f8d74c96640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d70148740 con 0x7f8d700b41c0 2024-09-15T22:34:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.772+0000 7f8d74c96640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f8d7009e220 con 0x7f8d7009d1c0 2024-09-15T22:34:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.772+0000 7f8d74c96640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8d70148c90 con 0x7f8d7009c290 2024-09-15T22:34:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.772+0000 7f8d6e59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8d7009d1c0 0x7f8d70148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.772+0000 7f8d6ed9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8d700b41c0 0x7f8d701447d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60576/0 (socket says 172.21.15.78:60576) 2024-09-15T22:34:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.772+0000 7f8d6ed9d640 1 -- 172.21.15.78:0/3230678595 learned_addr learned my addr 172.21.15.78:0/3230678595 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:34:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.772+0000 7f8d65d9b640 1 --2- 172.21.15.78:0/3230678595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d7009c290 0x7f8d7013e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.772+0000 7f8d6e59c640 1 -- 172.21.15.78:0/3230678595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d7009c290 msgr2=0x7f8d7013e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.772+0000 7f8d6e59c640 1 --2- 172.21.15.78:0/3230678595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d7009c290 0x7f8d7013e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.772+0000 7f8d6e59c640 1 -- 172.21.15.78:0/3230678595 >> v1:172.21.15.78:6789/0 conn(0x7f8d700b41c0 legacy=0x7f8d701447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.772+0000 7f8d6e59c640 1 -- 172.21.15.78:0/3230678595 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7009d5a0 con 0x7f8d7009d1c0 2024-09-15T22:34:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.772+0000 7f8d6dd9b640 1 -- 172.21.15.78:0/3230678595 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1116163111 0 0) 0x7f8d70148740 con 0x7f8d700b41c0 2024-09-15T22:34:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.773+0000 7f8d6e59c640 1 --2- 172.21.15.78:0/3230678595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7009d1c0 0x7f8d70148200 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8d600097a0 tx=0x7f8d6002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e23c1ea82927472 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.773+0000 7f8d6dd9b640 1 -- 172.21.15.78:0/3230678595 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60037070 con 0x7f8d7009d1c0 2024-09-15T22:34:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.773+0000 7f8d6dd9b640 1 -- 172.21.15.78:0/3230678595 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6002adb0 con 0x7f8d7009d1c0 2024-09-15T22:34:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.773+0000 7f8d6dd9b640 1 -- 172.21.15.78:0/3230678595 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60032660 con 0x7f8d7009d1c0 2024-09-15T22:34:54.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.774+0000 7f8d74c96640 1 -- 172.21.15.78:0/3230678595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7009d1c0 msgr2=0x7f8d70148200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:54.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.774+0000 7f8d74c96640 1 --2- 172.21.15.78:0/3230678595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7009d1c0 0x7f8d70148200 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8d600097a0 tx=0x7f8d6002a060 comp rx=0 tx=0).stop 2024-09-15T22:34:54.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.774+0000 7f8d74c96640 1 -- 172.21.15.78:0/3230678595 shutdown_connections 2024-09-15T22:34:54.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.774+0000 7f8d74c96640 1 --2- 172.21.15.78:0/3230678595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d7009c290 0x7f8d7013e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.774+0000 7f8d74c96640 1 --2- 172.21.15.78:0/3230678595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7009d1c0 0x7f8d70148200 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.774+0000 7f8d74c96640 1 -- 172.21.15.78:0/3230678595 >> 172.21.15.78:0/3230678595 conn(0x7f8d7006c270 msgr2=0x7f8d7006c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:54.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.774+0000 7f8d74c96640 1 -- 172.21.15.78:0/3230678595 shutdown_connections 2024-09-15T22:34:54.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.774+0000 7f8d74c96640 1 -- 172.21.15.78:0/3230678595 wait complete. 2024-09-15T22:34:54.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.775+0000 7f8d74c96640 1 Processor -- start 2024-09-15T22:34:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.775+0000 7f8d74c96640 1 -- start start 2024-09-15T22:34:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d74c96640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d7009c290 0x7f8d70147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d74c96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7009d1c0 0x7f8d700b8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d74c96640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d700b41c0 0x7f8d700b9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d74c96640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7013ed70 con 0x7f8d7009d1c0 2024-09-15T22:34:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d74c96640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8d700b3ca0 con 0x7f8d700b41c0 2024-09-15T22:34:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d74c96640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7013eef0 con 0x7f8d7009c290 2024-09-15T22:34:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d65d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7009d1c0 0x7f8d700b8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d65d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7009d1c0 0x7f8d700b8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54358/0 (socket says 172.21.15.78:54358) 2024-09-15T22:34:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d65d9b640 1 -- 172.21.15.78:0/3470995864 learned_addr learned my addr 172.21.15.78:0/3470995864 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d6ed9d640 1 --2- 172.21.15.78:0/3470995864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d700b41c0 0x7f8d700b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d6e59c640 1 --2- 172.21.15.78:0/3470995864 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d7009c290 0x7f8d70147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d65d9b640 1 -- 172.21.15.78:0/3470995864 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d7009c290 msgr2=0x7f8d70147930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:54.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d65d9b640 1 --2- 172.21.15.78:0/3470995864 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d7009c290 0x7f8d70147930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d65d9b640 1 -- 172.21.15.78:0/3470995864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d700b41c0 msgr2=0x7f8d700b9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:54.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d65d9b640 1 --2- 172.21.15.78:0/3470995864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d700b41c0 0x7f8d700b9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d65d9b640 1 -- 172.21.15.78:0/3470995864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d700b87a0 con 0x7f8d7009d1c0 2024-09-15T22:34:54.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d65d9b640 1 --2- 172.21.15.78:0/3470995864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7009d1c0 0x7f8d700b8f10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009fd0 tx=0x7f8d5800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:54.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d677fe640 1 -- 172.21.15.78:0/3470995864 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58017070 con 0x7f8d7009d1c0 2024-09-15T22:34:54.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d677fe640 1 -- 172.21.15.78:0/3470995864 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d5800c940 con 0x7f8d7009d1c0 2024-09-15T22:34:54.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d74c96640 1 -- 172.21.15.78:0/3470995864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d700b8a80 con 0x7f8d7009d1c0 2024-09-15T22:34:54.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.776+0000 7f8d677fe640 1 -- 172.21.15.78:0/3470995864 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5800cd10 con 0x7f8d7009d1c0 2024-09-15T22:34:54.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.777+0000 7f8d74c96640 1 -- 172.21.15.78:0/3470995864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d700b75a0 con 0x7f8d7009d1c0 2024-09-15T22:34:54.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.777+0000 7f8d74c96640 1 -- 172.21.15.78:0/3470995864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7013e830 con 0x7f8d7009d1c0 2024-09-15T22:34:54.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.778+0000 7f8d677fe640 1 -- 172.21.15.78:0/3470995864 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8d5801a070 con 0x7f8d7009d1c0 2024-09-15T22:34:54.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.778+0000 7f8d677fe640 1 --2- 172.21.15.78:0/3470995864 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8d5006c2e0 0x7f8d5006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:54.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.778+0000 7f8d677fe640 1 -- 172.21.15.78:0/3470995864 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7f8d5808ba90 con 0x7f8d7009d1c0 2024-09-15T22:34:54.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.778+0000 7f8d6e59c640 1 --2- 172.21.15.78:0/3470995864 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8d5006c2e0 0x7f8d5006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:54.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.779+0000 7f8d6e59c640 1 --2- 172.21.15.78:0/3470995864 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8d5006c2e0 0x7f8d5006e7a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8d60034000 tx=0x7f8d6002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:54.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.783+0000 7f8d677fe640 1 -- 172.21.15.78:0/3470995864 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d580597e0 con 0x7f8d7009d1c0 2024-09-15T22:34:54.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.946+0000 7f8d74c96640 1 -- 172.21.15.78:0/3470995864 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d70075c60 con 0x7f8d5006c2e0 2024-09-15T22:34:54.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.955+0000 7f8d677fe640 1 -- 172.21.15.78:0/3470995864 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335299 (secure 0 0 0) 0x7f8d70075c60 con 0x7f8d5006c2e0 2024-09-15T22:34:54.959 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:34:54.961 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-15T22:34:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.958+0000 7f8d74c96640 1 -- 172.21.15.78:0/3470995864 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8d5006c2e0 msgr2=0x7f8d5006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.958+0000 7f8d74c96640 1 --2- 172.21.15.78:0/3470995864 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8d5006c2e0 0x7f8d5006e7a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8d60034000 tx=0x7f8d6002e000 comp rx=0 tx=0).stop 2024-09-15T22:34:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.958+0000 7f8d74c96640 1 -- 172.21.15.78:0/3470995864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7009d1c0 msgr2=0x7f8d700b8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.958+0000 7f8d74c96640 1 --2- 172.21.15.78:0/3470995864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7009d1c0 0x7f8d700b8f10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009fd0 tx=0x7f8d5800ed40 comp rx=0 tx=0).stop 2024-09-15T22:34:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.958+0000 7f8d74c96640 1 -- 172.21.15.78:0/3470995864 shutdown_connections 2024-09-15T22:34:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.958+0000 7f8d74c96640 1 --2- 172.21.15.78:0/3470995864 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8d5006c2e0 0x7f8d5006e7a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.958+0000 7f8d74c96640 1 --2- 172.21.15.78:0/3470995864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d700b41c0 0x7f8d700b9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.958+0000 7f8d74c96640 1 --2- 172.21.15.78:0/3470995864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d7009d1c0 0x7f8d700b8f10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.958+0000 7f8d74c96640 1 --2- 172.21.15.78:0/3470995864 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d7009c290 0x7f8d70147930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:54.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.958+0000 7f8d74c96640 1 -- 172.21.15.78:0/3470995864 >> 172.21.15.78:0/3470995864 conn(0x7f8d7006c270 msgr2=0x7f8d7013cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:54.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.958+0000 7f8d74c96640 1 -- 172.21.15.78:0/3470995864 shutdown_connections 2024-09-15T22:34:54.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:54.958+0000 7f8d74c96640 1 -- 172.21.15.78:0/3470995864 wait complete. 2024-09-15T22:34:54.970 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":795,"stamp":"2024-09-15T22:34:54.300666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":249372333,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":3046,"num_read_kb":8096,"num_write":191653,"num_write_kb":4329880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273662,"ondisk_log_size":273662,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4119276,"kb_used_data":322092,"kb_used_omap":12,"kb_used_meta":3797043,"kb_avail":750855444,"statfs":{"total":773094113280,"available":768875974656,"internally_reserved":0,"allocated":329822208,"data_stored":499767724,"data_compressed":51505869,"data_compressed_allocated":79249408,"data_compressed_original":250613760,"omap_allocated":12747,"internal_metadata":3888172597},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-209229419,"num_objects":-1368,"num_object_clones":0,"num_object_copies":-4128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1368,"num_whiteouts":0,"num_read":19,"num_read_kb":113,"num_write":2168,"num_write_kb":18787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-113,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003093"},"pg_stats":[{"pgid":"2.1f","version":"27'1783","reported_seq":1821,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.144511+0000","last_change":"2024-09-15T22:09:16.403008+0000","last_active":"2024-09-15T22:34:48.144511+0000","last_peered":"2024-09-15T22:34:48.144511+0000","last_clean":"2024-09-15T22:34:48.144511+0000","last_became_active":"2024-09-15T22:09:16.402725+0000","last_became_peered":"2024-09-15T22:09:16.402725+0000","last_unstale":"2024-09-15T22:34:48.144511+0000","last_undegraded":"2024-09-15T22:34:48.144511+0000","last_fullsized":"2024-09-15T22:34:48.144511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:32.659951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1792,"num_write_kb":13194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'869","reported_seq":905,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.157563+0000","last_change":"2024-09-15T22:09:17.400698+0000","last_active":"2024-09-15T22:34:48.157563+0000","last_peered":"2024-09-15T22:34:48.157563+0000","last_clean":"2024-09-15T22:34:48.157563+0000","last_became_active":"2024-09-15T22:09:17.400428+0000","last_became_peered":"2024-09-15T22:09:17.400428+0000","last_unstale":"2024-09-15T22:34:48.157563+0000","last_undegraded":"2024-09-15T22:34:48.157563+0000","last_fullsized":"2024-09-15T22:34:48.157563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:15.431072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4221","reported_seq":4249,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.657041+0000","last_change":"2024-09-15T22:09:21.449737+0000","last_active":"2024-09-15T22:34:47.657041+0000","last_peered":"2024-09-15T22:34:47.657041+0000","last_clean":"2024-09-15T22:34:47.657041+0000","last_became_active":"2024-09-15T22:09:21.449376+0000","last_became_peered":"2024-09-15T22:09:21.449376+0000","last_unstale":"2024-09-15T22:34:47.657041+0000","last_undegraded":"2024-09-15T22:34:47.657041+0000","last_fullsized":"2024-09-15T22:34:47.657041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4221,"log_dups_size":0,"ondisk_log_size":4221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:13.943283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3323,"num_write_kb":95202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3536","reported_seq":3574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.121078+0000","last_change":"2024-09-15T22:09:16.407728+0000","last_active":"2024-09-15T22:34:48.121078+0000","last_peered":"2024-09-15T22:34:48.121078+0000","last_clean":"2024-09-15T22:34:48.121078+0000","last_became_active":"2024-09-15T22:09:16.407458+0000","last_became_peered":"2024-09-15T22:09:16.407458+0000","last_unstale":"2024-09-15T22:34:48.121078+0000","last_undegraded":"2024-09-15T22:34:48.121078+0000","last_fullsized":"2024-09-15T22:34:48.121078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3536,"log_dups_size":0,"ondisk_log_size":3536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":30404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'865","reported_seq":901,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.000407+0000","last_change":"2024-09-15T22:09:17.415311+0000","last_active":"2024-09-15T22:34:48.000407+0000","last_peered":"2024-09-15T22:34:48.000407+0000","last_clean":"2024-09-15T22:34:48.000407+0000","last_became_active":"2024-09-15T22:09:17.414966+0000","last_became_peered":"2024-09-15T22:09:17.414966+0000","last_unstale":"2024-09-15T22:34:48.000407+0000","last_undegraded":"2024-09-15T22:34:48.000407+0000","last_fullsized":"2024-09-15T22:34:48.000407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":865,"log_dups_size":0,"ondisk_log_size":865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'3714","reported_seq":3742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.633395+0000","last_change":"2024-09-15T22:09:21.454087+0000","last_active":"2024-09-15T22:34:47.633395+0000","last_peered":"2024-09-15T22:34:47.633395+0000","last_clean":"2024-09-15T22:34:47.633395+0000","last_became_active":"2024-09-15T22:09:21.453701+0000","last_became_peered":"2024-09-15T22:09:21.453701+0000","last_unstale":"2024-09-15T22:34:47.633395+0000","last_undegraded":"2024-09-15T22:34:47.633395+0000","last_fullsized":"2024-09-15T22:34:47.633395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3714,"log_dups_size":0,"ondisk_log_size":3714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:29.697947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2789,"num_write_kb":63634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'4509","reported_seq":4545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.133997+0000","last_change":"2024-09-15T22:09:16.405902+0000","last_active":"2024-09-15T22:34:48.133997+0000","last_peered":"2024-09-15T22:34:48.133997+0000","last_clean":"2024-09-15T22:34:48.133997+0000","last_became_active":"2024-09-15T22:09:16.405626+0000","last_became_peered":"2024-09-15T22:09:16.405626+0000","last_unstale":"2024-09-15T22:34:48.133997+0000","last_undegraded":"2024-09-15T22:34:48.133997+0000","last_fullsized":"2024-09-15T22:34:48.133997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4509,"log_dups_size":0,"ondisk_log_size":4509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:03.001838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4510,"num_write_kb":35033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'918","reported_seq":957,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.992605+0000","last_change":"2024-09-15T22:09:59.805432+0000","last_active":"2024-09-15T22:34:47.992605+0000","last_peered":"2024-09-15T22:34:47.992605+0000","last_clean":"2024-09-15T22:34:47.992605+0000","last_became_active":"2024-09-15T22:09:59.804970+0000","last_became_peered":"2024-09-15T22:09:59.804970+0000","last_unstale":"2024-09-15T22:34:47.992605+0000","last_undegraded":"2024-09-15T22:34:47.992605+0000","last_fullsized":"2024-09-15T22:34:47.992605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:41.901744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3619","reported_seq":3647,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.710065+0000","last_change":"2024-09-15T22:09:21.455260+0000","last_active":"2024-09-15T22:34:47.710065+0000","last_peered":"2024-09-15T22:34:47.710065+0000","last_clean":"2024-09-15T22:34:47.710065+0000","last_became_active":"2024-09-15T22:09:21.454850+0000","last_became_peered":"2024-09-15T22:09:21.454850+0000","last_unstale":"2024-09-15T22:34:47.710065+0000","last_undegraded":"2024-09-15T22:34:47.710065+0000","last_fullsized":"2024-09-15T22:34:47.710065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3619,"log_dups_size":0,"ondisk_log_size":3619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:08.904123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2687,"num_write_kb":123513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'2007","reported_seq":2043,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:35.617698+0000","last_change":"2024-09-15T22:09:16.407670+0000","last_active":"2024-09-15T22:34:35.617698+0000","last_peered":"2024-09-15T22:34:35.617698+0000","last_clean":"2024-09-15T22:34:35.617698+0000","last_became_active":"2024-09-15T22:09:16.407364+0000","last_became_peered":"2024-09-15T22:09:16.407364+0000","last_unstale":"2024-09-15T22:34:35.617698+0000","last_undegraded":"2024-09-15T22:34:35.617698+0000","last_fullsized":"2024-09-15T22:34:35.617698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2007,"log_dups_size":0,"ondisk_log_size":2007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:01.284777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2007,"num_write_kb":17393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'890","reported_seq":924,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.007199+0000","last_change":"2024-09-15T22:09:17.408224+0000","last_active":"2024-09-15T22:34:48.007199+0000","last_peered":"2024-09-15T22:34:48.007199+0000","last_clean":"2024-09-15T22:34:48.007199+0000","last_became_active":"2024-09-15T22:09:17.407881+0000","last_became_peered":"2024-09-15T22:09:17.407881+0000","last_unstale":"2024-09-15T22:34:48.007199+0000","last_undegraded":"2024-09-15T22:34:48.007199+0000","last_fullsized":"2024-09-15T22:34:48.007199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":890,"log_dups_size":0,"ondisk_log_size":890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:22.003479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'3863","reported_seq":3891,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.164932+0000","last_change":"2024-09-15T22:09:21.450705+0000","last_active":"2024-09-15T22:34:48.164932+0000","last_peered":"2024-09-15T22:34:48.164932+0000","last_clean":"2024-09-15T22:34:48.164932+0000","last_became_active":"2024-09-15T22:09:21.450265+0000","last_became_peered":"2024-09-15T22:09:21.450265+0000","last_unstale":"2024-09-15T22:34:48.164932+0000","last_undegraded":"2024-09-15T22:34:48.164932+0000","last_fullsized":"2024-09-15T22:34:48.164932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3863,"log_dups_size":0,"ondisk_log_size":3863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:21.477522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3014,"num_write_kb":86107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'883","reported_seq":918,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.970600+0000","last_change":"2024-09-15T22:09:17.410686+0000","last_active":"2024-09-15T22:34:47.970600+0000","last_peered":"2024-09-15T22:34:47.970600+0000","last_clean":"2024-09-15T22:34:47.970600+0000","last_became_active":"2024-09-15T22:09:17.410383+0000","last_became_peered":"2024-09-15T22:09:17.410383+0000","last_unstale":"2024-09-15T22:34:47.970600+0000","last_undegraded":"2024-09-15T22:34:47.970600+0000","last_fullsized":"2024-09-15T22:34:47.970600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'3968","reported_seq":4005,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.155998+0000","last_change":"2024-09-15T22:09:16.405335+0000","last_active":"2024-09-15T22:34:48.155998+0000","last_peered":"2024-09-15T22:34:48.155998+0000","last_clean":"2024-09-15T22:34:48.155998+0000","last_became_active":"2024-09-15T22:09:16.405010+0000","last_became_peered":"2024-09-15T22:09:16.405010+0000","last_unstale":"2024-09-15T22:34:48.155998+0000","last_undegraded":"2024-09-15T22:34:48.155998+0000","last_fullsized":"2024-09-15T22:34:48.155998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3968,"log_dups_size":0,"ondisk_log_size":3968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:00.202736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3969,"num_write_kb":30662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'3504","reported_seq":3540,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.346344+0000","last_change":"2024-09-15T22:09:59.534148+0000","last_active":"2024-09-15T22:34:47.346344+0000","last_peered":"2024-09-15T22:34:47.346344+0000","last_clean":"2024-09-15T22:34:47.346344+0000","last_became_active":"2024-09-15T22:09:59.533675+0000","last_became_peered":"2024-09-15T22:09:59.533675+0000","last_unstale":"2024-09-15T22:34:47.346344+0000","last_undegraded":"2024-09-15T22:34:47.346344+0000","last_fullsized":"2024-09-15T22:34:47.346344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3504,"log_dups_size":0,"ondisk_log_size":3504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.055754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2557,"num_write_kb":53761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'919","reported_seq":954,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.975733+0000","last_change":"2024-09-15T22:09:17.405327+0000","last_active":"2024-09-15T22:34:47.975733+0000","last_peered":"2024-09-15T22:34:47.975733+0000","last_clean":"2024-09-15T22:34:47.975733+0000","last_became_active":"2024-09-15T22:09:17.405065+0000","last_became_peered":"2024-09-15T22:09:17.405065+0000","last_unstale":"2024-09-15T22:34:47.975733+0000","last_undegraded":"2024-09-15T22:34:47.975733+0000","last_fullsized":"2024-09-15T22:34:47.975733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3442","reported_seq":3479,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.145460+0000","last_change":"2024-09-15T22:09:16.406705+0000","last_active":"2024-09-15T22:34:48.145460+0000","last_peered":"2024-09-15T22:34:48.145460+0000","last_clean":"2024-09-15T22:34:48.145460+0000","last_became_active":"2024-09-15T22:09:16.406454+0000","last_became_peered":"2024-09-15T22:09:16.406454+0000","last_unstale":"2024-09-15T22:34:48.145460+0000","last_undegraded":"2024-09-15T22:34:48.145460+0000","last_fullsized":"2024-09-15T22:34:48.145460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3442,"log_dups_size":0,"ondisk_log_size":3442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:02.444245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3448,"num_write_kb":30365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'4173","reported_seq":4209,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.694112+0000","last_change":"2024-09-15T22:09:59.805673+0000","last_active":"2024-09-15T22:34:47.694112+0000","last_peered":"2024-09-15T22:34:47.694112+0000","last_clean":"2024-09-15T22:34:47.694112+0000","last_became_active":"2024-09-15T22:09:59.805100+0000","last_became_peered":"2024-09-15T22:09:59.805100+0000","last_unstale":"2024-09-15T22:34:47.694112+0000","last_undegraded":"2024-09-15T22:34:47.694112+0000","last_fullsized":"2024-09-15T22:34:47.694112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4173,"log_dups_size":0,"ondisk_log_size":4173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:10.812526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3298,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'955","reported_seq":990,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.982724+0000","last_change":"2024-09-15T22:09:17.399551+0000","last_active":"2024-09-15T22:34:47.982724+0000","last_peered":"2024-09-15T22:34:47.982724+0000","last_clean":"2024-09-15T22:34:47.982724+0000","last_became_active":"2024-09-15T22:09:17.399290+0000","last_became_peered":"2024-09-15T22:09:17.399290+0000","last_unstale":"2024-09-15T22:34:47.982724+0000","last_undegraded":"2024-09-15T22:34:47.982724+0000","last_fullsized":"2024-09-15T22:34:47.982724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2082","reported_seq":2119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.144890+0000","last_change":"2024-09-15T22:09:16.408974+0000","last_active":"2024-09-15T22:34:48.144890+0000","last_peered":"2024-09-15T22:34:48.144890+0000","last_clean":"2024-09-15T22:34:48.144890+0000","last_became_active":"2024-09-15T22:09:16.408691+0000","last_became_peered":"2024-09-15T22:09:16.408691+0000","last_unstale":"2024-09-15T22:34:48.144890+0000","last_undegraded":"2024-09-15T22:34:48.144890+0000","last_fullsized":"2024-09-15T22:34:48.144890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2082,"log_dups_size":0,"ondisk_log_size":2082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:26:32.412274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2101,"num_write_kb":17400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'3631","reported_seq":3660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.474619+0000","last_change":"2024-09-15T22:09:21.458893+0000","last_active":"2024-09-15T22:34:47.474619+0000","last_peered":"2024-09-15T22:34:47.474619+0000","last_clean":"2024-09-15T22:34:47.474619+0000","last_became_active":"2024-09-15T22:09:21.458548+0000","last_became_peered":"2024-09-15T22:09:21.458548+0000","last_unstale":"2024-09-15T22:34:47.474619+0000","last_undegraded":"2024-09-15T22:34:47.474619+0000","last_fullsized":"2024-09-15T22:34:47.474619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3631,"log_dups_size":0,"ondisk_log_size":3631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:29.163692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2705,"num_write_kb":61946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'892","reported_seq":927,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.603569+0000","last_change":"2024-09-15T22:09:17.400823+0000","last_active":"2024-09-15T22:34:47.603569+0000","last_peered":"2024-09-15T22:34:47.603569+0000","last_clean":"2024-09-15T22:34:47.603569+0000","last_became_active":"2024-09-15T22:09:17.400494+0000","last_became_peered":"2024-09-15T22:09:17.400494+0000","last_unstale":"2024-09-15T22:34:47.603569+0000","last_undegraded":"2024-09-15T22:34:47.603569+0000","last_fullsized":"2024-09-15T22:34:47.603569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:02.290840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1674","reported_seq":1711,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.125462+0000","last_change":"2024-09-15T22:09:16.409156+0000","last_active":"2024-09-15T22:34:48.125462+0000","last_peered":"2024-09-15T22:34:48.125462+0000","last_clean":"2024-09-15T22:34:48.125462+0000","last_became_active":"2024-09-15T22:09:16.408603+0000","last_became_peered":"2024-09-15T22:09:16.408603+0000","last_unstale":"2024-09-15T22:34:48.125462+0000","last_undegraded":"2024-09-15T22:34:48.125462+0000","last_fullsized":"2024-09-15T22:34:48.125462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1674,"log_dups_size":0,"ondisk_log_size":1674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:12.245902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1676,"num_write_kb":13088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'3587","reported_seq":3616,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.170565+0000","last_change":"2024-09-15T22:09:21.447940+0000","last_active":"2024-09-15T22:34:48.170565+0000","last_peered":"2024-09-15T22:34:48.170565+0000","last_clean":"2024-09-15T22:34:48.170565+0000","last_became_active":"2024-09-15T22:09:21.447348+0000","last_became_peered":"2024-09-15T22:09:21.447348+0000","last_unstale":"2024-09-15T22:34:48.170565+0000","last_undegraded":"2024-09-15T22:34:48.170565+0000","last_fullsized":"2024-09-15T22:34:48.170565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3587,"log_dups_size":0,"ondisk_log_size":3587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:19.466950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2651,"num_write_kb":118894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'899","reported_seq":934,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.973665+0000","last_change":"2024-09-15T22:09:17.402826+0000","last_active":"2024-09-15T22:34:47.973665+0000","last_peered":"2024-09-15T22:34:47.973665+0000","last_clean":"2024-09-15T22:34:47.973665+0000","last_became_active":"2024-09-15T22:09:17.402585+0000","last_became_peered":"2024-09-15T22:09:17.402585+0000","last_unstale":"2024-09-15T22:34:47.973665+0000","last_undegraded":"2024-09-15T22:34:47.973665+0000","last_fullsized":"2024-09-15T22:34:47.973665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'1634","reported_seq":1671,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.142630+0000","last_change":"2024-09-15T22:09:16.408097+0000","last_active":"2024-09-15T22:34:48.142630+0000","last_peered":"2024-09-15T22:34:48.142630+0000","last_clean":"2024-09-15T22:34:48.142630+0000","last_became_active":"2024-09-15T22:09:16.407657+0000","last_became_peered":"2024-09-15T22:09:16.407657+0000","last_unstale":"2024-09-15T22:34:48.142630+0000","last_undegraded":"2024-09-15T22:34:48.142630+0000","last_fullsized":"2024-09-15T22:34:48.142630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1634,"log_dups_size":0,"ondisk_log_size":1634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":13124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'3592","reported_seq":3622,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.680644+0000","last_change":"2024-09-15T22:09:21.451205+0000","last_active":"2024-09-15T22:34:47.680644+0000","last_peered":"2024-09-15T22:34:47.680644+0000","last_clean":"2024-09-15T22:34:47.680644+0000","last_became_active":"2024-09-15T22:09:21.450731+0000","last_became_peered":"2024-09-15T22:09:21.450731+0000","last_unstale":"2024-09-15T22:34:47.680644+0000","last_undegraded":"2024-09-15T22:34:47.680644+0000","last_fullsized":"2024-09-15T22:34:47.680644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:38.650786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2678,"num_write_kb":64130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'844","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.996996+0000","last_change":"2024-09-15T22:09:17.421690+0000","last_active":"2024-09-15T22:34:47.996996+0000","last_peered":"2024-09-15T22:34:47.996996+0000","last_clean":"2024-09-15T22:34:47.996996+0000","last_became_active":"2024-09-15T22:09:17.421379+0000","last_became_peered":"2024-09-15T22:09:17.421379+0000","last_unstale":"2024-09-15T22:34:47.996996+0000","last_undegraded":"2024-09-15T22:34:47.996996+0000","last_fullsized":"2024-09-15T22:34:47.996996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2976","reported_seq":3013,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.143681+0000","last_change":"2024-09-15T22:09:16.408662+0000","last_active":"2024-09-15T22:34:48.143681+0000","last_peered":"2024-09-15T22:34:48.143681+0000","last_clean":"2024-09-15T22:34:48.143681+0000","last_became_active":"2024-09-15T22:09:16.408068+0000","last_became_peered":"2024-09-15T22:09:16.408068+0000","last_unstale":"2024-09-15T22:34:48.143681+0000","last_undegraded":"2024-09-15T22:34:48.143681+0000","last_fullsized":"2024-09-15T22:34:48.143681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2976,"log_dups_size":0,"ondisk_log_size":2976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:29.217773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5729,"num_write_kb":16111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'3599","reported_seq":3629,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.663354+0000","last_change":"2024-09-15T22:09:21.457447+0000","last_active":"2024-09-15T22:34:47.663354+0000","last_peered":"2024-09-15T22:34:47.663354+0000","last_clean":"2024-09-15T22:34:47.663354+0000","last_became_active":"2024-09-15T22:09:21.457031+0000","last_became_peered":"2024-09-15T22:09:21.457031+0000","last_unstale":"2024-09-15T22:34:47.663354+0000","last_undegraded":"2024-09-15T22:34:47.663354+0000","last_fullsized":"2024-09-15T22:34:47.663354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:45.457068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":57002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'901","reported_seq":937,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.973110+0000","last_change":"2024-09-15T22:09:17.400043+0000","last_active":"2024-09-15T22:34:47.973110+0000","last_peered":"2024-09-15T22:34:47.973110+0000","last_clean":"2024-09-15T22:34:47.973110+0000","last_became_active":"2024-09-15T22:09:17.399815+0000","last_became_peered":"2024-09-15T22:09:17.399815+0000","last_unstale":"2024-09-15T22:34:47.973110+0000","last_undegraded":"2024-09-15T22:34:47.973110+0000","last_fullsized":"2024-09-15T22:34:47.973110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:38.779044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2759","reported_seq":2797,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:20.157772+0000","last_change":"2024-09-15T22:09:16.407483+0000","last_active":"2024-09-15T22:34:20.157772+0000","last_peered":"2024-09-15T22:34:20.157772+0000","last_clean":"2024-09-15T22:34:20.157772+0000","last_became_active":"2024-09-15T22:09:16.407199+0000","last_became_peered":"2024-09-15T22:09:16.407199+0000","last_unstale":"2024-09-15T22:34:20.157772+0000","last_undegraded":"2024-09-15T22:34:20.157772+0000","last_fullsized":"2024-09-15T22:34:20.157772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2759,"log_dups_size":0,"ondisk_log_size":2759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:24.102281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2756,"num_write_kb":21836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'4104","reported_seq":4134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.647277+0000","last_change":"2024-09-15T22:09:21.449620+0000","last_active":"2024-09-15T22:34:47.647277+0000","last_peered":"2024-09-15T22:34:47.647277+0000","last_clean":"2024-09-15T22:34:47.647277+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:34:47.647277+0000","last_undegraded":"2024-09-15T22:34:47.647277+0000","last_fullsized":"2024-09-15T22:34:47.647277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4104,"log_dups_size":0,"ondisk_log_size":4104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:40.690811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3164,"num_write_kb":141390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'867","reported_seq":903,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.005792+0000","last_change":"2024-09-15T22:09:17.414930+0000","last_active":"2024-09-15T22:34:48.005792+0000","last_peered":"2024-09-15T22:34:48.005792+0000","last_clean":"2024-09-15T22:34:48.005792+0000","last_became_active":"2024-09-15T22:09:17.414645+0000","last_became_peered":"2024-09-15T22:09:17.414645+0000","last_unstale":"2024-09-15T22:34:48.005792+0000","last_undegraded":"2024-09-15T22:34:48.005792+0000","last_fullsized":"2024-09-15T22:34:48.005792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:22.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'2263","reported_seq":2301,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.120454+0000","last_change":"2024-09-15T22:09:16.408794+0000","last_active":"2024-09-15T22:34:48.120454+0000","last_peered":"2024-09-15T22:34:48.120454+0000","last_clean":"2024-09-15T22:34:48.120454+0000","last_became_active":"2024-09-15T22:09:16.408530+0000","last_became_peered":"2024-09-15T22:09:16.408530+0000","last_unstale":"2024-09-15T22:34:48.120454+0000","last_undegraded":"2024-09-15T22:34:48.120454+0000","last_fullsized":"2024-09-15T22:34:48.120454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2263,"log_dups_size":0,"ondisk_log_size":2263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:45.460989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2269,"num_write_kb":17504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'4348","reported_seq":4378,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.693261+0000","last_change":"2024-09-15T22:09:21.451875+0000","last_active":"2024-09-15T22:34:47.693261+0000","last_peered":"2024-09-15T22:34:47.693261+0000","last_clean":"2024-09-15T22:34:47.693261+0000","last_became_active":"2024-09-15T22:09:21.451491+0000","last_became_peered":"2024-09-15T22:09:21.451491+0000","last_unstale":"2024-09-15T22:34:47.693261+0000","last_undegraded":"2024-09-15T22:34:47.693261+0000","last_fullsized":"2024-09-15T22:34:47.693261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4348,"log_dups_size":0,"ondisk_log_size":4348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:11.279572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3466,"num_write_kb":69520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'894","reported_seq":930,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.974828+0000","last_change":"2024-09-15T22:09:17.409336+0000","last_active":"2024-09-15T22:34:47.974828+0000","last_peered":"2024-09-15T22:34:47.974828+0000","last_clean":"2024-09-15T22:34:47.974828+0000","last_became_active":"2024-09-15T22:09:17.409038+0000","last_became_peered":"2024-09-15T22:09:17.409038+0000","last_unstale":"2024-09-15T22:34:47.974828+0000","last_undegraded":"2024-09-15T22:34:47.974828+0000","last_fullsized":"2024-09-15T22:34:47.974828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:06.946537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5434","reported_seq":5472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.136131+0000","last_change":"2024-09-15T22:09:16.409869+0000","last_active":"2024-09-15T22:34:48.136131+0000","last_peered":"2024-09-15T22:34:48.136131+0000","last_clean":"2024-09-15T22:34:48.136131+0000","last_became_active":"2024-09-15T22:09:16.409532+0000","last_became_peered":"2024-09-15T22:09:16.409532+0000","last_unstale":"2024-09-15T22:34:48.136131+0000","last_undegraded":"2024-09-15T22:34:48.136131+0000","last_fullsized":"2024-09-15T22:34:48.136131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":5434,"log_dups_size":0,"ondisk_log_size":5434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:05.940474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20380159,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5429,"num_write_kb":47121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'4057","reported_seq":4087,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.703003+0000","last_change":"2024-09-15T22:09:21.458201+0000","last_active":"2024-09-15T22:34:47.703003+0000","last_peered":"2024-09-15T22:34:47.703003+0000","last_clean":"2024-09-15T22:34:47.703003+0000","last_became_active":"2024-09-15T22:09:21.457818+0000","last_became_peered":"2024-09-15T22:09:21.457818+0000","last_unstale":"2024-09-15T22:34:47.703003+0000","last_undegraded":"2024-09-15T22:34:47.703003+0000","last_fullsized":"2024-09-15T22:34:47.703003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4057,"log_dups_size":0,"ondisk_log_size":4057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:16.163530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3146,"num_write_kb":128629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'903","reported_seq":939,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.968435+0000","last_change":"2024-09-15T22:09:17.399405+0000","last_active":"2024-09-15T22:34:47.968435+0000","last_peered":"2024-09-15T22:34:47.968435+0000","last_clean":"2024-09-15T22:34:47.968435+0000","last_became_active":"2024-09-15T22:09:17.399148+0000","last_became_peered":"2024-09-15T22:09:17.399148+0000","last_unstale":"2024-09-15T22:34:47.968435+0000","last_undegraded":"2024-09-15T22:34:47.968435+0000","last_fullsized":"2024-09-15T22:34:47.968435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:29.126156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'4744","reported_seq":7015,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.147334+0000","last_change":"2024-09-15T22:09:16.402885+0000","last_active":"2024-09-15T22:34:48.147334+0000","last_peered":"2024-09-15T22:34:48.147334+0000","last_clean":"2024-09-15T22:34:48.147334+0000","last_became_active":"2024-09-15T22:09:16.402575+0000","last_became_peered":"2024-09-15T22:09:16.402575+0000","last_unstale":"2024-09-15T22:34:48.147334+0000","last_undegraded":"2024-09-15T22:34:48.147334+0000","last_fullsized":"2024-09-15T22:34:48.147334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4744,"log_dups_size":0,"ondisk_log_size":4744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2233,"num_read_kb":5661,"num_write":4757,"num_write_kb":27314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'3833","reported_seq":3862,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.687630+0000","last_change":"2024-09-15T22:09:21.457254+0000","last_active":"2024-09-15T22:34:47.687630+0000","last_peered":"2024-09-15T22:34:47.687630+0000","last_clean":"2024-09-15T22:34:47.687630+0000","last_became_active":"2024-09-15T22:09:21.456858+0000","last_became_peered":"2024-09-15T22:09:21.456858+0000","last_unstale":"2024-09-15T22:34:47.687630+0000","last_undegraded":"2024-09-15T22:34:47.687630+0000","last_fullsized":"2024-09-15T22:34:47.687630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:52.339264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2989,"num_write_kb":154181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'860","reported_seq":896,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.982932+0000","last_change":"2024-09-15T22:09:17.411196+0000","last_active":"2024-09-15T22:34:47.982932+0000","last_peered":"2024-09-15T22:34:47.982932+0000","last_clean":"2024-09-15T22:34:47.982932+0000","last_became_active":"2024-09-15T22:09:17.409905+0000","last_became_peered":"2024-09-15T22:09:17.409905+0000","last_unstale":"2024-09-15T22:34:47.982932+0000","last_undegraded":"2024-09-15T22:34:47.982932+0000","last_fullsized":"2024-09-15T22:34:47.982932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:10.299704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'3959","reported_seq":3997,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.122816+0000","last_change":"2024-09-15T22:09:16.409152+0000","last_active":"2024-09-15T22:34:48.122816+0000","last_peered":"2024-09-15T22:34:48.122816+0000","last_clean":"2024-09-15T22:34:48.122816+0000","last_became_active":"2024-09-15T22:09:16.408793+0000","last_became_peered":"2024-09-15T22:09:16.408793+0000","last_unstale":"2024-09-15T22:34:48.122816+0000","last_undegraded":"2024-09-15T22:34:48.122816+0000","last_fullsized":"2024-09-15T22:34:48.122816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3959,"log_dups_size":0,"ondisk_log_size":3959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:09.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3958,"num_write_kb":30646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'3858","reported_seq":3887,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.507795+0000","last_change":"2024-09-15T22:09:21.456804+0000","last_active":"2024-09-15T22:34:47.507795+0000","last_peered":"2024-09-15T22:34:47.507795+0000","last_clean":"2024-09-15T22:34:47.507795+0000","last_became_active":"2024-09-15T22:09:21.456416+0000","last_became_peered":"2024-09-15T22:09:21.456416+0000","last_unstale":"2024-09-15T22:34:47.507795+0000","last_undegraded":"2024-09-15T22:34:47.507795+0000","last_fullsized":"2024-09-15T22:34:47.507795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3858,"log_dups_size":0,"ondisk_log_size":3858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:28.462550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2949,"num_write_kb":92106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'903","reported_seq":924,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.995708+0000","last_change":"2024-09-15T22:09:59.531923+0000","last_active":"2024-09-15T22:34:47.995708+0000","last_peered":"2024-09-15T22:34:47.995708+0000","last_clean":"2024-09-15T22:34:47.995708+0000","last_became_active":"2024-09-15T22:09:59.531667+0000","last_became_peered":"2024-09-15T22:09:59.531667+0000","last_unstale":"2024-09-15T22:34:47.995708+0000","last_undegraded":"2024-09-15T22:34:47.995708+0000","last_fullsized":"2024-09-15T22:34:47.995708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'2199","reported_seq":2237,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.140187+0000","last_change":"2024-09-15T22:09:16.401625+0000","last_active":"2024-09-15T22:34:48.140187+0000","last_peered":"2024-09-15T22:34:48.140187+0000","last_clean":"2024-09-15T22:34:48.140187+0000","last_became_active":"2024-09-15T22:09:16.401328+0000","last_became_peered":"2024-09-15T22:09:16.401328+0000","last_unstale":"2024-09-15T22:34:48.140187+0000","last_undegraded":"2024-09-15T22:34:48.140187+0000","last_fullsized":"2024-09-15T22:34:48.140187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2199,"log_dups_size":0,"ondisk_log_size":2199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2201,"num_write_kb":17467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:31:10.136103+0000","last_change":"2024-09-15T22:09:07.243631+0000","last_active":"2024-09-15T22:31:10.136103+0000","last_peered":"2024-09-15T22:31:10.136103+0000","last_clean":"2024-09-15T22:31:10.136103+0000","last_became_active":"2024-09-15T22:09:07.243223+0000","last_became_peered":"2024-09-15T22:09:07.243223+0000","last_unstale":"2024-09-15T22:31:10.136103+0000","last_undegraded":"2024-09-15T22:31:10.136103+0000","last_fullsized":"2024-09-15T22:31:10.136103+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_clean_scrub_stamp":"2024-09-15T22:09:06.009777+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:17:18.429315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'4430","reported_seq":4460,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.619292+0000","last_change":"2024-09-15T22:09:21.453536+0000","last_active":"2024-09-15T22:34:47.619292+0000","last_peered":"2024-09-15T22:34:47.619292+0000","last_clean":"2024-09-15T22:34:47.619292+0000","last_became_active":"2024-09-15T22:09:21.453022+0000","last_became_peered":"2024-09-15T22:09:21.453022+0000","last_unstale":"2024-09-15T22:34:47.619292+0000","last_undegraded":"2024-09-15T22:34:47.619292+0000","last_fullsized":"2024-09-15T22:34:47.619292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4430,"log_dups_size":0,"ondisk_log_size":4430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:26.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3508,"num_write_kb":155329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'902","reported_seq":942,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.982222+0000","last_change":"2024-09-15T22:09:59.534250+0000","last_active":"2024-09-15T22:34:47.982222+0000","last_peered":"2024-09-15T22:34:47.982222+0000","last_clean":"2024-09-15T22:34:47.982222+0000","last_became_active":"2024-09-15T22:09:59.533885+0000","last_became_peered":"2024-09-15T22:09:59.533885+0000","last_unstale":"2024-09-15T22:34:47.982222+0000","last_undegraded":"2024-09-15T22:34:47.982222+0000","last_fullsized":"2024-09-15T22:34:47.982222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:26.642804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'3371","reported_seq":3408,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.132472+0000","last_change":"2024-09-15T22:09:16.404982+0000","last_active":"2024-09-15T22:34:48.132472+0000","last_peered":"2024-09-15T22:34:48.132472+0000","last_clean":"2024-09-15T22:34:48.132472+0000","last_became_active":"2024-09-15T22:09:16.404639+0000","last_became_peered":"2024-09-15T22:09:16.404639+0000","last_unstale":"2024-09-15T22:34:48.132472+0000","last_undegraded":"2024-09-15T22:34:48.132472+0000","last_fullsized":"2024-09-15T22:34:48.132472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3371,"log_dups_size":0,"ondisk_log_size":3371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3372,"num_write_kb":30249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'3562","reported_seq":3591,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.703425+0000","last_change":"2024-09-15T22:09:21.457352+0000","last_active":"2024-09-15T22:34:47.703425+0000","last_peered":"2024-09-15T22:34:47.703425+0000","last_clean":"2024-09-15T22:34:47.703425+0000","last_became_active":"2024-09-15T22:09:21.456906+0000","last_became_peered":"2024-09-15T22:09:21.456906+0000","last_unstale":"2024-09-15T22:34:47.703425+0000","last_undegraded":"2024-09-15T22:34:47.703425+0000","last_fullsized":"2024-09-15T22:34:47.703425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3562,"log_dups_size":0,"ondisk_log_size":3562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:28.271273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2654,"num_write_kb":61277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'891","reported_seq":926,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.985965+0000","last_change":"2024-09-15T22:09:17.416652+0000","last_active":"2024-09-15T22:34:47.985965+0000","last_peered":"2024-09-15T22:34:47.985965+0000","last_clean":"2024-09-15T22:34:47.985965+0000","last_became_active":"2024-09-15T22:09:17.415597+0000","last_became_peered":"2024-09-15T22:09:17.415597+0000","last_unstale":"2024-09-15T22:34:47.985965+0000","last_undegraded":"2024-09-15T22:34:47.985965+0000","last_fullsized":"2024-09-15T22:34:47.985965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:36.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'4278","reported_seq":4315,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.145535+0000","last_change":"2024-09-15T22:09:16.405689+0000","last_active":"2024-09-15T22:34:48.145535+0000","last_peered":"2024-09-15T22:34:48.145535+0000","last_clean":"2024-09-15T22:34:48.145535+0000","last_became_active":"2024-09-15T22:09:16.405433+0000","last_became_peered":"2024-09-15T22:09:16.405433+0000","last_unstale":"2024-09-15T22:34:48.145535+0000","last_undegraded":"2024-09-15T22:34:48.145535+0000","last_fullsized":"2024-09-15T22:34:48.145535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4278,"log_dups_size":0,"ondisk_log_size":4278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.332999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4278,"num_write_kb":34786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'3805","reported_seq":3841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.683777+0000","last_change":"2024-09-15T22:09:59.534678+0000","last_active":"2024-09-15T22:34:47.683777+0000","last_peered":"2024-09-15T22:34:47.683777+0000","last_clean":"2024-09-15T22:34:47.683777+0000","last_became_active":"2024-09-15T22:09:59.534224+0000","last_became_peered":"2024-09-15T22:09:59.534224+0000","last_unstale":"2024-09-15T22:34:47.683777+0000","last_undegraded":"2024-09-15T22:34:47.683777+0000","last_fullsized":"2024-09-15T22:34:47.683777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3805,"log_dups_size":0,"ondisk_log_size":3805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:29.093882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2836,"num_write_kb":60139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'879","reported_seq":914,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.006366+0000","last_change":"2024-09-15T22:09:17.412910+0000","last_active":"2024-09-15T22:34:48.006366+0000","last_peered":"2024-09-15T22:34:48.006366+0000","last_clean":"2024-09-15T22:34:48.006366+0000","last_became_active":"2024-09-15T22:09:17.412079+0000","last_became_peered":"2024-09-15T22:09:17.412079+0000","last_unstale":"2024-09-15T22:34:48.006366+0000","last_undegraded":"2024-09-15T22:34:48.006366+0000","last_fullsized":"2024-09-15T22:34:48.006366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:04.536343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'2409","reported_seq":2446,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.117233+0000","last_change":"2024-09-15T22:09:16.405941+0000","last_active":"2024-09-15T22:34:48.117233+0000","last_peered":"2024-09-15T22:34:48.117233+0000","last_clean":"2024-09-15T22:34:48.117233+0000","last_became_active":"2024-09-15T22:09:16.405621+0000","last_became_peered":"2024-09-15T22:09:16.405621+0000","last_unstale":"2024-09-15T22:34:48.117233+0000","last_undegraded":"2024-09-15T22:34:48.117233+0000","last_fullsized":"2024-09-15T22:34:48.117233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2409,"log_dups_size":0,"ondisk_log_size":2409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2412,"num_write_kb":21631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'4109","reported_seq":4138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.174045+0000","last_change":"2024-09-15T22:09:21.449669+0000","last_active":"2024-09-15T22:34:48.174045+0000","last_peered":"2024-09-15T22:34:48.174045+0000","last_clean":"2024-09-15T22:34:48.174045+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:34:48.174045+0000","last_undegraded":"2024-09-15T22:34:48.174045+0000","last_fullsized":"2024-09-15T22:34:48.174045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4109,"log_dups_size":0,"ondisk_log_size":4109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:45.457068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3191,"num_write_kb":110194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'910","reported_seq":945,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.981911+0000","last_change":"2024-09-15T22:09:17.410475+0000","last_active":"2024-09-15T22:34:47.981911+0000","last_peered":"2024-09-15T22:34:47.981911+0000","last_clean":"2024-09-15T22:34:47.981911+0000","last_became_active":"2024-09-15T22:09:17.410176+0000","last_became_peered":"2024-09-15T22:09:17.410176+0000","last_unstale":"2024-09-15T22:34:47.981911+0000","last_undegraded":"2024-09-15T22:34:47.981911+0000","last_fullsized":"2024-09-15T22:34:47.981911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'1504","reported_seq":1541,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.120787+0000","last_change":"2024-09-15T22:09:16.399090+0000","last_active":"2024-09-15T22:34:48.120787+0000","last_peered":"2024-09-15T22:34:48.120787+0000","last_clean":"2024-09-15T22:34:48.120787+0000","last_became_active":"2024-09-15T22:09:16.398789+0000","last_became_peered":"2024-09-15T22:09:16.398789+0000","last_unstale":"2024-09-15T22:34:48.120787+0000","last_undegraded":"2024-09-15T22:34:48.120787+0000","last_fullsized":"2024-09-15T22:34:48.120787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1504,"log_dups_size":0,"ondisk_log_size":1504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:14.477432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1509,"num_write_kb":13058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'3700","reported_seq":3729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.621769+0000","last_change":"2024-09-15T22:09:21.448270+0000","last_active":"2024-09-15T22:34:47.621769+0000","last_peered":"2024-09-15T22:34:47.621769+0000","last_clean":"2024-09-15T22:34:47.621769+0000","last_became_active":"2024-09-15T22:09:21.447541+0000","last_became_peered":"2024-09-15T22:09:21.447541+0000","last_unstale":"2024-09-15T22:34:47.621769+0000","last_undegraded":"2024-09-15T22:34:47.621769+0000","last_fullsized":"2024-09-15T22:34:47.621769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3700,"log_dups_size":0,"ondisk_log_size":3700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:51.175728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2791,"num_write_kb":90475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'922","reported_seq":956,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.992661+0000","last_change":"2024-09-15T22:09:17.410762+0000","last_active":"2024-09-15T22:34:47.992661+0000","last_peered":"2024-09-15T22:34:47.992661+0000","last_clean":"2024-09-15T22:34:47.992661+0000","last_became_active":"2024-09-15T22:09:17.410431+0000","last_became_peered":"2024-09-15T22:09:17.410431+0000","last_unstale":"2024-09-15T22:34:47.992661+0000","last_undegraded":"2024-09-15T22:34:47.992661+0000","last_fullsized":"2024-09-15T22:34:47.992661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:15.123863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'1787","reported_seq":1823,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.130026+0000","last_change":"2024-09-15T22:09:16.409298+0000","last_active":"2024-09-15T22:34:48.130026+0000","last_peered":"2024-09-15T22:34:48.130026+0000","last_clean":"2024-09-15T22:34:48.130026+0000","last_became_active":"2024-09-15T22:09:16.408991+0000","last_became_peered":"2024-09-15T22:09:16.408991+0000","last_unstale":"2024-09-15T22:34:48.130026+0000","last_undegraded":"2024-09-15T22:34:48.130026+0000","last_fullsized":"2024-09-15T22:34:48.130026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1787,"log_dups_size":0,"ondisk_log_size":1787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.799831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1802,"num_write_kb":13181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'3624","reported_seq":3652,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.703935+0000","last_change":"2024-09-15T22:09:21.453936+0000","last_active":"2024-09-15T22:34:47.703935+0000","last_peered":"2024-09-15T22:34:47.703935+0000","last_clean":"2024-09-15T22:34:47.703935+0000","last_became_active":"2024-09-15T22:09:21.453526+0000","last_became_peered":"2024-09-15T22:09:21.453526+0000","last_unstale":"2024-09-15T22:34:47.703935+0000","last_undegraded":"2024-09-15T22:34:47.703935+0000","last_fullsized":"2024-09-15T22:34:47.703935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:19.159742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2710,"num_write_kb":101760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'885","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.971021+0000","last_change":"2024-09-15T22:09:17.404617+0000","last_active":"2024-09-15T22:34:47.971021+0000","last_peered":"2024-09-15T22:34:47.971021+0000","last_clean":"2024-09-15T22:34:47.971021+0000","last_became_active":"2024-09-15T22:09:17.404310+0000","last_became_peered":"2024-09-15T22:09:17.404310+0000","last_unstale":"2024-09-15T22:34:47.971021+0000","last_undegraded":"2024-09-15T22:34:47.971021+0000","last_fullsized":"2024-09-15T22:34:47.971021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:17.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'963","reported_seq":999,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.117866+0000","last_change":"2024-09-15T22:09:16.403439+0000","last_active":"2024-09-15T22:34:48.117866+0000","last_peered":"2024-09-15T22:34:48.117866+0000","last_clean":"2024-09-15T22:34:48.117866+0000","last_became_active":"2024-09-15T22:09:16.403137+0000","last_became_peered":"2024-09-15T22:09:16.403137+0000","last_unstale":"2024-09-15T22:34:48.117866+0000","last_undegraded":"2024-09-15T22:34:48.117866+0000","last_fullsized":"2024-09-15T22:34:48.117866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:05.940474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":974,"num_write_kb":8662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'3775","reported_seq":3803,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.687144+0000","last_change":"2024-09-15T22:09:21.451370+0000","last_active":"2024-09-15T22:34:47.687144+0000","last_peered":"2024-09-15T22:34:47.687144+0000","last_clean":"2024-09-15T22:34:47.687144+0000","last_became_active":"2024-09-15T22:09:21.451016+0000","last_became_peered":"2024-09-15T22:09:21.451016+0000","last_unstale":"2024-09-15T22:34:47.687144+0000","last_undegraded":"2024-09-15T22:34:47.687144+0000","last_fullsized":"2024-09-15T22:34:47.687144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:54.480340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2843,"num_write_kb":133663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'906","reported_seq":940,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.006538+0000","last_change":"2024-09-15T22:09:17.412953+0000","last_active":"2024-09-15T22:34:48.006538+0000","last_peered":"2024-09-15T22:34:48.006538+0000","last_clean":"2024-09-15T22:34:48.006538+0000","last_became_active":"2024-09-15T22:09:17.412680+0000","last_became_peered":"2024-09-15T22:09:17.412680+0000","last_unstale":"2024-09-15T22:34:48.006538+0000","last_undegraded":"2024-09-15T22:34:48.006538+0000","last_fullsized":"2024-09-15T22:34:48.006538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":906,"log_dups_size":0,"ondisk_log_size":906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:36.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'443","reported_seq":479,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.126611+0000","last_change":"2024-09-15T22:09:16.406833+0000","last_active":"2024-09-15T22:34:48.126611+0000","last_peered":"2024-09-15T22:34:48.126611+0000","last_clean":"2024-09-15T22:34:48.126611+0000","last_became_active":"2024-09-15T22:09:16.406550+0000","last_became_peered":"2024-09-15T22:09:16.406550+0000","last_unstale":"2024-09-15T22:34:48.126611+0000","last_undegraded":"2024-09-15T22:34:48.126611+0000","last_fullsized":"2024-09-15T22:34:48.126611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":462,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'4060","reported_seq":4088,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.669028+0000","last_change":"2024-09-15T22:09:21.450825+0000","last_active":"2024-09-15T22:34:47.669028+0000","last_peered":"2024-09-15T22:34:47.669028+0000","last_clean":"2024-09-15T22:34:47.669028+0000","last_became_active":"2024-09-15T22:09:21.450200+0000","last_became_peered":"2024-09-15T22:09:21.450200+0000","last_unstale":"2024-09-15T22:34:47.669028+0000","last_undegraded":"2024-09-15T22:34:47.669028+0000","last_fullsized":"2024-09-15T22:34:47.669028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4060,"log_dups_size":0,"ondisk_log_size":4060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:10.812526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3182,"num_write_kb":92617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'876","reported_seq":910,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.986053+0000","last_change":"2024-09-15T22:09:17.421088+0000","last_active":"2024-09-15T22:34:47.986053+0000","last_peered":"2024-09-15T22:34:47.986053+0000","last_clean":"2024-09-15T22:34:47.986053+0000","last_became_active":"2024-09-15T22:09:17.420802+0000","last_became_peered":"2024-09-15T22:09:17.420802+0000","last_unstale":"2024-09-15T22:34:47.986053+0000","last_undegraded":"2024-09-15T22:34:47.986053+0000","last_fullsized":"2024-09-15T22:34:47.986053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:57.079300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'2258","reported_seq":2294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.131076+0000","last_change":"2024-09-15T22:09:16.395676+0000","last_active":"2024-09-15T22:34:48.131076+0000","last_peered":"2024-09-15T22:34:48.131076+0000","last_clean":"2024-09-15T22:34:48.131076+0000","last_became_active":"2024-09-15T22:09:16.394355+0000","last_became_peered":"2024-09-15T22:09:16.394355+0000","last_unstale":"2024-09-15T22:34:48.131076+0000","last_undegraded":"2024-09-15T22:34:48.131076+0000","last_fullsized":"2024-09-15T22:34:48.131076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2258,"log_dups_size":0,"ondisk_log_size":2258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:53.845610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2267,"num_write_kb":17573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'3672","reported_seq":3700,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.650001+0000","last_change":"2024-09-15T22:09:21.454458+0000","last_active":"2024-09-15T22:34:47.650001+0000","last_peered":"2024-09-15T22:34:47.650001+0000","last_clean":"2024-09-15T22:34:47.650001+0000","last_became_active":"2024-09-15T22:09:21.453992+0000","last_became_peered":"2024-09-15T22:09:21.453992+0000","last_unstale":"2024-09-15T22:34:47.650001+0000","last_undegraded":"2024-09-15T22:34:47.650001+0000","last_fullsized":"2024-09-15T22:34:47.650001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3672,"log_dups_size":0,"ondisk_log_size":3672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:08.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2764,"num_write_kb":64906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'863","reported_seq":897,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.982113+0000","last_change":"2024-09-15T22:09:17.404161+0000","last_active":"2024-09-15T22:34:47.982113+0000","last_peered":"2024-09-15T22:34:47.982113+0000","last_clean":"2024-09-15T22:34:47.982113+0000","last_became_active":"2024-09-15T22:09:17.403899+0000","last_became_peered":"2024-09-15T22:09:17.403899+0000","last_unstale":"2024-09-15T22:34:47.982113+0000","last_undegraded":"2024-09-15T22:34:47.982113+0000","last_fullsized":"2024-09-15T22:34:47.982113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:22.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'3996","reported_seq":4032,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.135010+0000","last_change":"2024-09-15T22:09:16.403905+0000","last_active":"2024-09-15T22:34:48.135010+0000","last_peered":"2024-09-15T22:34:48.135010+0000","last_clean":"2024-09-15T22:34:48.135010+0000","last_became_active":"2024-09-15T22:09:16.403624+0000","last_became_peered":"2024-09-15T22:09:16.403624+0000","last_unstale":"2024-09-15T22:34:48.135010+0000","last_undegraded":"2024-09-15T22:34:48.135010+0000","last_fullsized":"2024-09-15T22:34:48.135010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3999,"num_write_kb":30696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'3842","reported_seq":3870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.173105+0000","last_change":"2024-09-15T22:09:21.452045+0000","last_active":"2024-09-15T22:34:48.173105+0000","last_peered":"2024-09-15T22:34:48.173105+0000","last_clean":"2024-09-15T22:34:48.173105+0000","last_became_active":"2024-09-15T22:09:21.451617+0000","last_became_peered":"2024-09-15T22:09:21.451617+0000","last_unstale":"2024-09-15T22:34:48.173105+0000","last_undegraded":"2024-09-15T22:34:48.173105+0000","last_fullsized":"2024-09-15T22:34:48.173105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3842,"log_dups_size":0,"ondisk_log_size":3842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:32.189930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2980,"num_write_kb":152763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'896","reported_seq":930,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.978282+0000","last_change":"2024-09-15T22:09:17.399198+0000","last_active":"2024-09-15T22:34:47.978282+0000","last_peered":"2024-09-15T22:34:47.978282+0000","last_clean":"2024-09-15T22:34:47.978282+0000","last_became_active":"2024-09-15T22:09:17.398881+0000","last_became_peered":"2024-09-15T22:09:17.398881+0000","last_unstale":"2024-09-15T22:34:47.978282+0000","last_undegraded":"2024-09-15T22:34:47.978282+0000","last_fullsized":"2024-09-15T22:34:47.978282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:44.868956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'4322","reported_seq":4358,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.140696+0000","last_change":"2024-09-15T22:09:16.408365+0000","last_active":"2024-09-15T22:34:48.140696+0000","last_peered":"2024-09-15T22:34:48.140696+0000","last_clean":"2024-09-15T22:34:48.140696+0000","last_became_active":"2024-09-15T22:09:16.408064+0000","last_became_peered":"2024-09-15T22:09:16.408064+0000","last_unstale":"2024-09-15T22:34:48.140696+0000","last_undegraded":"2024-09-15T22:34:48.140696+0000","last_fullsized":"2024-09-15T22:34:48.140696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4322,"log_dups_size":0,"ondisk_log_size":4322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:01.032313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4321,"num_write_kb":23285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'4245","reported_seq":4273,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.171146+0000","last_change":"2024-09-15T22:09:21.455334+0000","last_active":"2024-09-15T22:34:48.171146+0000","last_peered":"2024-09-15T22:34:48.171146+0000","last_clean":"2024-09-15T22:34:48.171146+0000","last_became_active":"2024-09-15T22:09:21.454907+0000","last_became_peered":"2024-09-15T22:09:21.454907+0000","last_unstale":"2024-09-15T22:34:48.171146+0000","last_undegraded":"2024-09-15T22:34:48.171146+0000","last_fullsized":"2024-09-15T22:34:48.171146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4245,"log_dups_size":0,"ondisk_log_size":4245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:26.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3329,"num_write_kb":357256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'888","reported_seq":922,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.000309+0000","last_change":"2024-09-15T22:09:17.415215+0000","last_active":"2024-09-15T22:34:48.000309+0000","last_peered":"2024-09-15T22:34:48.000309+0000","last_clean":"2024-09-15T22:34:48.000309+0000","last_became_active":"2024-09-15T22:09:17.414951+0000","last_became_peered":"2024-09-15T22:09:17.414951+0000","last_unstale":"2024-09-15T22:34:48.000309+0000","last_undegraded":"2024-09-15T22:34:48.000309+0000","last_fullsized":"2024-09-15T22:34:48.000309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3258","reported_seq":3294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.140312+0000","last_change":"2024-09-15T22:09:16.405521+0000","last_active":"2024-09-15T22:34:48.140312+0000","last_peered":"2024-09-15T22:34:48.140312+0000","last_clean":"2024-09-15T22:34:48.140312+0000","last_became_active":"2024-09-15T22:09:16.405230+0000","last_became_peered":"2024-09-15T22:09:16.405230+0000","last_unstale":"2024-09-15T22:34:48.140312+0000","last_undegraded":"2024-09-15T22:34:48.140312+0000","last_fullsized":"2024-09-15T22:34:48.140312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3258,"log_dups_size":0,"ondisk_log_size":3258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:03.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3257,"num_write_kb":26116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'3612","reported_seq":3640,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.653194+0000","last_change":"2024-09-15T22:09:21.450431+0000","last_active":"2024-09-15T22:34:47.653194+0000","last_peered":"2024-09-15T22:34:47.653194+0000","last_clean":"2024-09-15T22:34:47.653194+0000","last_became_active":"2024-09-15T22:09:21.449896+0000","last_became_peered":"2024-09-15T22:09:21.449896+0000","last_unstale":"2024-09-15T22:34:47.653194+0000","last_undegraded":"2024-09-15T22:34:47.653194+0000","last_fullsized":"2024-09-15T22:34:47.653194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3612,"log_dups_size":0,"ondisk_log_size":3612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:18.430595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2735,"num_write_kb":71213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'873","reported_seq":907,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.003609+0000","last_change":"2024-09-15T22:09:17.422669+0000","last_active":"2024-09-15T22:34:48.003609+0000","last_peered":"2024-09-15T22:34:48.003609+0000","last_clean":"2024-09-15T22:34:48.003609+0000","last_became_active":"2024-09-15T22:09:17.422401+0000","last_became_peered":"2024-09-15T22:09:17.422401+0000","last_unstale":"2024-09-15T22:34:48.003609+0000","last_undegraded":"2024-09-15T22:34:48.003609+0000","last_fullsized":"2024-09-15T22:34:48.003609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2844","reported_seq":3576,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.146617+0000","last_change":"2024-09-15T22:09:16.405552+0000","last_active":"2024-09-15T22:34:48.146617+0000","last_peered":"2024-09-15T22:34:48.146617+0000","last_clean":"2024-09-15T22:34:48.146617+0000","last_became_active":"2024-09-15T22:09:16.405208+0000","last_became_peered":"2024-09-15T22:09:16.405208+0000","last_unstale":"2024-09-15T22:34:48.146617+0000","last_undegraded":"2024-09-15T22:34:48.146617+0000","last_fullsized":"2024-09-15T22:34:48.146617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2844,"log_dups_size":0,"ondisk_log_size":2844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18685136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":696,"num_read_kb":2335,"num_write":2846,"num_write_kb":23873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'3807","reported_seq":3835,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.585560+0000","last_change":"2024-09-15T22:09:21.448849+0000","last_active":"2024-09-15T22:34:47.585560+0000","last_peered":"2024-09-15T22:34:47.585560+0000","last_clean":"2024-09-15T22:34:47.585560+0000","last_became_active":"2024-09-15T22:09:21.448356+0000","last_became_peered":"2024-09-15T22:09:21.448356+0000","last_unstale":"2024-09-15T22:34:47.585560+0000","last_undegraded":"2024-09-15T22:34:47.585560+0000","last_fullsized":"2024-09-15T22:34:47.585560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3807,"log_dups_size":0,"ondisk_log_size":3807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:08.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2897,"num_write_kb":187512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'3625","reported_seq":3655,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.161586+0000","last_change":"2024-09-15T22:09:21.458815+0000","last_active":"2024-09-15T22:34:48.161586+0000","last_peered":"2024-09-15T22:34:48.161586+0000","last_clean":"2024-09-15T22:34:48.161586+0000","last_became_active":"2024-09-15T22:09:21.458418+0000","last_became_peered":"2024-09-15T22:09:21.458418+0000","last_unstale":"2024-09-15T22:34:48.161586+0000","last_undegraded":"2024-09-15T22:34:48.161586+0000","last_fullsized":"2024-09-15T22:34:48.161586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:26.187414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2737,"num_write_kb":87535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'902","reported_seq":936,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.973143+0000","last_change":"2024-09-15T22:09:17.401001+0000","last_active":"2024-09-15T22:34:47.973143+0000","last_peered":"2024-09-15T22:34:47.973143+0000","last_clean":"2024-09-15T22:34:47.973143+0000","last_became_active":"2024-09-15T22:09:17.400754+0000","last_became_peered":"2024-09-15T22:09:17.400754+0000","last_unstale":"2024-09-15T22:34:47.973143+0000","last_undegraded":"2024-09-15T22:34:47.973143+0000","last_fullsized":"2024-09-15T22:34:47.973143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:33.878828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'4403","reported_seq":4439,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.130690+0000","last_change":"2024-09-15T22:09:16.404987+0000","last_active":"2024-09-15T22:34:48.130690+0000","last_peered":"2024-09-15T22:34:48.130690+0000","last_clean":"2024-09-15T22:34:48.130690+0000","last_became_active":"2024-09-15T22:09:16.404694+0000","last_became_peered":"2024-09-15T22:09:16.404694+0000","last_unstale":"2024-09-15T22:34:48.130690+0000","last_undegraded":"2024-09-15T22:34:48.130690+0000","last_fullsized":"2024-09-15T22:34:48.130690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4404,"num_write_kb":39122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'4168","reported_seq":4198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.608477+0000","last_change":"2024-09-15T22:09:21.457334+0000","last_active":"2024-09-15T22:34:47.608477+0000","last_peered":"2024-09-15T22:34:47.608477+0000","last_clean":"2024-09-15T22:34:47.608477+0000","last_became_active":"2024-09-15T22:09:21.456871+0000","last_became_peered":"2024-09-15T22:09:21.456871+0000","last_unstale":"2024-09-15T22:34:47.608477+0000","last_undegraded":"2024-09-15T22:34:47.608477+0000","last_fullsized":"2024-09-15T22:34:47.608477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4168,"log_dups_size":0,"ondisk_log_size":4168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:08.904123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3293,"num_write_kb":221802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'944","reported_seq":978,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.980106+0000","last_change":"2024-09-15T22:09:17.402872+0000","last_active":"2024-09-15T22:34:47.980106+0000","last_peered":"2024-09-15T22:34:47.980106+0000","last_clean":"2024-09-15T22:34:47.980106+0000","last_became_active":"2024-09-15T22:09:17.402625+0000","last_became_peered":"2024-09-15T22:09:17.402625+0000","last_unstale":"2024-09-15T22:34:47.980106+0000","last_undegraded":"2024-09-15T22:34:47.980106+0000","last_fullsized":"2024-09-15T22:34:47.980106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":944,"log_dups_size":0,"ondisk_log_size":944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'2057","reported_seq":2093,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.127636+0000","last_change":"2024-09-15T22:09:16.405821+0000","last_active":"2024-09-15T22:34:48.127636+0000","last_peered":"2024-09-15T22:34:48.127636+0000","last_clean":"2024-09-15T22:34:48.127636+0000","last_became_active":"2024-09-15T22:09:16.405561+0000","last_became_peered":"2024-09-15T22:09:16.405561+0000","last_unstale":"2024-09-15T22:34:48.127636+0000","last_undegraded":"2024-09-15T22:34:48.127636+0000","last_fullsized":"2024-09-15T22:34:48.127636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2057,"log_dups_size":0,"ondisk_log_size":2057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2062,"num_write_kb":17437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4667","reported_seq":4703,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.176514+0000","last_change":"2024-09-15T22:09:16.403455+0000","last_active":"2024-09-15T22:34:48.176514+0000","last_peered":"2024-09-15T22:34:48.176514+0000","last_clean":"2024-09-15T22:34:48.176514+0000","last_became_active":"2024-09-15T22:09:16.403172+0000","last_became_peered":"2024-09-15T22:09:16.403172+0000","last_unstale":"2024-09-15T22:34:48.176514+0000","last_undegraded":"2024-09-15T22:34:48.176514+0000","last_fullsized":"2024-09-15T22:34:48.176514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:03.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4675,"num_write_kb":35111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'885","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.985255+0000","last_change":"2024-09-15T22:09:17.416335+0000","last_active":"2024-09-15T22:34:47.985255+0000","last_peered":"2024-09-15T22:34:47.985255+0000","last_clean":"2024-09-15T22:34:47.985255+0000","last_became_active":"2024-09-15T22:09:17.416102+0000","last_became_peered":"2024-09-15T22:09:17.416102+0000","last_unstale":"2024-09-15T22:34:47.985255+0000","last_undegraded":"2024-09-15T22:34:47.985255+0000","last_fullsized":"2024-09-15T22:34:47.985255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3664","reported_seq":3692,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.677534+0000","last_change":"2024-09-15T22:09:21.448449+0000","last_active":"2024-09-15T22:34:47.677534+0000","last_peered":"2024-09-15T22:34:47.677534+0000","last_clean":"2024-09-15T22:34:47.677534+0000","last_became_active":"2024-09-15T22:09:21.448020+0000","last_became_peered":"2024-09-15T22:09:21.448020+0000","last_unstale":"2024-09-15T22:34:47.677534+0000","last_undegraded":"2024-09-15T22:34:47.677534+0000","last_fullsized":"2024-09-15T22:34:47.677534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3664,"log_dups_size":0,"ondisk_log_size":3664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:05.244676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2728,"num_write_kb":145400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1987","reported_seq":2023,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.135711+0000","last_change":"2024-09-15T22:09:16.401331+0000","last_active":"2024-09-15T22:34:48.135711+0000","last_peered":"2024-09-15T22:34:48.135711+0000","last_clean":"2024-09-15T22:34:48.135711+0000","last_became_active":"2024-09-15T22:09:16.401040+0000","last_became_peered":"2024-09-15T22:09:16.401040+0000","last_unstale":"2024-09-15T22:34:48.135711+0000","last_undegraded":"2024-09-15T22:34:48.135711+0000","last_fullsized":"2024-09-15T22:34:48.135711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.799831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1992,"num_write_kb":17367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'895","reported_seq":929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.971488+0000","last_change":"2024-09-15T22:09:17.405328+0000","last_active":"2024-09-15T22:34:47.971488+0000","last_peered":"2024-09-15T22:34:47.971488+0000","last_clean":"2024-09-15T22:34:47.971488+0000","last_became_active":"2024-09-15T22:09:17.404772+0000","last_became_peered":"2024-09-15T22:09:17.404772+0000","last_unstale":"2024-09-15T22:34:47.971488+0000","last_undegraded":"2024-09-15T22:34:47.971488+0000","last_fullsized":"2024-09-15T22:34:47.971488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:33.377260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3687","reported_seq":3715,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.161366+0000","last_change":"2024-09-15T22:09:21.458359+0000","last_active":"2024-09-15T22:34:48.161366+0000","last_peered":"2024-09-15T22:34:48.161366+0000","last_clean":"2024-09-15T22:34:48.161366+0000","last_became_active":"2024-09-15T22:09:21.457977+0000","last_became_peered":"2024-09-15T22:09:21.457977+0000","last_unstale":"2024-09-15T22:34:48.161366+0000","last_undegraded":"2024-09-15T22:34:48.161366+0000","last_fullsized":"2024-09-15T22:34:48.161366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3687,"log_dups_size":0,"ondisk_log_size":3687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.055754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2724,"num_write_kb":59138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'900","reported_seq":936,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.980406+0000","last_change":"2024-09-15T22:09:17.405556+0000","last_active":"2024-09-15T22:34:47.980406+0000","last_peered":"2024-09-15T22:34:47.980406+0000","last_clean":"2024-09-15T22:34:47.980406+0000","last_became_active":"2024-09-15T22:09:17.405129+0000","last_became_peered":"2024-09-15T22:09:17.405129+0000","last_unstale":"2024-09-15T22:34:47.980406+0000","last_undegraded":"2024-09-15T22:34:47.980406+0000","last_fullsized":"2024-09-15T22:34:47.980406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'940","reported_seq":976,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.994790+0000","last_change":"2024-09-15T22:09:17.408189+0000","last_active":"2024-09-15T22:34:47.994790+0000","last_peered":"2024-09-15T22:34:47.994790+0000","last_clean":"2024-09-15T22:34:47.994790+0000","last_became_active":"2024-09-15T22:09:17.407877+0000","last_became_peered":"2024-09-15T22:09:17.407877+0000","last_unstale":"2024-09-15T22:34:47.994790+0000","last_undegraded":"2024-09-15T22:34:47.994790+0000","last_fullsized":"2024-09-15T22:34:47.994790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":940,"log_dups_size":0,"ondisk_log_size":940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:02.290840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'881","reported_seq":922,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.995854+0000","last_change":"2024-09-15T22:09:59.534711+0000","last_active":"2024-09-15T22:34:47.995854+0000","last_peered":"2024-09-15T22:34:47.995854+0000","last_clean":"2024-09-15T22:34:47.995854+0000","last_became_active":"2024-09-15T22:09:59.534380+0000","last_became_peered":"2024-09-15T22:09:59.534380+0000","last_unstale":"2024-09-15T22:34:47.995854+0000","last_undegraded":"2024-09-15T22:34:47.995854+0000","last_fullsized":"2024-09-15T22:34:47.995854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:26.642804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'916","reported_seq":952,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.980268+0000","last_change":"2024-09-15T22:09:17.406140+0000","last_active":"2024-09-15T22:34:47.980268+0000","last_peered":"2024-09-15T22:34:47.980268+0000","last_clean":"2024-09-15T22:34:47.980268+0000","last_became_active":"2024-09-15T22:09:17.405142+0000","last_became_peered":"2024-09-15T22:09:17.405142+0000","last_unstale":"2024-09-15T22:34:47.980268+0000","last_undegraded":"2024-09-15T22:34:47.980268+0000","last_fullsized":"2024-09-15T22:34:47.980268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":916,"log_dups_size":0,"ondisk_log_size":916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:17.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'885","reported_seq":920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.974935+0000","last_change":"2024-09-15T22:09:17.411027+0000","last_active":"2024-09-15T22:34:47.974935+0000","last_peered":"2024-09-15T22:34:47.974935+0000","last_clean":"2024-09-15T22:34:47.974935+0000","last_became_active":"2024-09-15T22:09:17.408913+0000","last_became_peered":"2024-09-15T22:09:17.408913+0000","last_unstale":"2024-09-15T22:34:47.974935+0000","last_undegraded":"2024-09-15T22:34:47.974935+0000","last_fullsized":"2024-09-15T22:34:47.974935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:34.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'886","reported_seq":921,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.972194+0000","last_change":"2024-09-15T22:09:17.401385+0000","last_active":"2024-09-15T22:34:47.972194+0000","last_peered":"2024-09-15T22:34:47.972194+0000","last_clean":"2024-09-15T22:34:47.972194+0000","last_became_active":"2024-09-15T22:09:17.400916+0000","last_became_peered":"2024-09-15T22:09:17.400916+0000","last_unstale":"2024-09-15T22:34:47.972194+0000","last_undegraded":"2024-09-15T22:34:47.972194+0000","last_fullsized":"2024-09-15T22:34:47.972194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:31.994148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'934","reported_seq":969,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.003834+0000","last_change":"2024-09-15T22:09:17.405622+0000","last_active":"2024-09-15T22:34:48.003834+0000","last_peered":"2024-09-15T22:34:48.003834+0000","last_clean":"2024-09-15T22:34:48.003834+0000","last_became_active":"2024-09-15T22:09:17.405319+0000","last_became_peered":"2024-09-15T22:09:17.405319+0000","last_unstale":"2024-09-15T22:34:48.003834+0000","last_undegraded":"2024-09-15T22:34:48.003834+0000","last_fullsized":"2024-09-15T22:34:48.003834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'869","reported_seq":904,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.971623+0000","last_change":"2024-09-15T22:09:17.409317+0000","last_active":"2024-09-15T22:34:47.971623+0000","last_peered":"2024-09-15T22:34:47.971623+0000","last_clean":"2024-09-15T22:34:47.971623+0000","last_became_active":"2024-09-15T22:09:17.408949+0000","last_became_peered":"2024-09-15T22:09:17.408949+0000","last_unstale":"2024-09-15T22:34:47.971623+0000","last_undegraded":"2024-09-15T22:34:47.971623+0000","last_fullsized":"2024-09-15T22:34:47.971623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'872","reported_seq":907,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.145298+0000","last_change":"2024-09-15T22:09:17.416439+0000","last_active":"2024-09-15T22:34:48.145298+0000","last_peered":"2024-09-15T22:34:48.145298+0000","last_clean":"2024-09-15T22:34:48.145298+0000","last_became_active":"2024-09-15T22:09:17.416170+0000","last_became_peered":"2024-09-15T22:09:17.416170+0000","last_unstale":"2024-09-15T22:34:48.145298+0000","last_undegraded":"2024-09-15T22:34:48.145298+0000","last_fullsized":"2024-09-15T22:34:48.145298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'867","reported_seq":902,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.983659+0000","last_change":"2024-09-15T22:09:17.409471+0000","last_active":"2024-09-15T22:34:47.983659+0000","last_peered":"2024-09-15T22:34:47.983659+0000","last_clean":"2024-09-15T22:34:47.983659+0000","last_became_active":"2024-09-15T22:09:17.408969+0000","last_became_peered":"2024-09-15T22:09:17.408969+0000","last_unstale":"2024-09-15T22:34:47.983659+0000","last_undegraded":"2024-09-15T22:34:47.983659+0000","last_fullsized":"2024-09-15T22:34:47.983659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'894","reported_seq":929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.006416+0000","last_change":"2024-09-15T22:09:17.422118+0000","last_active":"2024-09-15T22:34:48.006416+0000","last_peered":"2024-09-15T22:34:48.006416+0000","last_clean":"2024-09-15T22:34:48.006416+0000","last_became_active":"2024-09-15T22:09:17.421846+0000","last_became_peered":"2024-09-15T22:09:17.421846+0000","last_unstale":"2024-09-15T22:34:48.006416+0000","last_undegraded":"2024-09-15T22:34:48.006416+0000","last_fullsized":"2024-09-15T22:34:48.006416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:34.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'909","reported_seq":944,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.997335+0000","last_change":"2024-09-15T22:09:17.421168+0000","last_active":"2024-09-15T22:34:47.997335+0000","last_peered":"2024-09-15T22:34:47.997335+0000","last_clean":"2024-09-15T22:34:47.997335+0000","last_became_active":"2024-09-15T22:09:17.420849+0000","last_became_peered":"2024-09-15T22:09:17.420849+0000","last_unstale":"2024-09-15T22:34:47.997335+0000","last_undegraded":"2024-09-15T22:34:47.997335+0000","last_fullsized":"2024-09-15T22:34:47.997335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:25.108343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'894","reported_seq":929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.001943+0000","last_change":"2024-09-15T22:09:17.410112+0000","last_active":"2024-09-15T22:34:48.001943+0000","last_peered":"2024-09-15T22:34:48.001943+0000","last_clean":"2024-09-15T22:34:48.001943+0000","last_became_active":"2024-09-15T22:09:17.409837+0000","last_became_peered":"2024-09-15T22:09:17.409837+0000","last_unstale":"2024-09-15T22:34:48.001943+0000","last_undegraded":"2024-09-15T22:34:48.001943+0000","last_fullsized":"2024-09-15T22:34:48.001943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'901","reported_seq":922,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.969763+0000","last_change":"2024-09-15T22:09:59.534976+0000","last_active":"2024-09-15T22:34:47.969763+0000","last_peered":"2024-09-15T22:34:47.969763+0000","last_clean":"2024-09-15T22:34:47.969763+0000","last_became_active":"2024-09-15T22:09:59.534485+0000","last_became_peered":"2024-09-15T22:09:59.534485+0000","last_unstale":"2024-09-15T22:34:47.969763+0000","last_undegraded":"2024-09-15T22:34:47.969763+0000","last_fullsized":"2024-09-15T22:34:47.969763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:42.051025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"27'851","reported_seq":885,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.971112+0000","last_change":"2024-09-15T22:09:17.401680+0000","last_active":"2024-09-15T22:34:47.971112+0000","last_peered":"2024-09-15T22:34:47.971112+0000","last_clean":"2024-09-15T22:34:47.971112+0000","last_became_active":"2024-09-15T22:09:17.401413+0000","last_became_peered":"2024-09-15T22:09:17.401413+0000","last_unstale":"2024-09-15T22:34:47.971112+0000","last_undegraded":"2024-09-15T22:34:47.971112+0000","last_fullsized":"2024-09-15T22:34:47.971112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:04.007901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'922","reported_seq":942,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.968907+0000","last_change":"2024-09-15T22:09:59.528330+0000","last_active":"2024-09-15T22:34:47.968907+0000","last_peered":"2024-09-15T22:34:47.968907+0000","last_clean":"2024-09-15T22:34:47.968907+0000","last_became_active":"2024-09-15T22:09:59.528000+0000","last_became_peered":"2024-09-15T22:09:59.528000+0000","last_unstale":"2024-09-15T22:34:47.968907+0000","last_undegraded":"2024-09-15T22:34:47.968907+0000","last_fullsized":"2024-09-15T22:34:47.968907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:15.431072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"27'882","reported_seq":916,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.993791+0000","last_change":"2024-09-15T22:09:17.411524+0000","last_active":"2024-09-15T22:34:47.993791+0000","last_peered":"2024-09-15T22:34:47.993791+0000","last_clean":"2024-09-15T22:34:47.993791+0000","last_became_active":"2024-09-15T22:09:17.411244+0000","last_became_peered":"2024-09-15T22:09:17.411244+0000","last_unstale":"2024-09-15T22:34:47.993791+0000","last_undegraded":"2024-09-15T22:34:47.993791+0000","last_fullsized":"2024-09-15T22:34:47.993791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'910","reported_seq":944,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.983245+0000","last_change":"2024-09-15T22:09:17.409933+0000","last_active":"2024-09-15T22:34:47.983245+0000","last_peered":"2024-09-15T22:34:47.983245+0000","last_clean":"2024-09-15T22:34:47.983245+0000","last_became_active":"2024-09-15T22:09:17.409681+0000","last_became_peered":"2024-09-15T22:09:17.409681+0000","last_unstale":"2024-09-15T22:34:47.983245+0000","last_undegraded":"2024-09-15T22:34:47.983245+0000","last_fullsized":"2024-09-15T22:34:47.983245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:37.130999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'858","reported_seq":892,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.974080+0000","last_change":"2024-09-15T22:09:17.403522+0000","last_active":"2024-09-15T22:34:47.974080+0000","last_peered":"2024-09-15T22:34:47.974080+0000","last_clean":"2024-09-15T22:34:47.974080+0000","last_became_active":"2024-09-15T22:09:17.403220+0000","last_became_peered":"2024-09-15T22:09:17.403220+0000","last_unstale":"2024-09-15T22:34:47.974080+0000","last_undegraded":"2024-09-15T22:34:47.974080+0000","last_fullsized":"2024-09-15T22:34:47.974080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:01.208798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'870","reported_seq":904,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.980323+0000","last_change":"2024-09-15T22:09:17.400537+0000","last_active":"2024-09-15T22:34:47.980323+0000","last_peered":"2024-09-15T22:34:47.980323+0000","last_clean":"2024-09-15T22:34:47.980323+0000","last_became_active":"2024-09-15T22:09:17.400288+0000","last_became_peered":"2024-09-15T22:09:17.400288+0000","last_unstale":"2024-09-15T22:34:47.980323+0000","last_undegraded":"2024-09-15T22:34:47.980323+0000","last_fullsized":"2024-09-15T22:34:47.980323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'857","reported_seq":891,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.984489+0000","last_change":"2024-09-15T22:09:17.404318+0000","last_active":"2024-09-15T22:34:47.984489+0000","last_peered":"2024-09-15T22:34:47.984489+0000","last_clean":"2024-09-15T22:34:47.984489+0000","last_became_active":"2024-09-15T22:09:17.404038+0000","last_became_peered":"2024-09-15T22:09:17.404038+0000","last_unstale":"2024-09-15T22:34:47.984489+0000","last_undegraded":"2024-09-15T22:34:47.984489+0000","last_fullsized":"2024-09-15T22:34:47.984489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:04.314746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'885","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.005482+0000","last_change":"2024-09-15T22:09:17.415645+0000","last_active":"2024-09-15T22:34:48.005482+0000","last_peered":"2024-09-15T22:34:48.005482+0000","last_clean":"2024-09-15T22:34:48.005482+0000","last_became_active":"2024-09-15T22:09:17.415354+0000","last_became_peered":"2024-09-15T22:09:17.415354+0000","last_unstale":"2024-09-15T22:34:48.005482+0000","last_undegraded":"2024-09-15T22:34:48.005482+0000","last_fullsized":"2024-09-15T22:34:48.005482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'874","reported_seq":908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.004288+0000","last_change":"2024-09-15T22:09:17.415171+0000","last_active":"2024-09-15T22:34:48.004288+0000","last_peered":"2024-09-15T22:34:48.004288+0000","last_clean":"2024-09-15T22:34:48.004288+0000","last_became_active":"2024-09-15T22:09:17.414875+0000","last_became_peered":"2024-09-15T22:09:17.414875+0000","last_unstale":"2024-09-15T22:34:48.004288+0000","last_undegraded":"2024-09-15T22:34:48.004288+0000","last_fullsized":"2024-09-15T22:34:48.004288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'913","reported_seq":947,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.006168+0000","last_change":"2024-09-15T22:09:17.420121+0000","last_active":"2024-09-15T22:34:48.006168+0000","last_peered":"2024-09-15T22:34:48.006168+0000","last_clean":"2024-09-15T22:34:48.006168+0000","last_became_active":"2024-09-15T22:09:17.419854+0000","last_became_peered":"2024-09-15T22:09:17.419854+0000","last_unstale":"2024-09-15T22:34:48.006168+0000","last_undegraded":"2024-09-15T22:34:48.006168+0000","last_fullsized":"2024-09-15T22:34:48.006168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":913,"log_dups_size":0,"ondisk_log_size":913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:41.421190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'862","reported_seq":896,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.992262+0000","last_change":"2024-09-15T22:09:17.414316+0000","last_active":"2024-09-15T22:34:47.992262+0000","last_peered":"2024-09-15T22:34:47.992262+0000","last_clean":"2024-09-15T22:34:47.992262+0000","last_became_active":"2024-09-15T22:09:17.414020+0000","last_became_peered":"2024-09-15T22:09:17.414020+0000","last_unstale":"2024-09-15T22:34:47.992262+0000","last_undegraded":"2024-09-15T22:34:47.992262+0000","last_fullsized":"2024-09-15T22:34:47.992262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'898","reported_seq":932,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.979726+0000","last_change":"2024-09-15T22:09:17.404509+0000","last_active":"2024-09-15T22:34:47.979726+0000","last_peered":"2024-09-15T22:34:47.979726+0000","last_clean":"2024-09-15T22:34:47.979726+0000","last_became_active":"2024-09-15T22:09:17.404181+0000","last_became_peered":"2024-09-15T22:09:17.404181+0000","last_unstale":"2024-09-15T22:34:47.979726+0000","last_undegraded":"2024-09-15T22:34:47.979726+0000","last_fullsized":"2024-09-15T22:34:47.979726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:22.003479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'835","reported_seq":869,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.004866+0000","last_change":"2024-09-15T22:09:17.414252+0000","last_active":"2024-09-15T22:34:48.004866+0000","last_peered":"2024-09-15T22:34:48.004866+0000","last_clean":"2024-09-15T22:34:48.004866+0000","last_became_active":"2024-09-15T22:09:17.413987+0000","last_became_peered":"2024-09-15T22:09:17.413987+0000","last_unstale":"2024-09-15T22:34:48.004866+0000","last_undegraded":"2024-09-15T22:34:48.004866+0000","last_fullsized":"2024-09-15T22:34:48.004866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'918","reported_seq":952,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.002775+0000","last_change":"2024-09-15T22:09:17.399744+0000","last_active":"2024-09-15T22:34:48.002775+0000","last_peered":"2024-09-15T22:34:48.002775+0000","last_clean":"2024-09-15T22:34:48.002775+0000","last_became_active":"2024-09-15T22:09:17.399470+0000","last_became_peered":"2024-09-15T22:09:17.399470+0000","last_unstale":"2024-09-15T22:34:48.002775+0000","last_undegraded":"2024-09-15T22:34:48.002775+0000","last_fullsized":"2024-09-15T22:34:48.002775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:04.868244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'877","reported_seq":899,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.973047+0000","last_change":"2024-09-15T22:09:59.804042+0000","last_active":"2024-09-15T22:34:47.973047+0000","last_peered":"2024-09-15T22:34:47.973047+0000","last_clean":"2024-09-15T22:34:47.973047+0000","last_became_active":"2024-09-15T22:09:59.803657+0000","last_became_peered":"2024-09-15T22:09:59.803657+0000","last_unstale":"2024-09-15T22:34:47.973047+0000","last_undegraded":"2024-09-15T22:34:47.973047+0000","last_fullsized":"2024-09-15T22:34:47.973047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'928","reported_seq":964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.967618+0000","last_change":"2024-09-15T22:09:17.404558+0000","last_active":"2024-09-15T22:34:47.967618+0000","last_peered":"2024-09-15T22:34:47.967618+0000","last_clean":"2024-09-15T22:34:47.967618+0000","last_became_active":"2024-09-15T22:09:17.404301+0000","last_became_peered":"2024-09-15T22:09:17.404301+0000","last_unstale":"2024-09-15T22:34:47.967618+0000","last_undegraded":"2024-09-15T22:34:47.967618+0000","last_fullsized":"2024-09-15T22:34:47.967618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'838","reported_seq":874,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.968650+0000","last_change":"2024-09-15T22:09:17.402881+0000","last_active":"2024-09-15T22:34:47.968650+0000","last_peered":"2024-09-15T22:34:47.968650+0000","last_clean":"2024-09-15T22:34:47.968650+0000","last_became_active":"2024-09-15T22:09:17.402632+0000","last_became_peered":"2024-09-15T22:09:17.402632+0000","last_unstale":"2024-09-15T22:34:47.968650+0000","last_undegraded":"2024-09-15T22:34:47.968650+0000","last_fullsized":"2024-09-15T22:34:47.968650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:30.142651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'834","reported_seq":870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.002340+0000","last_change":"2024-09-15T22:09:17.403017+0000","last_active":"2024-09-15T22:34:48.002340+0000","last_peered":"2024-09-15T22:34:48.002340+0000","last_clean":"2024-09-15T22:34:48.002340+0000","last_became_active":"2024-09-15T22:09:17.402751+0000","last_became_peered":"2024-09-15T22:09:17.402751+0000","last_unstale":"2024-09-15T22:34:48.002340+0000","last_undegraded":"2024-09-15T22:34:48.002340+0000","last_fullsized":"2024-09-15T22:34:48.002340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:26.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93952,"num_write_kb":3592319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123090,"ondisk_log_size":123090,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56939,"ondisk_log_size":56939,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":248781965,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2930,"num_read_kb":7996,"num_write":96422,"num_write_kb":735145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327397376,"data_stored":497646532,"data_compressed":51440825,"data_compressed_allocated":79159296,"data_compressed_original":249466880,"omap_allocated":0,"internal_metadata":0},"log_size":93516,"ondisk_log_size":93516,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542455,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":548100,"kb_used_data":43636,"kb_used_omap":1,"kb_used_meta":504446,"kb_avail":93823740,"statfs":{"total":96636764160,"available":96075509760,"internally_reserved":0,"allocated":44683264,"data_stored":67817371,"data_compressed":6954037,"data_compressed_allocated":10792960,"data_compressed_original":34103296,"omap_allocated":1590,"internal_metadata":516553162},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542455,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":562988,"kb_used_data":44636,"kb_used_omap":1,"kb_used_meta":518334,"kb_avail":93808852,"statfs":{"total":96636764160,"available":96060264448,"internally_reserved":0,"allocated":45707264,"data_stored":69135013,"data_compressed":7128351,"data_compressed_allocated":10952704,"data_compressed_original":34557952,"omap_allocated":1594,"internal_metadata":530774470},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542456,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":592620,"kb_used_data":61852,"kb_used_omap":1,"kb_used_meta":530750,"kb_avail":93779220,"statfs":{"total":96636764160,"available":96029921280,"internally_reserved":0,"allocated":63336448,"data_stored":97903198,"data_compressed":10447326,"data_compressed_allocated":15986688,"data_compressed_original":50728960,"omap_allocated":1594,"internal_metadata":543488454},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542457,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":450656,"kb_used_data":26640,"kb_used_omap":1,"kb_used_meta":423998,"kb_avail":93921184,"statfs":{"total":96636764160,"available":96175292416,"internally_reserved":0,"allocated":27279360,"data_stored":42060723,"data_compressed":4480082,"data_compressed_allocated":6909952,"data_compressed_original":21872640,"omap_allocated":1595,"internal_metadata":434174405},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542457,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":571996,"kb_used_data":41100,"kb_used_omap":1,"kb_used_meta":530878,"kb_avail":93799844,"statfs":{"total":96636764160,"available":96051040256,"internally_reserved":0,"allocated":42086400,"data_stored":63032789,"data_compressed":6347263,"data_compressed_allocated":9764864,"data_compressed_original":30887936,"omap_allocated":1593,"internal_metadata":543619527},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":336252,"kb_used_data":30188,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94035588,"statfs":{"total":96636764160,"available":96292442112,"internally_reserved":0,"allocated":30912512,"data_stored":46254901,"data_compressed":4726192,"data_compressed_allocated":7282688,"data_compressed_original":22794240,"omap_allocated":1592,"internal_metadata":313391560},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542456,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":399260,"kb_used_data":25228,"kb_used_omap":1,"kb_used_meta":374014,"kb_avail":93972580,"statfs":{"total":96636764160,"available":96227921920,"internally_reserved":0,"allocated":25833472,"data_stored":38457299,"data_compressed":3734837,"data_compressed_allocated":5775360,"data_compressed_original":18583552,"omap_allocated":1595,"internal_metadata":382990789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575161,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":657404,"kb_used_data":48812,"kb_used_omap":1,"kb_used_meta":608574,"kb_avail":93714436,"statfs":{"total":96636764160,"available":95963582464,"internally_reserved":0,"allocated":49983488,"data_stored":75106430,"data_compressed":7687781,"data_compressed_allocated":11784192,"data_compressed_original":37085184,"omap_allocated":1594,"internal_metadata":623180230},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25481216,"data_stored":37749374,"data_compressed":3702315,"data_compressed_allocated":5730304,"data_compressed_original":18010112,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49696768,"data_stored":74988873,"data_compressed":7687781,"data_compressed_allocated":11784192,"data_compressed_original":37085184,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30625792,"data_stored":46137344,"data_compressed":4726192,"data_compressed_allocated":7282688,"data_compressed_original":22794240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":41799680,"data_stored":62915232,"data_compressed":6347263,"data_compressed_allocated":9764864,"data_compressed_original":30887936,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26992640,"data_stored":41943166,"data_compressed":4480082,"data_compressed_allocated":6909952,"data_compressed_original":21872640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":63049728,"data_stored":97785641,"data_compressed":10447326,"data_compressed_allocated":15986688,"data_compressed_original":50728960,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45420544,"data_stored":69017456,"data_compressed":7128351,"data_compressed_allocated":10952704,"data_compressed_original":34557952,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":44331008,"data_stored":67109446,"data_compressed":6921515,"data_compressed_allocated":10747904,"data_compressed_original":33529856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:34:54.974 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:34:54.974 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:34:55.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.109+0000 7fc373a0e640 1 Processor -- start 2024-09-15T22:34:55.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.109+0000 7fc373a0e640 1 -- start start 2024-09-15T22:34:55.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.110+0000 7fc373a0e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc36c0b4fb0 0x7fc36c074e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:55.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.110+0000 7fc373a0e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc36c0b6a50 0x7fc36c075380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:55.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.110+0000 7fc373a0e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc36c0b5390 con 0x7fc36c141a30 2024-09-15T22:34:55.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.110+0000 7fc373a0e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc36c0b62e0 con 0x7fc36c0b4fb0 2024-09-15T22:34:55.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.110+0000 7fc373a0e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc36c1486d0 con 0x7fc36c0b6a50 2024-09-15T22:34:55.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.110+0000 7fc371fab640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc36c141a30 0x7fc36c141ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60580/0 (socket says 172.21.15.78:60580) 2024-09-15T22:34:55.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.110+0000 7fc371fab640 1 -- 172.21.15.78:0/2047619599 learned_addr learned my addr 172.21.15.78:0/2047619599 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:34:55.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.110+0000 7fc370fa9640 1 --2- 172.21.15.78:0/2047619599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc36c0b6a50 0x7fc36c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:55.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.110+0000 7fc3717aa640 1 --2- 172.21.15.78:0/2047619599 >> v2:172.21.15.175:3300/0 conn(0x7fc36c0b4fb0 0x7fc36c074e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:55.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.110+0000 7fc363fff640 1 -- 172.21.15.78:0/2047619599 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2893861536 0 0) 0x7fc36c0b5390 con 0x7fc36c141a30 2024-09-15T22:34:55.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.110+0000 7fc363fff640 1 -- 172.21.15.78:0/2047619599 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc358003520 con 0x7fc36c141a30 2024-09-15T22:34:55.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.111+0000 7fc3717aa640 1 -- 172.21.15.78:0/2047619599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc36c0b6a50 msgr2=0x7fc36c075380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:55.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.111+0000 7fc3717aa640 1 --2- 172.21.15.78:0/2047619599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc36c0b6a50 0x7fc36c075380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.111+0000 7fc3717aa640 1 -- 172.21.15.78:0/2047619599 >> v1:172.21.15.78:6789/0 conn(0x7fc36c141a30 legacy=0x7fc36c141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:55.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.111+0000 7fc3717aa640 1 -- 172.21.15.78:0/2047619599 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36c1489b0 con 0x7fc36c0b4fb0 2024-09-15T22:34:55.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.111+0000 7fc370fa9640 1 --2- 172.21.15.78:0/2047619599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc36c0b6a50 0x7fc36c075380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:34:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.111+0000 7fc3717aa640 1 --2- 172.21.15.78:0/2047619599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc36c0b4fb0 0x7fc36c074e40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3680097a0 tx=0x7fc36802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6dad65f76f83292 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.111+0000 7fc363fff640 1 -- 172.21.15.78:0/2047619599 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368037070 con 0x7fc36c0b4fb0 2024-09-15T22:34:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.111+0000 7fc363fff640 1 -- 172.21.15.78:0/2047619599 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc368032440 con 0x7fc36c0b4fb0 2024-09-15T22:34:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.111+0000 7fc363fff640 1 -- 172.21.15.78:0/2047619599 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3680327f0 con 0x7fc36c0b4fb0 2024-09-15T22:34:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.112+0000 7fc373a0e640 1 -- 172.21.15.78:0/2047619599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc36c0b4fb0 msgr2=0x7fc36c074e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.112+0000 7fc373a0e640 1 --2- 172.21.15.78:0/2047619599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc36c0b4fb0 0x7fc36c074e40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3680097a0 tx=0x7fc36802a180 comp rx=0 tx=0).stop 2024-09-15T22:34:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.112+0000 7fc373a0e640 1 -- 172.21.15.78:0/2047619599 shutdown_connections 2024-09-15T22:34:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.112+0000 7fc373a0e640 1 --2- 172.21.15.78:0/2047619599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc36c0b6a50 0x7fc36c075380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.112+0000 7fc373a0e640 1 --2- 172.21.15.78:0/2047619599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc36c0b4fb0 0x7fc36c074e40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.112+0000 7fc373a0e640 1 -- 172.21.15.78:0/2047619599 >> 172.21.15.78:0/2047619599 conn(0x7fc36c09c0f0 msgr2=0x7fc36c09c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.112+0000 7fc373a0e640 1 -- 172.21.15.78:0/2047619599 shutdown_connections 2024-09-15T22:34:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.112+0000 7fc373a0e640 1 -- 172.21.15.78:0/2047619599 wait complete. 2024-09-15T22:34:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.113+0000 7fc373a0e640 1 Processor -- start 2024-09-15T22:34:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.113+0000 7fc373a0e640 1 -- start start 2024-09-15T22:34:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc373a0e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc36c0b4fb0 0x7fc36c1443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc373a0e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc36c141a30 0x7fc36c1e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc373a0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc36c1e1080 0x7fc36c142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc373a0e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c1482c0 con 0x7fc36c1e1080 2024-09-15T22:34:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc373a0e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c09ce80 con 0x7fc36c141a30 2024-09-15T22:34:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc373a0e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc36c148440 con 0x7fc36c0b4fb0 2024-09-15T22:34:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc371fab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc36c1e1080 0x7fc36c142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc3717aa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc36c0b4fb0 0x7fc36c1443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc371fab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc36c1e1080 0x7fc36c142be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54364/0 (socket says 172.21.15.78:54364) 2024-09-15T22:34:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc371fab640 1 -- 172.21.15.78:0/2174092152 learned_addr learned my addr 172.21.15.78:0/2174092152 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc370fa9640 1 --2- 172.21.15.78:0/2174092152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc36c141a30 0x7fc36c1e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc371fab640 1 -- 172.21.15.78:0/2174092152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc36c0b4fb0 msgr2=0x7fc36c1443c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc371fab640 1 --2- 172.21.15.78:0/2174092152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc36c0b4fb0 0x7fc36c1443c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc371fab640 1 -- 172.21.15.78:0/2174092152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc36c141a30 msgr2=0x7fc36c1e0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc371fab640 1 --2- 172.21.15.78:0/2174092152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc36c141a30 0x7fc36c1e0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc371fab640 1 -- 172.21.15.78:0/2174092152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36c144900 con 0x7fc36c1e1080 2024-09-15T22:34:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc371fab640 1 --2- 172.21.15.78:0/2174092152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc36c1e1080 0x7fc36c142be0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc36400cad0 tx=0x7fc36400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc361ffb640 1 -- 172.21.15.78:0/2174092152 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc364017070 con 0x7fc36c1e1080 2024-09-15T22:34:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc361ffb640 1 -- 172.21.15.78:0/2174092152 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36400ac30 con 0x7fc36c1e1080 2024-09-15T22:34:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc373a0e640 1 -- 172.21.15.78:0/2174092152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36c142700 con 0x7fc36c1e1080 2024-09-15T22:34:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.114+0000 7fc361ffb640 1 -- 172.21.15.78:0/2174092152 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc364012400 con 0x7fc36c1e1080 2024-09-15T22:34:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.115+0000 7fc373a0e640 1 -- 172.21.15.78:0/2174092152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc36c144e90 con 0x7fc36c1e1080 2024-09-15T22:34:55.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.116+0000 7fc373a0e640 1 -- 172.21.15.78:0/2174092152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc36c075d80 con 0x7fc36c1e1080 2024-09-15T22:34:55.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.116+0000 7fc361ffb640 1 -- 172.21.15.78:0/2174092152 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc36401a070 con 0x7fc36c1e1080 2024-09-15T22:34:55.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.116+0000 7fc361ffb640 1 --2- 172.21.15.78:0/2174092152 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc35006c2b0 0x7fc35006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:55.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.116+0000 7fc361ffb640 1 -- 172.21.15.78:0/2174092152 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7fc36408b590 con 0x7fc36c1e1080 2024-09-15T22:34:55.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.116+0000 7fc3717aa640 1 --2- 172.21.15.78:0/2174092152 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc35006c2b0 0x7fc35006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:55.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.117+0000 7fc3717aa640 1 --2- 172.21.15.78:0/2174092152 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc35006c2b0 0x7fc35006e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc368034000 tx=0x7fc36802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:55.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.121+0000 7fc361ffb640 1 -- 172.21.15.78:0/2174092152 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc364059260 con 0x7fc36c1e1080 2024-09-15T22:34:55.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.286+0000 7fc373a0e640 1 -- 172.21.15.78:0/2174092152 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc36c141ea0 con 0x7fc35006c2b0 2024-09-15T22:34:55.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.293+0000 7fc361ffb640 1 -- 172.21.15.78:0/2174092152 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335299 (secure 0 0 0) 0x7fc36c141ea0 con 0x7fc35006c2b0 2024-09-15T22:34:55.297 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:34:55.299 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-15T22:34:55.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.296+0000 7fc373a0e640 1 -- 172.21.15.78:0/2174092152 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc35006c2b0 msgr2=0x7fc35006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:55.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.296+0000 7fc373a0e640 1 --2- 172.21.15.78:0/2174092152 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc35006c2b0 0x7fc35006e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc368034000 tx=0x7fc36802e000 comp rx=0 tx=0).stop 2024-09-15T22:34:55.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.296+0000 7fc373a0e640 1 -- 172.21.15.78:0/2174092152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc36c1e1080 msgr2=0x7fc36c142be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:55.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.296+0000 7fc373a0e640 1 --2- 172.21.15.78:0/2174092152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc36c1e1080 0x7fc36c142be0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc36400cad0 tx=0x7fc36400cf90 comp rx=0 tx=0).stop 2024-09-15T22:34:55.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.296+0000 7fc373a0e640 1 -- 172.21.15.78:0/2174092152 shutdown_connections 2024-09-15T22:34:55.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.297+0000 7fc373a0e640 1 --2- 172.21.15.78:0/2174092152 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc35006c2b0 0x7fc35006e770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.297+0000 7fc373a0e640 1 --2- 172.21.15.78:0/2174092152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc36c1e1080 0x7fc36c142be0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.297+0000 7fc373a0e640 1 --2- 172.21.15.78:0/2174092152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc36c141a30 0x7fc36c1e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.297+0000 7fc373a0e640 1 --2- 172.21.15.78:0/2174092152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc36c0b4fb0 0x7fc36c1443c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.297+0000 7fc373a0e640 1 -- 172.21.15.78:0/2174092152 >> 172.21.15.78:0/2174092152 conn(0x7fc36c09c0f0 msgr2=0x7fc36c140e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:55.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.297+0000 7fc373a0e640 1 -- 172.21.15.78:0/2174092152 shutdown_connections 2024-09-15T22:34:55.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.297+0000 7fc373a0e640 1 -- 172.21.15.78:0/2174092152 wait complete. 2024-09-15T22:34:55.308 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":795,"stamp":"2024-09-15T22:34:54.300666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":249372333,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":3046,"num_read_kb":8096,"num_write":191653,"num_write_kb":4329880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273662,"ondisk_log_size":273662,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4119276,"kb_used_data":322092,"kb_used_omap":12,"kb_used_meta":3797043,"kb_avail":750855444,"statfs":{"total":773094113280,"available":768875974656,"internally_reserved":0,"allocated":329822208,"data_stored":499767724,"data_compressed":51505869,"data_compressed_allocated":79249408,"data_compressed_original":250613760,"omap_allocated":12747,"internal_metadata":3888172597},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-209229419,"num_objects":-1368,"num_object_clones":0,"num_object_copies":-4128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1368,"num_whiteouts":0,"num_read":19,"num_read_kb":113,"num_write":2168,"num_write_kb":18787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-113,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003093"},"pg_stats":[{"pgid":"2.1f","version":"27'1783","reported_seq":1821,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.144511+0000","last_change":"2024-09-15T22:09:16.403008+0000","last_active":"2024-09-15T22:34:48.144511+0000","last_peered":"2024-09-15T22:34:48.144511+0000","last_clean":"2024-09-15T22:34:48.144511+0000","last_became_active":"2024-09-15T22:09:16.402725+0000","last_became_peered":"2024-09-15T22:09:16.402725+0000","last_unstale":"2024-09-15T22:34:48.144511+0000","last_undegraded":"2024-09-15T22:34:48.144511+0000","last_fullsized":"2024-09-15T22:34:48.144511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:32.659951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1792,"num_write_kb":13194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'869","reported_seq":905,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.157563+0000","last_change":"2024-09-15T22:09:17.400698+0000","last_active":"2024-09-15T22:34:48.157563+0000","last_peered":"2024-09-15T22:34:48.157563+0000","last_clean":"2024-09-15T22:34:48.157563+0000","last_became_active":"2024-09-15T22:09:17.400428+0000","last_became_peered":"2024-09-15T22:09:17.400428+0000","last_unstale":"2024-09-15T22:34:48.157563+0000","last_undegraded":"2024-09-15T22:34:48.157563+0000","last_fullsized":"2024-09-15T22:34:48.157563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:15.431072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4221","reported_seq":4249,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.657041+0000","last_change":"2024-09-15T22:09:21.449737+0000","last_active":"2024-09-15T22:34:47.657041+0000","last_peered":"2024-09-15T22:34:47.657041+0000","last_clean":"2024-09-15T22:34:47.657041+0000","last_became_active":"2024-09-15T22:09:21.449376+0000","last_became_peered":"2024-09-15T22:09:21.449376+0000","last_unstale":"2024-09-15T22:34:47.657041+0000","last_undegraded":"2024-09-15T22:34:47.657041+0000","last_fullsized":"2024-09-15T22:34:47.657041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4221,"log_dups_size":0,"ondisk_log_size":4221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:13.943283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3323,"num_write_kb":95202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3536","reported_seq":3574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.121078+0000","last_change":"2024-09-15T22:09:16.407728+0000","last_active":"2024-09-15T22:34:48.121078+0000","last_peered":"2024-09-15T22:34:48.121078+0000","last_clean":"2024-09-15T22:34:48.121078+0000","last_became_active":"2024-09-15T22:09:16.407458+0000","last_became_peered":"2024-09-15T22:09:16.407458+0000","last_unstale":"2024-09-15T22:34:48.121078+0000","last_undegraded":"2024-09-15T22:34:48.121078+0000","last_fullsized":"2024-09-15T22:34:48.121078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3536,"log_dups_size":0,"ondisk_log_size":3536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":30404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'865","reported_seq":901,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.000407+0000","last_change":"2024-09-15T22:09:17.415311+0000","last_active":"2024-09-15T22:34:48.000407+0000","last_peered":"2024-09-15T22:34:48.000407+0000","last_clean":"2024-09-15T22:34:48.000407+0000","last_became_active":"2024-09-15T22:09:17.414966+0000","last_became_peered":"2024-09-15T22:09:17.414966+0000","last_unstale":"2024-09-15T22:34:48.000407+0000","last_undegraded":"2024-09-15T22:34:48.000407+0000","last_fullsized":"2024-09-15T22:34:48.000407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":865,"log_dups_size":0,"ondisk_log_size":865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'3714","reported_seq":3742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.633395+0000","last_change":"2024-09-15T22:09:21.454087+0000","last_active":"2024-09-15T22:34:47.633395+0000","last_peered":"2024-09-15T22:34:47.633395+0000","last_clean":"2024-09-15T22:34:47.633395+0000","last_became_active":"2024-09-15T22:09:21.453701+0000","last_became_peered":"2024-09-15T22:09:21.453701+0000","last_unstale":"2024-09-15T22:34:47.633395+0000","last_undegraded":"2024-09-15T22:34:47.633395+0000","last_fullsized":"2024-09-15T22:34:47.633395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3714,"log_dups_size":0,"ondisk_log_size":3714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:29.697947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2789,"num_write_kb":63634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'4509","reported_seq":4545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.133997+0000","last_change":"2024-09-15T22:09:16.405902+0000","last_active":"2024-09-15T22:34:48.133997+0000","last_peered":"2024-09-15T22:34:48.133997+0000","last_clean":"2024-09-15T22:34:48.133997+0000","last_became_active":"2024-09-15T22:09:16.405626+0000","last_became_peered":"2024-09-15T22:09:16.405626+0000","last_unstale":"2024-09-15T22:34:48.133997+0000","last_undegraded":"2024-09-15T22:34:48.133997+0000","last_fullsized":"2024-09-15T22:34:48.133997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4509,"log_dups_size":0,"ondisk_log_size":4509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:03.001838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4510,"num_write_kb":35033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'918","reported_seq":957,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.992605+0000","last_change":"2024-09-15T22:09:59.805432+0000","last_active":"2024-09-15T22:34:47.992605+0000","last_peered":"2024-09-15T22:34:47.992605+0000","last_clean":"2024-09-15T22:34:47.992605+0000","last_became_active":"2024-09-15T22:09:59.804970+0000","last_became_peered":"2024-09-15T22:09:59.804970+0000","last_unstale":"2024-09-15T22:34:47.992605+0000","last_undegraded":"2024-09-15T22:34:47.992605+0000","last_fullsized":"2024-09-15T22:34:47.992605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:41.901744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3619","reported_seq":3647,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.710065+0000","last_change":"2024-09-15T22:09:21.455260+0000","last_active":"2024-09-15T22:34:47.710065+0000","last_peered":"2024-09-15T22:34:47.710065+0000","last_clean":"2024-09-15T22:34:47.710065+0000","last_became_active":"2024-09-15T22:09:21.454850+0000","last_became_peered":"2024-09-15T22:09:21.454850+0000","last_unstale":"2024-09-15T22:34:47.710065+0000","last_undegraded":"2024-09-15T22:34:47.710065+0000","last_fullsized":"2024-09-15T22:34:47.710065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3619,"log_dups_size":0,"ondisk_log_size":3619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:08.904123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2687,"num_write_kb":123513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'2007","reported_seq":2043,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:35.617698+0000","last_change":"2024-09-15T22:09:16.407670+0000","last_active":"2024-09-15T22:34:35.617698+0000","last_peered":"2024-09-15T22:34:35.617698+0000","last_clean":"2024-09-15T22:34:35.617698+0000","last_became_active":"2024-09-15T22:09:16.407364+0000","last_became_peered":"2024-09-15T22:09:16.407364+0000","last_unstale":"2024-09-15T22:34:35.617698+0000","last_undegraded":"2024-09-15T22:34:35.617698+0000","last_fullsized":"2024-09-15T22:34:35.617698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2007,"log_dups_size":0,"ondisk_log_size":2007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:01.284777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2007,"num_write_kb":17393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'890","reported_seq":924,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.007199+0000","last_change":"2024-09-15T22:09:17.408224+0000","last_active":"2024-09-15T22:34:48.007199+0000","last_peered":"2024-09-15T22:34:48.007199+0000","last_clean":"2024-09-15T22:34:48.007199+0000","last_became_active":"2024-09-15T22:09:17.407881+0000","last_became_peered":"2024-09-15T22:09:17.407881+0000","last_unstale":"2024-09-15T22:34:48.007199+0000","last_undegraded":"2024-09-15T22:34:48.007199+0000","last_fullsized":"2024-09-15T22:34:48.007199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":890,"log_dups_size":0,"ondisk_log_size":890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:22.003479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'3863","reported_seq":3891,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.164932+0000","last_change":"2024-09-15T22:09:21.450705+0000","last_active":"2024-09-15T22:34:48.164932+0000","last_peered":"2024-09-15T22:34:48.164932+0000","last_clean":"2024-09-15T22:34:48.164932+0000","last_became_active":"2024-09-15T22:09:21.450265+0000","last_became_peered":"2024-09-15T22:09:21.450265+0000","last_unstale":"2024-09-15T22:34:48.164932+0000","last_undegraded":"2024-09-15T22:34:48.164932+0000","last_fullsized":"2024-09-15T22:34:48.164932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3863,"log_dups_size":0,"ondisk_log_size":3863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:21.477522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3014,"num_write_kb":86107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'883","reported_seq":918,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.970600+0000","last_change":"2024-09-15T22:09:17.410686+0000","last_active":"2024-09-15T22:34:47.970600+0000","last_peered":"2024-09-15T22:34:47.970600+0000","last_clean":"2024-09-15T22:34:47.970600+0000","last_became_active":"2024-09-15T22:09:17.410383+0000","last_became_peered":"2024-09-15T22:09:17.410383+0000","last_unstale":"2024-09-15T22:34:47.970600+0000","last_undegraded":"2024-09-15T22:34:47.970600+0000","last_fullsized":"2024-09-15T22:34:47.970600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'3968","reported_seq":4005,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.155998+0000","last_change":"2024-09-15T22:09:16.405335+0000","last_active":"2024-09-15T22:34:48.155998+0000","last_peered":"2024-09-15T22:34:48.155998+0000","last_clean":"2024-09-15T22:34:48.155998+0000","last_became_active":"2024-09-15T22:09:16.405010+0000","last_became_peered":"2024-09-15T22:09:16.405010+0000","last_unstale":"2024-09-15T22:34:48.155998+0000","last_undegraded":"2024-09-15T22:34:48.155998+0000","last_fullsized":"2024-09-15T22:34:48.155998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3968,"log_dups_size":0,"ondisk_log_size":3968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:00.202736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3969,"num_write_kb":30662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'3504","reported_seq":3540,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.346344+0000","last_change":"2024-09-15T22:09:59.534148+0000","last_active":"2024-09-15T22:34:47.346344+0000","last_peered":"2024-09-15T22:34:47.346344+0000","last_clean":"2024-09-15T22:34:47.346344+0000","last_became_active":"2024-09-15T22:09:59.533675+0000","last_became_peered":"2024-09-15T22:09:59.533675+0000","last_unstale":"2024-09-15T22:34:47.346344+0000","last_undegraded":"2024-09-15T22:34:47.346344+0000","last_fullsized":"2024-09-15T22:34:47.346344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3504,"log_dups_size":0,"ondisk_log_size":3504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.055754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2557,"num_write_kb":53761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'919","reported_seq":954,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.975733+0000","last_change":"2024-09-15T22:09:17.405327+0000","last_active":"2024-09-15T22:34:47.975733+0000","last_peered":"2024-09-15T22:34:47.975733+0000","last_clean":"2024-09-15T22:34:47.975733+0000","last_became_active":"2024-09-15T22:09:17.405065+0000","last_became_peered":"2024-09-15T22:09:17.405065+0000","last_unstale":"2024-09-15T22:34:47.975733+0000","last_undegraded":"2024-09-15T22:34:47.975733+0000","last_fullsized":"2024-09-15T22:34:47.975733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3442","reported_seq":3479,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.145460+0000","last_change":"2024-09-15T22:09:16.406705+0000","last_active":"2024-09-15T22:34:48.145460+0000","last_peered":"2024-09-15T22:34:48.145460+0000","last_clean":"2024-09-15T22:34:48.145460+0000","last_became_active":"2024-09-15T22:09:16.406454+0000","last_became_peered":"2024-09-15T22:09:16.406454+0000","last_unstale":"2024-09-15T22:34:48.145460+0000","last_undegraded":"2024-09-15T22:34:48.145460+0000","last_fullsized":"2024-09-15T22:34:48.145460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3442,"log_dups_size":0,"ondisk_log_size":3442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:02.444245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3448,"num_write_kb":30365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'4173","reported_seq":4209,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.694112+0000","last_change":"2024-09-15T22:09:59.805673+0000","last_active":"2024-09-15T22:34:47.694112+0000","last_peered":"2024-09-15T22:34:47.694112+0000","last_clean":"2024-09-15T22:34:47.694112+0000","last_became_active":"2024-09-15T22:09:59.805100+0000","last_became_peered":"2024-09-15T22:09:59.805100+0000","last_unstale":"2024-09-15T22:34:47.694112+0000","last_undegraded":"2024-09-15T22:34:47.694112+0000","last_fullsized":"2024-09-15T22:34:47.694112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4173,"log_dups_size":0,"ondisk_log_size":4173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:10.812526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3298,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'955","reported_seq":990,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.982724+0000","last_change":"2024-09-15T22:09:17.399551+0000","last_active":"2024-09-15T22:34:47.982724+0000","last_peered":"2024-09-15T22:34:47.982724+0000","last_clean":"2024-09-15T22:34:47.982724+0000","last_became_active":"2024-09-15T22:09:17.399290+0000","last_became_peered":"2024-09-15T22:09:17.399290+0000","last_unstale":"2024-09-15T22:34:47.982724+0000","last_undegraded":"2024-09-15T22:34:47.982724+0000","last_fullsized":"2024-09-15T22:34:47.982724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2082","reported_seq":2119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.144890+0000","last_change":"2024-09-15T22:09:16.408974+0000","last_active":"2024-09-15T22:34:48.144890+0000","last_peered":"2024-09-15T22:34:48.144890+0000","last_clean":"2024-09-15T22:34:48.144890+0000","last_became_active":"2024-09-15T22:09:16.408691+0000","last_became_peered":"2024-09-15T22:09:16.408691+0000","last_unstale":"2024-09-15T22:34:48.144890+0000","last_undegraded":"2024-09-15T22:34:48.144890+0000","last_fullsized":"2024-09-15T22:34:48.144890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2082,"log_dups_size":0,"ondisk_log_size":2082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:26:32.412274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2101,"num_write_kb":17400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'3631","reported_seq":3660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.474619+0000","last_change":"2024-09-15T22:09:21.458893+0000","last_active":"2024-09-15T22:34:47.474619+0000","last_peered":"2024-09-15T22:34:47.474619+0000","last_clean":"2024-09-15T22:34:47.474619+0000","last_became_active":"2024-09-15T22:09:21.458548+0000","last_became_peered":"2024-09-15T22:09:21.458548+0000","last_unstale":"2024-09-15T22:34:47.474619+0000","last_undegraded":"2024-09-15T22:34:47.474619+0000","last_fullsized":"2024-09-15T22:34:47.474619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3631,"log_dups_size":0,"ondisk_log_size":3631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:29.163692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2705,"num_write_kb":61946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'892","reported_seq":927,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.603569+0000","last_change":"2024-09-15T22:09:17.400823+0000","last_active":"2024-09-15T22:34:47.603569+0000","last_peered":"2024-09-15T22:34:47.603569+0000","last_clean":"2024-09-15T22:34:47.603569+0000","last_became_active":"2024-09-15T22:09:17.400494+0000","last_became_peered":"2024-09-15T22:09:17.400494+0000","last_unstale":"2024-09-15T22:34:47.603569+0000","last_undegraded":"2024-09-15T22:34:47.603569+0000","last_fullsized":"2024-09-15T22:34:47.603569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:02.290840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1674","reported_seq":1711,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.125462+0000","last_change":"2024-09-15T22:09:16.409156+0000","last_active":"2024-09-15T22:34:48.125462+0000","last_peered":"2024-09-15T22:34:48.125462+0000","last_clean":"2024-09-15T22:34:48.125462+0000","last_became_active":"2024-09-15T22:09:16.408603+0000","last_became_peered":"2024-09-15T22:09:16.408603+0000","last_unstale":"2024-09-15T22:34:48.125462+0000","last_undegraded":"2024-09-15T22:34:48.125462+0000","last_fullsized":"2024-09-15T22:34:48.125462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1674,"log_dups_size":0,"ondisk_log_size":1674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:12.245902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1676,"num_write_kb":13088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'3587","reported_seq":3616,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.170565+0000","last_change":"2024-09-15T22:09:21.447940+0000","last_active":"2024-09-15T22:34:48.170565+0000","last_peered":"2024-09-15T22:34:48.170565+0000","last_clean":"2024-09-15T22:34:48.170565+0000","last_became_active":"2024-09-15T22:09:21.447348+0000","last_became_peered":"2024-09-15T22:09:21.447348+0000","last_unstale":"2024-09-15T22:34:48.170565+0000","last_undegraded":"2024-09-15T22:34:48.170565+0000","last_fullsized":"2024-09-15T22:34:48.170565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3587,"log_dups_size":0,"ondisk_log_size":3587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:19.466950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2651,"num_write_kb":118894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'899","reported_seq":934,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.973665+0000","last_change":"2024-09-15T22:09:17.402826+0000","last_active":"2024-09-15T22:34:47.973665+0000","last_peered":"2024-09-15T22:34:47.973665+0000","last_clean":"2024-09-15T22:34:47.973665+0000","last_became_active":"2024-09-15T22:09:17.402585+0000","last_became_peered":"2024-09-15T22:09:17.402585+0000","last_unstale":"2024-09-15T22:34:47.973665+0000","last_undegraded":"2024-09-15T22:34:47.973665+0000","last_fullsized":"2024-09-15T22:34:47.973665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'1634","reported_seq":1671,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.142630+0000","last_change":"2024-09-15T22:09:16.408097+0000","last_active":"2024-09-15T22:34:48.142630+0000","last_peered":"2024-09-15T22:34:48.142630+0000","last_clean":"2024-09-15T22:34:48.142630+0000","last_became_active":"2024-09-15T22:09:16.407657+0000","last_became_peered":"2024-09-15T22:09:16.407657+0000","last_unstale":"2024-09-15T22:34:48.142630+0000","last_undegraded":"2024-09-15T22:34:48.142630+0000","last_fullsized":"2024-09-15T22:34:48.142630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1634,"log_dups_size":0,"ondisk_log_size":1634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":13124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'3592","reported_seq":3622,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.680644+0000","last_change":"2024-09-15T22:09:21.451205+0000","last_active":"2024-09-15T22:34:47.680644+0000","last_peered":"2024-09-15T22:34:47.680644+0000","last_clean":"2024-09-15T22:34:47.680644+0000","last_became_active":"2024-09-15T22:09:21.450731+0000","last_became_peered":"2024-09-15T22:09:21.450731+0000","last_unstale":"2024-09-15T22:34:47.680644+0000","last_undegraded":"2024-09-15T22:34:47.680644+0000","last_fullsized":"2024-09-15T22:34:47.680644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:38.650786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2678,"num_write_kb":64130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'844","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.996996+0000","last_change":"2024-09-15T22:09:17.421690+0000","last_active":"2024-09-15T22:34:47.996996+0000","last_peered":"2024-09-15T22:34:47.996996+0000","last_clean":"2024-09-15T22:34:47.996996+0000","last_became_active":"2024-09-15T22:09:17.421379+0000","last_became_peered":"2024-09-15T22:09:17.421379+0000","last_unstale":"2024-09-15T22:34:47.996996+0000","last_undegraded":"2024-09-15T22:34:47.996996+0000","last_fullsized":"2024-09-15T22:34:47.996996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2976","reported_seq":3013,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.143681+0000","last_change":"2024-09-15T22:09:16.408662+0000","last_active":"2024-09-15T22:34:48.143681+0000","last_peered":"2024-09-15T22:34:48.143681+0000","last_clean":"2024-09-15T22:34:48.143681+0000","last_became_active":"2024-09-15T22:09:16.408068+0000","last_became_peered":"2024-09-15T22:09:16.408068+0000","last_unstale":"2024-09-15T22:34:48.143681+0000","last_undegraded":"2024-09-15T22:34:48.143681+0000","last_fullsized":"2024-09-15T22:34:48.143681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2976,"log_dups_size":0,"ondisk_log_size":2976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:29.217773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5729,"num_write_kb":16111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'3599","reported_seq":3629,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.663354+0000","last_change":"2024-09-15T22:09:21.457447+0000","last_active":"2024-09-15T22:34:47.663354+0000","last_peered":"2024-09-15T22:34:47.663354+0000","last_clean":"2024-09-15T22:34:47.663354+0000","last_became_active":"2024-09-15T22:09:21.457031+0000","last_became_peered":"2024-09-15T22:09:21.457031+0000","last_unstale":"2024-09-15T22:34:47.663354+0000","last_undegraded":"2024-09-15T22:34:47.663354+0000","last_fullsized":"2024-09-15T22:34:47.663354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:45.457068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":57002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'901","reported_seq":937,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.973110+0000","last_change":"2024-09-15T22:09:17.400043+0000","last_active":"2024-09-15T22:34:47.973110+0000","last_peered":"2024-09-15T22:34:47.973110+0000","last_clean":"2024-09-15T22:34:47.973110+0000","last_became_active":"2024-09-15T22:09:17.399815+0000","last_became_peered":"2024-09-15T22:09:17.399815+0000","last_unstale":"2024-09-15T22:34:47.973110+0000","last_undegraded":"2024-09-15T22:34:47.973110+0000","last_fullsized":"2024-09-15T22:34:47.973110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:38.779044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2759","reported_seq":2797,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:20.157772+0000","last_change":"2024-09-15T22:09:16.407483+0000","last_active":"2024-09-15T22:34:20.157772+0000","last_peered":"2024-09-15T22:34:20.157772+0000","last_clean":"2024-09-15T22:34:20.157772+0000","last_became_active":"2024-09-15T22:09:16.407199+0000","last_became_peered":"2024-09-15T22:09:16.407199+0000","last_unstale":"2024-09-15T22:34:20.157772+0000","last_undegraded":"2024-09-15T22:34:20.157772+0000","last_fullsized":"2024-09-15T22:34:20.157772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2759,"log_dups_size":0,"ondisk_log_size":2759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:24.102281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2756,"num_write_kb":21836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'4104","reported_seq":4134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.647277+0000","last_change":"2024-09-15T22:09:21.449620+0000","last_active":"2024-09-15T22:34:47.647277+0000","last_peered":"2024-09-15T22:34:47.647277+0000","last_clean":"2024-09-15T22:34:47.647277+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:34:47.647277+0000","last_undegraded":"2024-09-15T22:34:47.647277+0000","last_fullsized":"2024-09-15T22:34:47.647277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4104,"log_dups_size":0,"ondisk_log_size":4104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:40.690811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3164,"num_write_kb":141390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'867","reported_seq":903,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.005792+0000","last_change":"2024-09-15T22:09:17.414930+0000","last_active":"2024-09-15T22:34:48.005792+0000","last_peered":"2024-09-15T22:34:48.005792+0000","last_clean":"2024-09-15T22:34:48.005792+0000","last_became_active":"2024-09-15T22:09:17.414645+0000","last_became_peered":"2024-09-15T22:09:17.414645+0000","last_unstale":"2024-09-15T22:34:48.005792+0000","last_undegraded":"2024-09-15T22:34:48.005792+0000","last_fullsized":"2024-09-15T22:34:48.005792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:22.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'2263","reported_seq":2301,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.120454+0000","last_change":"2024-09-15T22:09:16.408794+0000","last_active":"2024-09-15T22:34:48.120454+0000","last_peered":"2024-09-15T22:34:48.120454+0000","last_clean":"2024-09-15T22:34:48.120454+0000","last_became_active":"2024-09-15T22:09:16.408530+0000","last_became_peered":"2024-09-15T22:09:16.408530+0000","last_unstale":"2024-09-15T22:34:48.120454+0000","last_undegraded":"2024-09-15T22:34:48.120454+0000","last_fullsized":"2024-09-15T22:34:48.120454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2263,"log_dups_size":0,"ondisk_log_size":2263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:45.460989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2269,"num_write_kb":17504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'4348","reported_seq":4378,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.693261+0000","last_change":"2024-09-15T22:09:21.451875+0000","last_active":"2024-09-15T22:34:47.693261+0000","last_peered":"2024-09-15T22:34:47.693261+0000","last_clean":"2024-09-15T22:34:47.693261+0000","last_became_active":"2024-09-15T22:09:21.451491+0000","last_became_peered":"2024-09-15T22:09:21.451491+0000","last_unstale":"2024-09-15T22:34:47.693261+0000","last_undegraded":"2024-09-15T22:34:47.693261+0000","last_fullsized":"2024-09-15T22:34:47.693261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4348,"log_dups_size":0,"ondisk_log_size":4348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:11.279572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3466,"num_write_kb":69520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'894","reported_seq":930,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.974828+0000","last_change":"2024-09-15T22:09:17.409336+0000","last_active":"2024-09-15T22:34:47.974828+0000","last_peered":"2024-09-15T22:34:47.974828+0000","last_clean":"2024-09-15T22:34:47.974828+0000","last_became_active":"2024-09-15T22:09:17.409038+0000","last_became_peered":"2024-09-15T22:09:17.409038+0000","last_unstale":"2024-09-15T22:34:47.974828+0000","last_undegraded":"2024-09-15T22:34:47.974828+0000","last_fullsized":"2024-09-15T22:34:47.974828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:06.946537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5434","reported_seq":5472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.136131+0000","last_change":"2024-09-15T22:09:16.409869+0000","last_active":"2024-09-15T22:34:48.136131+0000","last_peered":"2024-09-15T22:34:48.136131+0000","last_clean":"2024-09-15T22:34:48.136131+0000","last_became_active":"2024-09-15T22:09:16.409532+0000","last_became_peered":"2024-09-15T22:09:16.409532+0000","last_unstale":"2024-09-15T22:34:48.136131+0000","last_undegraded":"2024-09-15T22:34:48.136131+0000","last_fullsized":"2024-09-15T22:34:48.136131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":5434,"log_dups_size":0,"ondisk_log_size":5434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:05.940474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20380159,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5429,"num_write_kb":47121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'4057","reported_seq":4087,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.703003+0000","last_change":"2024-09-15T22:09:21.458201+0000","last_active":"2024-09-15T22:34:47.703003+0000","last_peered":"2024-09-15T22:34:47.703003+0000","last_clean":"2024-09-15T22:34:47.703003+0000","last_became_active":"2024-09-15T22:09:21.457818+0000","last_became_peered":"2024-09-15T22:09:21.457818+0000","last_unstale":"2024-09-15T22:34:47.703003+0000","last_undegraded":"2024-09-15T22:34:47.703003+0000","last_fullsized":"2024-09-15T22:34:47.703003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4057,"log_dups_size":0,"ondisk_log_size":4057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:16.163530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3146,"num_write_kb":128629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'903","reported_seq":939,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.968435+0000","last_change":"2024-09-15T22:09:17.399405+0000","last_active":"2024-09-15T22:34:47.968435+0000","last_peered":"2024-09-15T22:34:47.968435+0000","last_clean":"2024-09-15T22:34:47.968435+0000","last_became_active":"2024-09-15T22:09:17.399148+0000","last_became_peered":"2024-09-15T22:09:17.399148+0000","last_unstale":"2024-09-15T22:34:47.968435+0000","last_undegraded":"2024-09-15T22:34:47.968435+0000","last_fullsized":"2024-09-15T22:34:47.968435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:29.126156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'4744","reported_seq":7015,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.147334+0000","last_change":"2024-09-15T22:09:16.402885+0000","last_active":"2024-09-15T22:34:48.147334+0000","last_peered":"2024-09-15T22:34:48.147334+0000","last_clean":"2024-09-15T22:34:48.147334+0000","last_became_active":"2024-09-15T22:09:16.402575+0000","last_became_peered":"2024-09-15T22:09:16.402575+0000","last_unstale":"2024-09-15T22:34:48.147334+0000","last_undegraded":"2024-09-15T22:34:48.147334+0000","last_fullsized":"2024-09-15T22:34:48.147334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4744,"log_dups_size":0,"ondisk_log_size":4744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2233,"num_read_kb":5661,"num_write":4757,"num_write_kb":27314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'3833","reported_seq":3862,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.687630+0000","last_change":"2024-09-15T22:09:21.457254+0000","last_active":"2024-09-15T22:34:47.687630+0000","last_peered":"2024-09-15T22:34:47.687630+0000","last_clean":"2024-09-15T22:34:47.687630+0000","last_became_active":"2024-09-15T22:09:21.456858+0000","last_became_peered":"2024-09-15T22:09:21.456858+0000","last_unstale":"2024-09-15T22:34:47.687630+0000","last_undegraded":"2024-09-15T22:34:47.687630+0000","last_fullsized":"2024-09-15T22:34:47.687630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:52.339264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2989,"num_write_kb":154181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'860","reported_seq":896,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.982932+0000","last_change":"2024-09-15T22:09:17.411196+0000","last_active":"2024-09-15T22:34:47.982932+0000","last_peered":"2024-09-15T22:34:47.982932+0000","last_clean":"2024-09-15T22:34:47.982932+0000","last_became_active":"2024-09-15T22:09:17.409905+0000","last_became_peered":"2024-09-15T22:09:17.409905+0000","last_unstale":"2024-09-15T22:34:47.982932+0000","last_undegraded":"2024-09-15T22:34:47.982932+0000","last_fullsized":"2024-09-15T22:34:47.982932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:10.299704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'3959","reported_seq":3997,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.122816+0000","last_change":"2024-09-15T22:09:16.409152+0000","last_active":"2024-09-15T22:34:48.122816+0000","last_peered":"2024-09-15T22:34:48.122816+0000","last_clean":"2024-09-15T22:34:48.122816+0000","last_became_active":"2024-09-15T22:09:16.408793+0000","last_became_peered":"2024-09-15T22:09:16.408793+0000","last_unstale":"2024-09-15T22:34:48.122816+0000","last_undegraded":"2024-09-15T22:34:48.122816+0000","last_fullsized":"2024-09-15T22:34:48.122816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3959,"log_dups_size":0,"ondisk_log_size":3959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:09.293642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3958,"num_write_kb":30646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'3858","reported_seq":3887,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.507795+0000","last_change":"2024-09-15T22:09:21.456804+0000","last_active":"2024-09-15T22:34:47.507795+0000","last_peered":"2024-09-15T22:34:47.507795+0000","last_clean":"2024-09-15T22:34:47.507795+0000","last_became_active":"2024-09-15T22:09:21.456416+0000","last_became_peered":"2024-09-15T22:09:21.456416+0000","last_unstale":"2024-09-15T22:34:47.507795+0000","last_undegraded":"2024-09-15T22:34:47.507795+0000","last_fullsized":"2024-09-15T22:34:47.507795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3858,"log_dups_size":0,"ondisk_log_size":3858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:28.462550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2949,"num_write_kb":92106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'903","reported_seq":924,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.995708+0000","last_change":"2024-09-15T22:09:59.531923+0000","last_active":"2024-09-15T22:34:47.995708+0000","last_peered":"2024-09-15T22:34:47.995708+0000","last_clean":"2024-09-15T22:34:47.995708+0000","last_became_active":"2024-09-15T22:09:59.531667+0000","last_became_peered":"2024-09-15T22:09:59.531667+0000","last_unstale":"2024-09-15T22:34:47.995708+0000","last_undegraded":"2024-09-15T22:34:47.995708+0000","last_fullsized":"2024-09-15T22:34:47.995708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'2199","reported_seq":2237,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.140187+0000","last_change":"2024-09-15T22:09:16.401625+0000","last_active":"2024-09-15T22:34:48.140187+0000","last_peered":"2024-09-15T22:34:48.140187+0000","last_clean":"2024-09-15T22:34:48.140187+0000","last_became_active":"2024-09-15T22:09:16.401328+0000","last_became_peered":"2024-09-15T22:09:16.401328+0000","last_unstale":"2024-09-15T22:34:48.140187+0000","last_undegraded":"2024-09-15T22:34:48.140187+0000","last_fullsized":"2024-09-15T22:34:48.140187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2199,"log_dups_size":0,"ondisk_log_size":2199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2201,"num_write_kb":17467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:31:10.136103+0000","last_change":"2024-09-15T22:09:07.243631+0000","last_active":"2024-09-15T22:31:10.136103+0000","last_peered":"2024-09-15T22:31:10.136103+0000","last_clean":"2024-09-15T22:31:10.136103+0000","last_became_active":"2024-09-15T22:09:07.243223+0000","last_became_peered":"2024-09-15T22:09:07.243223+0000","last_unstale":"2024-09-15T22:31:10.136103+0000","last_undegraded":"2024-09-15T22:31:10.136103+0000","last_fullsized":"2024-09-15T22:31:10.136103+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_clean_scrub_stamp":"2024-09-15T22:09:06.009777+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:17:18.429315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'4430","reported_seq":4460,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.619292+0000","last_change":"2024-09-15T22:09:21.453536+0000","last_active":"2024-09-15T22:34:47.619292+0000","last_peered":"2024-09-15T22:34:47.619292+0000","last_clean":"2024-09-15T22:34:47.619292+0000","last_became_active":"2024-09-15T22:09:21.453022+0000","last_became_peered":"2024-09-15T22:09:21.453022+0000","last_unstale":"2024-09-15T22:34:47.619292+0000","last_undegraded":"2024-09-15T22:34:47.619292+0000","last_fullsized":"2024-09-15T22:34:47.619292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4430,"log_dups_size":0,"ondisk_log_size":4430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:26.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3508,"num_write_kb":155329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'902","reported_seq":942,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.982222+0000","last_change":"2024-09-15T22:09:59.534250+0000","last_active":"2024-09-15T22:34:47.982222+0000","last_peered":"2024-09-15T22:34:47.982222+0000","last_clean":"2024-09-15T22:34:47.982222+0000","last_became_active":"2024-09-15T22:09:59.533885+0000","last_became_peered":"2024-09-15T22:09:59.533885+0000","last_unstale":"2024-09-15T22:34:47.982222+0000","last_undegraded":"2024-09-15T22:34:47.982222+0000","last_fullsized":"2024-09-15T22:34:47.982222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:26.642804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'3371","reported_seq":3408,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.132472+0000","last_change":"2024-09-15T22:09:16.404982+0000","last_active":"2024-09-15T22:34:48.132472+0000","last_peered":"2024-09-15T22:34:48.132472+0000","last_clean":"2024-09-15T22:34:48.132472+0000","last_became_active":"2024-09-15T22:09:16.404639+0000","last_became_peered":"2024-09-15T22:09:16.404639+0000","last_unstale":"2024-09-15T22:34:48.132472+0000","last_undegraded":"2024-09-15T22:34:48.132472+0000","last_fullsized":"2024-09-15T22:34:48.132472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3371,"log_dups_size":0,"ondisk_log_size":3371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3372,"num_write_kb":30249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'3562","reported_seq":3591,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.703425+0000","last_change":"2024-09-15T22:09:21.457352+0000","last_active":"2024-09-15T22:34:47.703425+0000","last_peered":"2024-09-15T22:34:47.703425+0000","last_clean":"2024-09-15T22:34:47.703425+0000","last_became_active":"2024-09-15T22:09:21.456906+0000","last_became_peered":"2024-09-15T22:09:21.456906+0000","last_unstale":"2024-09-15T22:34:47.703425+0000","last_undegraded":"2024-09-15T22:34:47.703425+0000","last_fullsized":"2024-09-15T22:34:47.703425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3562,"log_dups_size":0,"ondisk_log_size":3562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:28.271273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2654,"num_write_kb":61277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'891","reported_seq":926,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.985965+0000","last_change":"2024-09-15T22:09:17.416652+0000","last_active":"2024-09-15T22:34:47.985965+0000","last_peered":"2024-09-15T22:34:47.985965+0000","last_clean":"2024-09-15T22:34:47.985965+0000","last_became_active":"2024-09-15T22:09:17.415597+0000","last_became_peered":"2024-09-15T22:09:17.415597+0000","last_unstale":"2024-09-15T22:34:47.985965+0000","last_undegraded":"2024-09-15T22:34:47.985965+0000","last_fullsized":"2024-09-15T22:34:47.985965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:36.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'4278","reported_seq":4315,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.145535+0000","last_change":"2024-09-15T22:09:16.405689+0000","last_active":"2024-09-15T22:34:48.145535+0000","last_peered":"2024-09-15T22:34:48.145535+0000","last_clean":"2024-09-15T22:34:48.145535+0000","last_became_active":"2024-09-15T22:09:16.405433+0000","last_became_peered":"2024-09-15T22:09:16.405433+0000","last_unstale":"2024-09-15T22:34:48.145535+0000","last_undegraded":"2024-09-15T22:34:48.145535+0000","last_fullsized":"2024-09-15T22:34:48.145535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4278,"log_dups_size":0,"ondisk_log_size":4278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.332999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4278,"num_write_kb":34786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'3805","reported_seq":3841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.683777+0000","last_change":"2024-09-15T22:09:59.534678+0000","last_active":"2024-09-15T22:34:47.683777+0000","last_peered":"2024-09-15T22:34:47.683777+0000","last_clean":"2024-09-15T22:34:47.683777+0000","last_became_active":"2024-09-15T22:09:59.534224+0000","last_became_peered":"2024-09-15T22:09:59.534224+0000","last_unstale":"2024-09-15T22:34:47.683777+0000","last_undegraded":"2024-09-15T22:34:47.683777+0000","last_fullsized":"2024-09-15T22:34:47.683777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3805,"log_dups_size":0,"ondisk_log_size":3805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:29.093882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2836,"num_write_kb":60139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'879","reported_seq":914,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.006366+0000","last_change":"2024-09-15T22:09:17.412910+0000","last_active":"2024-09-15T22:34:48.006366+0000","last_peered":"2024-09-15T22:34:48.006366+0000","last_clean":"2024-09-15T22:34:48.006366+0000","last_became_active":"2024-09-15T22:09:17.412079+0000","last_became_peered":"2024-09-15T22:09:17.412079+0000","last_unstale":"2024-09-15T22:34:48.006366+0000","last_undegraded":"2024-09-15T22:34:48.006366+0000","last_fullsized":"2024-09-15T22:34:48.006366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:04.536343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'2409","reported_seq":2446,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.117233+0000","last_change":"2024-09-15T22:09:16.405941+0000","last_active":"2024-09-15T22:34:48.117233+0000","last_peered":"2024-09-15T22:34:48.117233+0000","last_clean":"2024-09-15T22:34:48.117233+0000","last_became_active":"2024-09-15T22:09:16.405621+0000","last_became_peered":"2024-09-15T22:09:16.405621+0000","last_unstale":"2024-09-15T22:34:48.117233+0000","last_undegraded":"2024-09-15T22:34:48.117233+0000","last_fullsized":"2024-09-15T22:34:48.117233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2409,"log_dups_size":0,"ondisk_log_size":2409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2412,"num_write_kb":21631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'4109","reported_seq":4138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.174045+0000","last_change":"2024-09-15T22:09:21.449669+0000","last_active":"2024-09-15T22:34:48.174045+0000","last_peered":"2024-09-15T22:34:48.174045+0000","last_clean":"2024-09-15T22:34:48.174045+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:34:48.174045+0000","last_undegraded":"2024-09-15T22:34:48.174045+0000","last_fullsized":"2024-09-15T22:34:48.174045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4109,"log_dups_size":0,"ondisk_log_size":4109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:45.457068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3191,"num_write_kb":110194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'910","reported_seq":945,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.981911+0000","last_change":"2024-09-15T22:09:17.410475+0000","last_active":"2024-09-15T22:34:47.981911+0000","last_peered":"2024-09-15T22:34:47.981911+0000","last_clean":"2024-09-15T22:34:47.981911+0000","last_became_active":"2024-09-15T22:09:17.410176+0000","last_became_peered":"2024-09-15T22:09:17.410176+0000","last_unstale":"2024-09-15T22:34:47.981911+0000","last_undegraded":"2024-09-15T22:34:47.981911+0000","last_fullsized":"2024-09-15T22:34:47.981911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:22.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'1504","reported_seq":1541,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.120787+0000","last_change":"2024-09-15T22:09:16.399090+0000","last_active":"2024-09-15T22:34:48.120787+0000","last_peered":"2024-09-15T22:34:48.120787+0000","last_clean":"2024-09-15T22:34:48.120787+0000","last_became_active":"2024-09-15T22:09:16.398789+0000","last_became_peered":"2024-09-15T22:09:16.398789+0000","last_unstale":"2024-09-15T22:34:48.120787+0000","last_undegraded":"2024-09-15T22:34:48.120787+0000","last_fullsized":"2024-09-15T22:34:48.120787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1504,"log_dups_size":0,"ondisk_log_size":1504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:14.477432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1509,"num_write_kb":13058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'3700","reported_seq":3729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.621769+0000","last_change":"2024-09-15T22:09:21.448270+0000","last_active":"2024-09-15T22:34:47.621769+0000","last_peered":"2024-09-15T22:34:47.621769+0000","last_clean":"2024-09-15T22:34:47.621769+0000","last_became_active":"2024-09-15T22:09:21.447541+0000","last_became_peered":"2024-09-15T22:09:21.447541+0000","last_unstale":"2024-09-15T22:34:47.621769+0000","last_undegraded":"2024-09-15T22:34:47.621769+0000","last_fullsized":"2024-09-15T22:34:47.621769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3700,"log_dups_size":0,"ondisk_log_size":3700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:51.175728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2791,"num_write_kb":90475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'922","reported_seq":956,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.992661+0000","last_change":"2024-09-15T22:09:17.410762+0000","last_active":"2024-09-15T22:34:47.992661+0000","last_peered":"2024-09-15T22:34:47.992661+0000","last_clean":"2024-09-15T22:34:47.992661+0000","last_became_active":"2024-09-15T22:09:17.410431+0000","last_became_peered":"2024-09-15T22:09:17.410431+0000","last_unstale":"2024-09-15T22:34:47.992661+0000","last_undegraded":"2024-09-15T22:34:47.992661+0000","last_fullsized":"2024-09-15T22:34:47.992661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:15.123863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'1787","reported_seq":1823,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.130026+0000","last_change":"2024-09-15T22:09:16.409298+0000","last_active":"2024-09-15T22:34:48.130026+0000","last_peered":"2024-09-15T22:34:48.130026+0000","last_clean":"2024-09-15T22:34:48.130026+0000","last_became_active":"2024-09-15T22:09:16.408991+0000","last_became_peered":"2024-09-15T22:09:16.408991+0000","last_unstale":"2024-09-15T22:34:48.130026+0000","last_undegraded":"2024-09-15T22:34:48.130026+0000","last_fullsized":"2024-09-15T22:34:48.130026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1787,"log_dups_size":0,"ondisk_log_size":1787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.799831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1802,"num_write_kb":13181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'3624","reported_seq":3652,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.703935+0000","last_change":"2024-09-15T22:09:21.453936+0000","last_active":"2024-09-15T22:34:47.703935+0000","last_peered":"2024-09-15T22:34:47.703935+0000","last_clean":"2024-09-15T22:34:47.703935+0000","last_became_active":"2024-09-15T22:09:21.453526+0000","last_became_peered":"2024-09-15T22:09:21.453526+0000","last_unstale":"2024-09-15T22:34:47.703935+0000","last_undegraded":"2024-09-15T22:34:47.703935+0000","last_fullsized":"2024-09-15T22:34:47.703935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:19.159742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2710,"num_write_kb":101760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'885","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.971021+0000","last_change":"2024-09-15T22:09:17.404617+0000","last_active":"2024-09-15T22:34:47.971021+0000","last_peered":"2024-09-15T22:34:47.971021+0000","last_clean":"2024-09-15T22:34:47.971021+0000","last_became_active":"2024-09-15T22:09:17.404310+0000","last_became_peered":"2024-09-15T22:09:17.404310+0000","last_unstale":"2024-09-15T22:34:47.971021+0000","last_undegraded":"2024-09-15T22:34:47.971021+0000","last_fullsized":"2024-09-15T22:34:47.971021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:17.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'963","reported_seq":999,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.117866+0000","last_change":"2024-09-15T22:09:16.403439+0000","last_active":"2024-09-15T22:34:48.117866+0000","last_peered":"2024-09-15T22:34:48.117866+0000","last_clean":"2024-09-15T22:34:48.117866+0000","last_became_active":"2024-09-15T22:09:16.403137+0000","last_became_peered":"2024-09-15T22:09:16.403137+0000","last_unstale":"2024-09-15T22:34:48.117866+0000","last_undegraded":"2024-09-15T22:34:48.117866+0000","last_fullsized":"2024-09-15T22:34:48.117866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:05.940474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":974,"num_write_kb":8662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'3775","reported_seq":3803,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.687144+0000","last_change":"2024-09-15T22:09:21.451370+0000","last_active":"2024-09-15T22:34:47.687144+0000","last_peered":"2024-09-15T22:34:47.687144+0000","last_clean":"2024-09-15T22:34:47.687144+0000","last_became_active":"2024-09-15T22:09:21.451016+0000","last_became_peered":"2024-09-15T22:09:21.451016+0000","last_unstale":"2024-09-15T22:34:47.687144+0000","last_undegraded":"2024-09-15T22:34:47.687144+0000","last_fullsized":"2024-09-15T22:34:47.687144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:54.480340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2843,"num_write_kb":133663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'906","reported_seq":940,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.006538+0000","last_change":"2024-09-15T22:09:17.412953+0000","last_active":"2024-09-15T22:34:48.006538+0000","last_peered":"2024-09-15T22:34:48.006538+0000","last_clean":"2024-09-15T22:34:48.006538+0000","last_became_active":"2024-09-15T22:09:17.412680+0000","last_became_peered":"2024-09-15T22:09:17.412680+0000","last_unstale":"2024-09-15T22:34:48.006538+0000","last_undegraded":"2024-09-15T22:34:48.006538+0000","last_fullsized":"2024-09-15T22:34:48.006538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":906,"log_dups_size":0,"ondisk_log_size":906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:36.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'443","reported_seq":479,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.126611+0000","last_change":"2024-09-15T22:09:16.406833+0000","last_active":"2024-09-15T22:34:48.126611+0000","last_peered":"2024-09-15T22:34:48.126611+0000","last_clean":"2024-09-15T22:34:48.126611+0000","last_became_active":"2024-09-15T22:09:16.406550+0000","last_became_peered":"2024-09-15T22:09:16.406550+0000","last_unstale":"2024-09-15T22:34:48.126611+0000","last_undegraded":"2024-09-15T22:34:48.126611+0000","last_fullsized":"2024-09-15T22:34:48.126611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":462,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'4060","reported_seq":4088,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.669028+0000","last_change":"2024-09-15T22:09:21.450825+0000","last_active":"2024-09-15T22:34:47.669028+0000","last_peered":"2024-09-15T22:34:47.669028+0000","last_clean":"2024-09-15T22:34:47.669028+0000","last_became_active":"2024-09-15T22:09:21.450200+0000","last_became_peered":"2024-09-15T22:09:21.450200+0000","last_unstale":"2024-09-15T22:34:47.669028+0000","last_undegraded":"2024-09-15T22:34:47.669028+0000","last_fullsized":"2024-09-15T22:34:47.669028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4060,"log_dups_size":0,"ondisk_log_size":4060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:10.812526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3182,"num_write_kb":92617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'876","reported_seq":910,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.986053+0000","last_change":"2024-09-15T22:09:17.421088+0000","last_active":"2024-09-15T22:34:47.986053+0000","last_peered":"2024-09-15T22:34:47.986053+0000","last_clean":"2024-09-15T22:34:47.986053+0000","last_became_active":"2024-09-15T22:09:17.420802+0000","last_became_peered":"2024-09-15T22:09:17.420802+0000","last_unstale":"2024-09-15T22:34:47.986053+0000","last_undegraded":"2024-09-15T22:34:47.986053+0000","last_fullsized":"2024-09-15T22:34:47.986053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:57.079300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'2258","reported_seq":2294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.131076+0000","last_change":"2024-09-15T22:09:16.395676+0000","last_active":"2024-09-15T22:34:48.131076+0000","last_peered":"2024-09-15T22:34:48.131076+0000","last_clean":"2024-09-15T22:34:48.131076+0000","last_became_active":"2024-09-15T22:09:16.394355+0000","last_became_peered":"2024-09-15T22:09:16.394355+0000","last_unstale":"2024-09-15T22:34:48.131076+0000","last_undegraded":"2024-09-15T22:34:48.131076+0000","last_fullsized":"2024-09-15T22:34:48.131076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2258,"log_dups_size":0,"ondisk_log_size":2258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:53.845610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2267,"num_write_kb":17573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'3672","reported_seq":3700,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.650001+0000","last_change":"2024-09-15T22:09:21.454458+0000","last_active":"2024-09-15T22:34:47.650001+0000","last_peered":"2024-09-15T22:34:47.650001+0000","last_clean":"2024-09-15T22:34:47.650001+0000","last_became_active":"2024-09-15T22:09:21.453992+0000","last_became_peered":"2024-09-15T22:09:21.453992+0000","last_unstale":"2024-09-15T22:34:47.650001+0000","last_undegraded":"2024-09-15T22:34:47.650001+0000","last_fullsized":"2024-09-15T22:34:47.650001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3672,"log_dups_size":0,"ondisk_log_size":3672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:08.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2764,"num_write_kb":64906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'863","reported_seq":897,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.982113+0000","last_change":"2024-09-15T22:09:17.404161+0000","last_active":"2024-09-15T22:34:47.982113+0000","last_peered":"2024-09-15T22:34:47.982113+0000","last_clean":"2024-09-15T22:34:47.982113+0000","last_became_active":"2024-09-15T22:09:17.403899+0000","last_became_peered":"2024-09-15T22:09:17.403899+0000","last_unstale":"2024-09-15T22:34:47.982113+0000","last_undegraded":"2024-09-15T22:34:47.982113+0000","last_fullsized":"2024-09-15T22:34:47.982113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:22.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'3996","reported_seq":4032,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.135010+0000","last_change":"2024-09-15T22:09:16.403905+0000","last_active":"2024-09-15T22:34:48.135010+0000","last_peered":"2024-09-15T22:34:48.135010+0000","last_clean":"2024-09-15T22:34:48.135010+0000","last_became_active":"2024-09-15T22:09:16.403624+0000","last_became_peered":"2024-09-15T22:09:16.403624+0000","last_unstale":"2024-09-15T22:34:48.135010+0000","last_undegraded":"2024-09-15T22:34:48.135010+0000","last_fullsized":"2024-09-15T22:34:48.135010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.371198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3999,"num_write_kb":30696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'3842","reported_seq":3870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.173105+0000","last_change":"2024-09-15T22:09:21.452045+0000","last_active":"2024-09-15T22:34:48.173105+0000","last_peered":"2024-09-15T22:34:48.173105+0000","last_clean":"2024-09-15T22:34:48.173105+0000","last_became_active":"2024-09-15T22:09:21.451617+0000","last_became_peered":"2024-09-15T22:09:21.451617+0000","last_unstale":"2024-09-15T22:34:48.173105+0000","last_undegraded":"2024-09-15T22:34:48.173105+0000","last_fullsized":"2024-09-15T22:34:48.173105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3842,"log_dups_size":0,"ondisk_log_size":3842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:32.189930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2980,"num_write_kb":152763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'896","reported_seq":930,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.978282+0000","last_change":"2024-09-15T22:09:17.399198+0000","last_active":"2024-09-15T22:34:47.978282+0000","last_peered":"2024-09-15T22:34:47.978282+0000","last_clean":"2024-09-15T22:34:47.978282+0000","last_became_active":"2024-09-15T22:09:17.398881+0000","last_became_peered":"2024-09-15T22:09:17.398881+0000","last_unstale":"2024-09-15T22:34:47.978282+0000","last_undegraded":"2024-09-15T22:34:47.978282+0000","last_fullsized":"2024-09-15T22:34:47.978282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:44.868956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'4322","reported_seq":4358,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.140696+0000","last_change":"2024-09-15T22:09:16.408365+0000","last_active":"2024-09-15T22:34:48.140696+0000","last_peered":"2024-09-15T22:34:48.140696+0000","last_clean":"2024-09-15T22:34:48.140696+0000","last_became_active":"2024-09-15T22:09:16.408064+0000","last_became_peered":"2024-09-15T22:09:16.408064+0000","last_unstale":"2024-09-15T22:34:48.140696+0000","last_undegraded":"2024-09-15T22:34:48.140696+0000","last_fullsized":"2024-09-15T22:34:48.140696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4322,"log_dups_size":0,"ondisk_log_size":4322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:01.032313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4321,"num_write_kb":23285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'4245","reported_seq":4273,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.171146+0000","last_change":"2024-09-15T22:09:21.455334+0000","last_active":"2024-09-15T22:34:48.171146+0000","last_peered":"2024-09-15T22:34:48.171146+0000","last_clean":"2024-09-15T22:34:48.171146+0000","last_became_active":"2024-09-15T22:09:21.454907+0000","last_became_peered":"2024-09-15T22:09:21.454907+0000","last_unstale":"2024-09-15T22:34:48.171146+0000","last_undegraded":"2024-09-15T22:34:48.171146+0000","last_fullsized":"2024-09-15T22:34:48.171146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4245,"log_dups_size":0,"ondisk_log_size":4245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:26.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3329,"num_write_kb":357256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'888","reported_seq":922,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.000309+0000","last_change":"2024-09-15T22:09:17.415215+0000","last_active":"2024-09-15T22:34:48.000309+0000","last_peered":"2024-09-15T22:34:48.000309+0000","last_clean":"2024-09-15T22:34:48.000309+0000","last_became_active":"2024-09-15T22:09:17.414951+0000","last_became_peered":"2024-09-15T22:09:17.414951+0000","last_unstale":"2024-09-15T22:34:48.000309+0000","last_undegraded":"2024-09-15T22:34:48.000309+0000","last_fullsized":"2024-09-15T22:34:48.000309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3258","reported_seq":3294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.140312+0000","last_change":"2024-09-15T22:09:16.405521+0000","last_active":"2024-09-15T22:34:48.140312+0000","last_peered":"2024-09-15T22:34:48.140312+0000","last_clean":"2024-09-15T22:34:48.140312+0000","last_became_active":"2024-09-15T22:09:16.405230+0000","last_became_peered":"2024-09-15T22:09:16.405230+0000","last_unstale":"2024-09-15T22:34:48.140312+0000","last_undegraded":"2024-09-15T22:34:48.140312+0000","last_fullsized":"2024-09-15T22:34:48.140312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3258,"log_dups_size":0,"ondisk_log_size":3258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:03.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3257,"num_write_kb":26116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'3612","reported_seq":3640,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.653194+0000","last_change":"2024-09-15T22:09:21.450431+0000","last_active":"2024-09-15T22:34:47.653194+0000","last_peered":"2024-09-15T22:34:47.653194+0000","last_clean":"2024-09-15T22:34:47.653194+0000","last_became_active":"2024-09-15T22:09:21.449896+0000","last_became_peered":"2024-09-15T22:09:21.449896+0000","last_unstale":"2024-09-15T22:34:47.653194+0000","last_undegraded":"2024-09-15T22:34:47.653194+0000","last_fullsized":"2024-09-15T22:34:47.653194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3612,"log_dups_size":0,"ondisk_log_size":3612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:18.430595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2735,"num_write_kb":71213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'873","reported_seq":907,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.003609+0000","last_change":"2024-09-15T22:09:17.422669+0000","last_active":"2024-09-15T22:34:48.003609+0000","last_peered":"2024-09-15T22:34:48.003609+0000","last_clean":"2024-09-15T22:34:48.003609+0000","last_became_active":"2024-09-15T22:09:17.422401+0000","last_became_peered":"2024-09-15T22:09:17.422401+0000","last_unstale":"2024-09-15T22:34:48.003609+0000","last_undegraded":"2024-09-15T22:34:48.003609+0000","last_fullsized":"2024-09-15T22:34:48.003609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:58.490211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2844","reported_seq":3576,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.146617+0000","last_change":"2024-09-15T22:09:16.405552+0000","last_active":"2024-09-15T22:34:48.146617+0000","last_peered":"2024-09-15T22:34:48.146617+0000","last_clean":"2024-09-15T22:34:48.146617+0000","last_became_active":"2024-09-15T22:09:16.405208+0000","last_became_peered":"2024-09-15T22:09:16.405208+0000","last_unstale":"2024-09-15T22:34:48.146617+0000","last_undegraded":"2024-09-15T22:34:48.146617+0000","last_fullsized":"2024-09-15T22:34:48.146617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2844,"log_dups_size":0,"ondisk_log_size":2844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18685136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":696,"num_read_kb":2335,"num_write":2846,"num_write_kb":23873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'3807","reported_seq":3835,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.585560+0000","last_change":"2024-09-15T22:09:21.448849+0000","last_active":"2024-09-15T22:34:47.585560+0000","last_peered":"2024-09-15T22:34:47.585560+0000","last_clean":"2024-09-15T22:34:47.585560+0000","last_became_active":"2024-09-15T22:09:21.448356+0000","last_became_peered":"2024-09-15T22:09:21.448356+0000","last_unstale":"2024-09-15T22:34:47.585560+0000","last_undegraded":"2024-09-15T22:34:47.585560+0000","last_fullsized":"2024-09-15T22:34:47.585560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3807,"log_dups_size":0,"ondisk_log_size":3807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:08.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2897,"num_write_kb":187512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'3625","reported_seq":3655,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.161586+0000","last_change":"2024-09-15T22:09:21.458815+0000","last_active":"2024-09-15T22:34:48.161586+0000","last_peered":"2024-09-15T22:34:48.161586+0000","last_clean":"2024-09-15T22:34:48.161586+0000","last_became_active":"2024-09-15T22:09:21.458418+0000","last_became_peered":"2024-09-15T22:09:21.458418+0000","last_unstale":"2024-09-15T22:34:48.161586+0000","last_undegraded":"2024-09-15T22:34:48.161586+0000","last_fullsized":"2024-09-15T22:34:48.161586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:26.187414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2737,"num_write_kb":87535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'902","reported_seq":936,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.973143+0000","last_change":"2024-09-15T22:09:17.401001+0000","last_active":"2024-09-15T22:34:47.973143+0000","last_peered":"2024-09-15T22:34:47.973143+0000","last_clean":"2024-09-15T22:34:47.973143+0000","last_became_active":"2024-09-15T22:09:17.400754+0000","last_became_peered":"2024-09-15T22:09:17.400754+0000","last_unstale":"2024-09-15T22:34:47.973143+0000","last_undegraded":"2024-09-15T22:34:47.973143+0000","last_fullsized":"2024-09-15T22:34:47.973143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:33.878828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'4403","reported_seq":4439,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.130690+0000","last_change":"2024-09-15T22:09:16.404987+0000","last_active":"2024-09-15T22:34:48.130690+0000","last_peered":"2024-09-15T22:34:48.130690+0000","last_clean":"2024-09-15T22:34:48.130690+0000","last_became_active":"2024-09-15T22:09:16.404694+0000","last_became_peered":"2024-09-15T22:09:16.404694+0000","last_unstale":"2024-09-15T22:34:48.130690+0000","last_undegraded":"2024-09-15T22:34:48.130690+0000","last_fullsized":"2024-09-15T22:34:48.130690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4404,"num_write_kb":39122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'4168","reported_seq":4198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.608477+0000","last_change":"2024-09-15T22:09:21.457334+0000","last_active":"2024-09-15T22:34:47.608477+0000","last_peered":"2024-09-15T22:34:47.608477+0000","last_clean":"2024-09-15T22:34:47.608477+0000","last_became_active":"2024-09-15T22:09:21.456871+0000","last_became_peered":"2024-09-15T22:09:21.456871+0000","last_unstale":"2024-09-15T22:34:47.608477+0000","last_undegraded":"2024-09-15T22:34:47.608477+0000","last_fullsized":"2024-09-15T22:34:47.608477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4168,"log_dups_size":0,"ondisk_log_size":4168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:08.904123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3293,"num_write_kb":221802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'944","reported_seq":978,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.980106+0000","last_change":"2024-09-15T22:09:17.402872+0000","last_active":"2024-09-15T22:34:47.980106+0000","last_peered":"2024-09-15T22:34:47.980106+0000","last_clean":"2024-09-15T22:34:47.980106+0000","last_became_active":"2024-09-15T22:09:17.402625+0000","last_became_peered":"2024-09-15T22:09:17.402625+0000","last_unstale":"2024-09-15T22:34:47.980106+0000","last_undegraded":"2024-09-15T22:34:47.980106+0000","last_fullsized":"2024-09-15T22:34:47.980106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":944,"log_dups_size":0,"ondisk_log_size":944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'2057","reported_seq":2093,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.127636+0000","last_change":"2024-09-15T22:09:16.405821+0000","last_active":"2024-09-15T22:34:48.127636+0000","last_peered":"2024-09-15T22:34:48.127636+0000","last_clean":"2024-09-15T22:34:48.127636+0000","last_became_active":"2024-09-15T22:09:16.405561+0000","last_became_peered":"2024-09-15T22:09:16.405561+0000","last_unstale":"2024-09-15T22:34:48.127636+0000","last_undegraded":"2024-09-15T22:34:48.127636+0000","last_fullsized":"2024-09-15T22:34:48.127636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2057,"log_dups_size":0,"ondisk_log_size":2057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:07.197651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2062,"num_write_kb":17437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4667","reported_seq":4703,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.176514+0000","last_change":"2024-09-15T22:09:16.403455+0000","last_active":"2024-09-15T22:34:48.176514+0000","last_peered":"2024-09-15T22:34:48.176514+0000","last_clean":"2024-09-15T22:34:48.176514+0000","last_became_active":"2024-09-15T22:09:16.403172+0000","last_became_peered":"2024-09-15T22:09:16.403172+0000","last_unstale":"2024-09-15T22:34:48.176514+0000","last_undegraded":"2024-09-15T22:34:48.176514+0000","last_fullsized":"2024-09-15T22:34:48.176514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:03.308684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4675,"num_write_kb":35111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'885","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.985255+0000","last_change":"2024-09-15T22:09:17.416335+0000","last_active":"2024-09-15T22:34:47.985255+0000","last_peered":"2024-09-15T22:34:47.985255+0000","last_clean":"2024-09-15T22:34:47.985255+0000","last_became_active":"2024-09-15T22:09:17.416102+0000","last_became_peered":"2024-09-15T22:09:17.416102+0000","last_unstale":"2024-09-15T22:34:47.985255+0000","last_undegraded":"2024-09-15T22:34:47.985255+0000","last_fullsized":"2024-09-15T22:34:47.985255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3664","reported_seq":3692,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.677534+0000","last_change":"2024-09-15T22:09:21.448449+0000","last_active":"2024-09-15T22:34:47.677534+0000","last_peered":"2024-09-15T22:34:47.677534+0000","last_clean":"2024-09-15T22:34:47.677534+0000","last_became_active":"2024-09-15T22:09:21.448020+0000","last_became_peered":"2024-09-15T22:09:21.448020+0000","last_unstale":"2024-09-15T22:34:47.677534+0000","last_undegraded":"2024-09-15T22:34:47.677534+0000","last_fullsized":"2024-09-15T22:34:47.677534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3664,"log_dups_size":0,"ondisk_log_size":3664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:05.244676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2728,"num_write_kb":145400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1987","reported_seq":2023,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.135711+0000","last_change":"2024-09-15T22:09:16.401331+0000","last_active":"2024-09-15T22:34:48.135711+0000","last_peered":"2024-09-15T22:34:48.135711+0000","last_clean":"2024-09-15T22:34:48.135711+0000","last_became_active":"2024-09-15T22:09:16.401040+0000","last_became_peered":"2024-09-15T22:09:16.401040+0000","last_unstale":"2024-09-15T22:34:48.135711+0000","last_undegraded":"2024-09-15T22:34:48.135711+0000","last_fullsized":"2024-09-15T22:34:48.135711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.799831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1992,"num_write_kb":17367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'895","reported_seq":929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.971488+0000","last_change":"2024-09-15T22:09:17.405328+0000","last_active":"2024-09-15T22:34:47.971488+0000","last_peered":"2024-09-15T22:34:47.971488+0000","last_clean":"2024-09-15T22:34:47.971488+0000","last_became_active":"2024-09-15T22:09:17.404772+0000","last_became_peered":"2024-09-15T22:09:17.404772+0000","last_unstale":"2024-09-15T22:34:47.971488+0000","last_undegraded":"2024-09-15T22:34:47.971488+0000","last_fullsized":"2024-09-15T22:34:47.971488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:33.377260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3687","reported_seq":3715,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.161366+0000","last_change":"2024-09-15T22:09:21.458359+0000","last_active":"2024-09-15T22:34:48.161366+0000","last_peered":"2024-09-15T22:34:48.161366+0000","last_clean":"2024-09-15T22:34:48.161366+0000","last_became_active":"2024-09-15T22:09:21.457977+0000","last_became_peered":"2024-09-15T22:09:21.457977+0000","last_unstale":"2024-09-15T22:34:48.161366+0000","last_undegraded":"2024-09-15T22:34:48.161366+0000","last_fullsized":"2024-09-15T22:34:48.161366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3687,"log_dups_size":0,"ondisk_log_size":3687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.055754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2724,"num_write_kb":59138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'900","reported_seq":936,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.980406+0000","last_change":"2024-09-15T22:09:17.405556+0000","last_active":"2024-09-15T22:34:47.980406+0000","last_peered":"2024-09-15T22:34:47.980406+0000","last_clean":"2024-09-15T22:34:47.980406+0000","last_became_active":"2024-09-15T22:09:17.405129+0000","last_became_peered":"2024-09-15T22:09:17.405129+0000","last_unstale":"2024-09-15T22:34:47.980406+0000","last_undegraded":"2024-09-15T22:34:47.980406+0000","last_fullsized":"2024-09-15T22:34:47.980406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'940","reported_seq":976,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.994790+0000","last_change":"2024-09-15T22:09:17.408189+0000","last_active":"2024-09-15T22:34:47.994790+0000","last_peered":"2024-09-15T22:34:47.994790+0000","last_clean":"2024-09-15T22:34:47.994790+0000","last_became_active":"2024-09-15T22:09:17.407877+0000","last_became_peered":"2024-09-15T22:09:17.407877+0000","last_unstale":"2024-09-15T22:34:47.994790+0000","last_undegraded":"2024-09-15T22:34:47.994790+0000","last_fullsized":"2024-09-15T22:34:47.994790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":940,"log_dups_size":0,"ondisk_log_size":940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:02.290840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'881","reported_seq":922,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.995854+0000","last_change":"2024-09-15T22:09:59.534711+0000","last_active":"2024-09-15T22:34:47.995854+0000","last_peered":"2024-09-15T22:34:47.995854+0000","last_clean":"2024-09-15T22:34:47.995854+0000","last_became_active":"2024-09-15T22:09:59.534380+0000","last_became_peered":"2024-09-15T22:09:59.534380+0000","last_unstale":"2024-09-15T22:34:47.995854+0000","last_undegraded":"2024-09-15T22:34:47.995854+0000","last_fullsized":"2024-09-15T22:34:47.995854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:26.642804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'916","reported_seq":952,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.980268+0000","last_change":"2024-09-15T22:09:17.406140+0000","last_active":"2024-09-15T22:34:47.980268+0000","last_peered":"2024-09-15T22:34:47.980268+0000","last_clean":"2024-09-15T22:34:47.980268+0000","last_became_active":"2024-09-15T22:09:17.405142+0000","last_became_peered":"2024-09-15T22:09:17.405142+0000","last_unstale":"2024-09-15T22:34:47.980268+0000","last_undegraded":"2024-09-15T22:34:47.980268+0000","last_fullsized":"2024-09-15T22:34:47.980268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":916,"log_dups_size":0,"ondisk_log_size":916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:17.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'885","reported_seq":920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.974935+0000","last_change":"2024-09-15T22:09:17.411027+0000","last_active":"2024-09-15T22:34:47.974935+0000","last_peered":"2024-09-15T22:34:47.974935+0000","last_clean":"2024-09-15T22:34:47.974935+0000","last_became_active":"2024-09-15T22:09:17.408913+0000","last_became_peered":"2024-09-15T22:09:17.408913+0000","last_unstale":"2024-09-15T22:34:47.974935+0000","last_undegraded":"2024-09-15T22:34:47.974935+0000","last_fullsized":"2024-09-15T22:34:47.974935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:34.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'886","reported_seq":921,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.972194+0000","last_change":"2024-09-15T22:09:17.401385+0000","last_active":"2024-09-15T22:34:47.972194+0000","last_peered":"2024-09-15T22:34:47.972194+0000","last_clean":"2024-09-15T22:34:47.972194+0000","last_became_active":"2024-09-15T22:09:17.400916+0000","last_became_peered":"2024-09-15T22:09:17.400916+0000","last_unstale":"2024-09-15T22:34:47.972194+0000","last_undegraded":"2024-09-15T22:34:47.972194+0000","last_fullsized":"2024-09-15T22:34:47.972194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:31.994148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'934","reported_seq":969,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.003834+0000","last_change":"2024-09-15T22:09:17.405622+0000","last_active":"2024-09-15T22:34:48.003834+0000","last_peered":"2024-09-15T22:34:48.003834+0000","last_clean":"2024-09-15T22:34:48.003834+0000","last_became_active":"2024-09-15T22:09:17.405319+0000","last_became_peered":"2024-09-15T22:09:17.405319+0000","last_unstale":"2024-09-15T22:34:48.003834+0000","last_undegraded":"2024-09-15T22:34:48.003834+0000","last_fullsized":"2024-09-15T22:34:48.003834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'869","reported_seq":904,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.971623+0000","last_change":"2024-09-15T22:09:17.409317+0000","last_active":"2024-09-15T22:34:47.971623+0000","last_peered":"2024-09-15T22:34:47.971623+0000","last_clean":"2024-09-15T22:34:47.971623+0000","last_became_active":"2024-09-15T22:09:17.408949+0000","last_became_peered":"2024-09-15T22:09:17.408949+0000","last_unstale":"2024-09-15T22:34:47.971623+0000","last_undegraded":"2024-09-15T22:34:47.971623+0000","last_fullsized":"2024-09-15T22:34:47.971623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'872","reported_seq":907,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.145298+0000","last_change":"2024-09-15T22:09:17.416439+0000","last_active":"2024-09-15T22:34:48.145298+0000","last_peered":"2024-09-15T22:34:48.145298+0000","last_clean":"2024-09-15T22:34:48.145298+0000","last_became_active":"2024-09-15T22:09:17.416170+0000","last_became_peered":"2024-09-15T22:09:17.416170+0000","last_unstale":"2024-09-15T22:34:48.145298+0000","last_undegraded":"2024-09-15T22:34:48.145298+0000","last_fullsized":"2024-09-15T22:34:48.145298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'867","reported_seq":902,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.983659+0000","last_change":"2024-09-15T22:09:17.409471+0000","last_active":"2024-09-15T22:34:47.983659+0000","last_peered":"2024-09-15T22:34:47.983659+0000","last_clean":"2024-09-15T22:34:47.983659+0000","last_became_active":"2024-09-15T22:09:17.408969+0000","last_became_peered":"2024-09-15T22:09:17.408969+0000","last_unstale":"2024-09-15T22:34:47.983659+0000","last_undegraded":"2024-09-15T22:34:47.983659+0000","last_fullsized":"2024-09-15T22:34:47.983659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'894","reported_seq":929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.006416+0000","last_change":"2024-09-15T22:09:17.422118+0000","last_active":"2024-09-15T22:34:48.006416+0000","last_peered":"2024-09-15T22:34:48.006416+0000","last_clean":"2024-09-15T22:34:48.006416+0000","last_became_active":"2024-09-15T22:09:17.421846+0000","last_became_peered":"2024-09-15T22:09:17.421846+0000","last_unstale":"2024-09-15T22:34:48.006416+0000","last_undegraded":"2024-09-15T22:34:48.006416+0000","last_fullsized":"2024-09-15T22:34:48.006416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:34.614907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'909","reported_seq":944,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.997335+0000","last_change":"2024-09-15T22:09:17.421168+0000","last_active":"2024-09-15T22:34:47.997335+0000","last_peered":"2024-09-15T22:34:47.997335+0000","last_clean":"2024-09-15T22:34:47.997335+0000","last_became_active":"2024-09-15T22:09:17.420849+0000","last_became_peered":"2024-09-15T22:09:17.420849+0000","last_unstale":"2024-09-15T22:34:47.997335+0000","last_undegraded":"2024-09-15T22:34:47.997335+0000","last_fullsized":"2024-09-15T22:34:47.997335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:25.108343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'894","reported_seq":929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.001943+0000","last_change":"2024-09-15T22:09:17.410112+0000","last_active":"2024-09-15T22:34:48.001943+0000","last_peered":"2024-09-15T22:34:48.001943+0000","last_clean":"2024-09-15T22:34:48.001943+0000","last_became_active":"2024-09-15T22:09:17.409837+0000","last_became_peered":"2024-09-15T22:09:17.409837+0000","last_unstale":"2024-09-15T22:34:48.001943+0000","last_undegraded":"2024-09-15T22:34:48.001943+0000","last_fullsized":"2024-09-15T22:34:48.001943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'901","reported_seq":922,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.969763+0000","last_change":"2024-09-15T22:09:59.534976+0000","last_active":"2024-09-15T22:34:47.969763+0000","last_peered":"2024-09-15T22:34:47.969763+0000","last_clean":"2024-09-15T22:34:47.969763+0000","last_became_active":"2024-09-15T22:09:59.534485+0000","last_became_peered":"2024-09-15T22:09:59.534485+0000","last_unstale":"2024-09-15T22:34:47.969763+0000","last_undegraded":"2024-09-15T22:34:47.969763+0000","last_fullsized":"2024-09-15T22:34:47.969763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:42.051025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"27'851","reported_seq":885,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.971112+0000","last_change":"2024-09-15T22:09:17.401680+0000","last_active":"2024-09-15T22:34:47.971112+0000","last_peered":"2024-09-15T22:34:47.971112+0000","last_clean":"2024-09-15T22:34:47.971112+0000","last_became_active":"2024-09-15T22:09:17.401413+0000","last_became_peered":"2024-09-15T22:09:17.401413+0000","last_unstale":"2024-09-15T22:34:47.971112+0000","last_undegraded":"2024-09-15T22:34:47.971112+0000","last_fullsized":"2024-09-15T22:34:47.971112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:04.007901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'922","reported_seq":942,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.968907+0000","last_change":"2024-09-15T22:09:59.528330+0000","last_active":"2024-09-15T22:34:47.968907+0000","last_peered":"2024-09-15T22:34:47.968907+0000","last_clean":"2024-09-15T22:34:47.968907+0000","last_became_active":"2024-09-15T22:09:59.528000+0000","last_became_peered":"2024-09-15T22:09:59.528000+0000","last_unstale":"2024-09-15T22:34:47.968907+0000","last_undegraded":"2024-09-15T22:34:47.968907+0000","last_fullsized":"2024-09-15T22:34:47.968907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:36:15.431072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"27'882","reported_seq":916,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.993791+0000","last_change":"2024-09-15T22:09:17.411524+0000","last_active":"2024-09-15T22:34:47.993791+0000","last_peered":"2024-09-15T22:34:47.993791+0000","last_clean":"2024-09-15T22:34:47.993791+0000","last_became_active":"2024-09-15T22:09:17.411244+0000","last_became_peered":"2024-09-15T22:09:17.411244+0000","last_unstale":"2024-09-15T22:34:47.993791+0000","last_undegraded":"2024-09-15T22:34:47.993791+0000","last_fullsized":"2024-09-15T22:34:47.993791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'910","reported_seq":944,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.983245+0000","last_change":"2024-09-15T22:09:17.409933+0000","last_active":"2024-09-15T22:34:47.983245+0000","last_peered":"2024-09-15T22:34:47.983245+0000","last_clean":"2024-09-15T22:34:47.983245+0000","last_became_active":"2024-09-15T22:09:17.409681+0000","last_became_peered":"2024-09-15T22:09:17.409681+0000","last_unstale":"2024-09-15T22:34:47.983245+0000","last_undegraded":"2024-09-15T22:34:47.983245+0000","last_fullsized":"2024-09-15T22:34:47.983245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:37.130999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'858","reported_seq":892,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.974080+0000","last_change":"2024-09-15T22:09:17.403522+0000","last_active":"2024-09-15T22:34:47.974080+0000","last_peered":"2024-09-15T22:34:47.974080+0000","last_clean":"2024-09-15T22:34:47.974080+0000","last_became_active":"2024-09-15T22:09:17.403220+0000","last_became_peered":"2024-09-15T22:09:17.403220+0000","last_unstale":"2024-09-15T22:34:47.974080+0000","last_undegraded":"2024-09-15T22:34:47.974080+0000","last_fullsized":"2024-09-15T22:34:47.974080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:01.208798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'870","reported_seq":904,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.980323+0000","last_change":"2024-09-15T22:09:17.400537+0000","last_active":"2024-09-15T22:34:47.980323+0000","last_peered":"2024-09-15T22:34:47.980323+0000","last_clean":"2024-09-15T22:34:47.980323+0000","last_became_active":"2024-09-15T22:09:17.400288+0000","last_became_peered":"2024-09-15T22:09:17.400288+0000","last_unstale":"2024-09-15T22:34:47.980323+0000","last_undegraded":"2024-09-15T22:34:47.980323+0000","last_fullsized":"2024-09-15T22:34:47.980323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:14.673400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'857","reported_seq":891,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.984489+0000","last_change":"2024-09-15T22:09:17.404318+0000","last_active":"2024-09-15T22:34:47.984489+0000","last_peered":"2024-09-15T22:34:47.984489+0000","last_clean":"2024-09-15T22:34:47.984489+0000","last_became_active":"2024-09-15T22:09:17.404038+0000","last_became_peered":"2024-09-15T22:09:17.404038+0000","last_unstale":"2024-09-15T22:34:47.984489+0000","last_undegraded":"2024-09-15T22:34:47.984489+0000","last_fullsized":"2024-09-15T22:34:47.984489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:04.314746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'885","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.005482+0000","last_change":"2024-09-15T22:09:17.415645+0000","last_active":"2024-09-15T22:34:48.005482+0000","last_peered":"2024-09-15T22:34:48.005482+0000","last_clean":"2024-09-15T22:34:48.005482+0000","last_became_active":"2024-09-15T22:09:17.415354+0000","last_became_peered":"2024-09-15T22:09:17.415354+0000","last_unstale":"2024-09-15T22:34:48.005482+0000","last_undegraded":"2024-09-15T22:34:48.005482+0000","last_fullsized":"2024-09-15T22:34:48.005482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:25.662068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'874","reported_seq":908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.004288+0000","last_change":"2024-09-15T22:09:17.415171+0000","last_active":"2024-09-15T22:34:48.004288+0000","last_peered":"2024-09-15T22:34:48.004288+0000","last_clean":"2024-09-15T22:34:48.004288+0000","last_became_active":"2024-09-15T22:09:17.414875+0000","last_became_peered":"2024-09-15T22:09:17.414875+0000","last_unstale":"2024-09-15T22:34:48.004288+0000","last_undegraded":"2024-09-15T22:34:48.004288+0000","last_fullsized":"2024-09-15T22:34:48.004288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:17.441643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'913","reported_seq":947,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.006168+0000","last_change":"2024-09-15T22:09:17.420121+0000","last_active":"2024-09-15T22:34:48.006168+0000","last_peered":"2024-09-15T22:34:48.006168+0000","last_clean":"2024-09-15T22:34:48.006168+0000","last_became_active":"2024-09-15T22:09:17.419854+0000","last_became_peered":"2024-09-15T22:09:17.419854+0000","last_unstale":"2024-09-15T22:34:48.006168+0000","last_undegraded":"2024-09-15T22:34:48.006168+0000","last_fullsized":"2024-09-15T22:34:48.006168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":913,"log_dups_size":0,"ondisk_log_size":913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:41.421190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'862","reported_seq":896,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.992262+0000","last_change":"2024-09-15T22:09:17.414316+0000","last_active":"2024-09-15T22:34:47.992262+0000","last_peered":"2024-09-15T22:34:47.992262+0000","last_clean":"2024-09-15T22:34:47.992262+0000","last_became_active":"2024-09-15T22:09:17.414020+0000","last_became_peered":"2024-09-15T22:09:17.414020+0000","last_unstale":"2024-09-15T22:34:47.992262+0000","last_undegraded":"2024-09-15T22:34:47.992262+0000","last_fullsized":"2024-09-15T22:34:47.992262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:18.243909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'898","reported_seq":932,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.979726+0000","last_change":"2024-09-15T22:09:17.404509+0000","last_active":"2024-09-15T22:34:47.979726+0000","last_peered":"2024-09-15T22:34:47.979726+0000","last_clean":"2024-09-15T22:34:47.979726+0000","last_became_active":"2024-09-15T22:09:17.404181+0000","last_became_peered":"2024-09-15T22:09:17.404181+0000","last_unstale":"2024-09-15T22:34:47.979726+0000","last_undegraded":"2024-09-15T22:34:47.979726+0000","last_fullsized":"2024-09-15T22:34:47.979726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:22.003479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'835","reported_seq":869,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.004866+0000","last_change":"2024-09-15T22:09:17.414252+0000","last_active":"2024-09-15T22:34:48.004866+0000","last_peered":"2024-09-15T22:34:48.004866+0000","last_clean":"2024-09-15T22:34:48.004866+0000","last_became_active":"2024-09-15T22:09:17.413987+0000","last_became_peered":"2024-09-15T22:09:17.413987+0000","last_unstale":"2024-09-15T22:34:48.004866+0000","last_undegraded":"2024-09-15T22:34:48.004866+0000","last_fullsized":"2024-09-15T22:34:48.004866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:47.139849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'918","reported_seq":952,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.002775+0000","last_change":"2024-09-15T22:09:17.399744+0000","last_active":"2024-09-15T22:34:48.002775+0000","last_peered":"2024-09-15T22:34:48.002775+0000","last_clean":"2024-09-15T22:34:48.002775+0000","last_became_active":"2024-09-15T22:09:17.399470+0000","last_became_peered":"2024-09-15T22:09:17.399470+0000","last_unstale":"2024-09-15T22:34:48.002775+0000","last_undegraded":"2024-09-15T22:34:48.002775+0000","last_fullsized":"2024-09-15T22:34:48.002775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:04.868244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'877","reported_seq":899,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.973047+0000","last_change":"2024-09-15T22:09:59.804042+0000","last_active":"2024-09-15T22:34:47.973047+0000","last_peered":"2024-09-15T22:34:47.973047+0000","last_clean":"2024-09-15T22:34:47.973047+0000","last_became_active":"2024-09-15T22:09:59.803657+0000","last_became_peered":"2024-09-15T22:09:59.803657+0000","last_unstale":"2024-09-15T22:34:47.973047+0000","last_undegraded":"2024-09-15T22:34:47.973047+0000","last_fullsized":"2024-09-15T22:34:47.973047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:24.235395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'928","reported_seq":964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.967618+0000","last_change":"2024-09-15T22:09:17.404558+0000","last_active":"2024-09-15T22:34:47.967618+0000","last_peered":"2024-09-15T22:34:47.967618+0000","last_clean":"2024-09-15T22:34:47.967618+0000","last_became_active":"2024-09-15T22:09:17.404301+0000","last_became_peered":"2024-09-15T22:09:17.404301+0000","last_unstale":"2024-09-15T22:34:47.967618+0000","last_undegraded":"2024-09-15T22:34:47.967618+0000","last_fullsized":"2024-09-15T22:34:47.967618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:32.167540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'838","reported_seq":874,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.968650+0000","last_change":"2024-09-15T22:09:17.402881+0000","last_active":"2024-09-15T22:34:47.968650+0000","last_peered":"2024-09-15T22:34:47.968650+0000","last_clean":"2024-09-15T22:34:47.968650+0000","last_became_active":"2024-09-15T22:09:17.402632+0000","last_became_peered":"2024-09-15T22:09:17.402632+0000","last_unstale":"2024-09-15T22:34:47.968650+0000","last_undegraded":"2024-09-15T22:34:47.968650+0000","last_fullsized":"2024-09-15T22:34:47.968650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:30.142651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'834","reported_seq":870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.002340+0000","last_change":"2024-09-15T22:09:17.403017+0000","last_active":"2024-09-15T22:34:48.002340+0000","last_peered":"2024-09-15T22:34:48.002340+0000","last_clean":"2024-09-15T22:34:48.002340+0000","last_became_active":"2024-09-15T22:09:17.402751+0000","last_became_peered":"2024-09-15T22:09:17.402751+0000","last_unstale":"2024-09-15T22:34:48.002340+0000","last_undegraded":"2024-09-15T22:34:48.002340+0000","last_fullsized":"2024-09-15T22:34:48.002340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:26.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93952,"num_write_kb":3592319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123090,"ondisk_log_size":123090,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56939,"ondisk_log_size":56939,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":248781965,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2930,"num_read_kb":7996,"num_write":96422,"num_write_kb":735145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327397376,"data_stored":497646532,"data_compressed":51440825,"data_compressed_allocated":79159296,"data_compressed_original":249466880,"omap_allocated":0,"internal_metadata":0},"log_size":93516,"ondisk_log_size":93516,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542455,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":548100,"kb_used_data":43636,"kb_used_omap":1,"kb_used_meta":504446,"kb_avail":93823740,"statfs":{"total":96636764160,"available":96075509760,"internally_reserved":0,"allocated":44683264,"data_stored":67817371,"data_compressed":6954037,"data_compressed_allocated":10792960,"data_compressed_original":34103296,"omap_allocated":1590,"internal_metadata":516553162},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542455,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":562988,"kb_used_data":44636,"kb_used_omap":1,"kb_used_meta":518334,"kb_avail":93808852,"statfs":{"total":96636764160,"available":96060264448,"internally_reserved":0,"allocated":45707264,"data_stored":69135013,"data_compressed":7128351,"data_compressed_allocated":10952704,"data_compressed_original":34557952,"omap_allocated":1594,"internal_metadata":530774470},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542456,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":592620,"kb_used_data":61852,"kb_used_omap":1,"kb_used_meta":530750,"kb_avail":93779220,"statfs":{"total":96636764160,"available":96029921280,"internally_reserved":0,"allocated":63336448,"data_stored":97903198,"data_compressed":10447326,"data_compressed_allocated":15986688,"data_compressed_original":50728960,"omap_allocated":1594,"internal_metadata":543488454},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542457,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":450656,"kb_used_data":26640,"kb_used_omap":1,"kb_used_meta":423998,"kb_avail":93921184,"statfs":{"total":96636764160,"available":96175292416,"internally_reserved":0,"allocated":27279360,"data_stored":42060723,"data_compressed":4480082,"data_compressed_allocated":6909952,"data_compressed_original":21872640,"omap_allocated":1595,"internal_metadata":434174405},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542457,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":571996,"kb_used_data":41100,"kb_used_omap":1,"kb_used_meta":530878,"kb_avail":93799844,"statfs":{"total":96636764160,"available":96051040256,"internally_reserved":0,"allocated":42086400,"data_stored":63032789,"data_compressed":6347263,"data_compressed_allocated":9764864,"data_compressed_original":30887936,"omap_allocated":1593,"internal_metadata":543619527},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":336252,"kb_used_data":30188,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94035588,"statfs":{"total":96636764160,"available":96292442112,"internally_reserved":0,"allocated":30912512,"data_stored":46254901,"data_compressed":4726192,"data_compressed_allocated":7282688,"data_compressed_original":22794240,"omap_allocated":1592,"internal_metadata":313391560},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542456,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":399260,"kb_used_data":25228,"kb_used_omap":1,"kb_used_meta":374014,"kb_avail":93972580,"statfs":{"total":96636764160,"available":96227921920,"internally_reserved":0,"allocated":25833472,"data_stored":38457299,"data_compressed":3734837,"data_compressed_allocated":5775360,"data_compressed_original":18583552,"omap_allocated":1595,"internal_metadata":382990789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575161,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":657404,"kb_used_data":48812,"kb_used_omap":1,"kb_used_meta":608574,"kb_avail":93714436,"statfs":{"total":96636764160,"available":95963582464,"internally_reserved":0,"allocated":49983488,"data_stored":75106430,"data_compressed":7687781,"data_compressed_allocated":11784192,"data_compressed_original":37085184,"omap_allocated":1594,"internal_metadata":623180230},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25481216,"data_stored":37749374,"data_compressed":3702315,"data_compressed_allocated":5730304,"data_compressed_original":18010112,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49696768,"data_stored":74988873,"data_compressed":7687781,"data_compressed_allocated":11784192,"data_compressed_original":37085184,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30625792,"data_stored":46137344,"data_compressed":4726192,"data_compressed_allocated":7282688,"data_compressed_original":22794240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":41799680,"data_stored":62915232,"data_compressed":6347263,"data_compressed_allocated":9764864,"data_compressed_original":30887936,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26992640,"data_stored":41943166,"data_compressed":4480082,"data_compressed_allocated":6909952,"data_compressed_original":21872640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":63049728,"data_stored":97785641,"data_compressed":10447326,"data_compressed_allocated":15986688,"data_compressed_original":50728960,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45420544,"data_stored":69017456,"data_compressed":7128351,"data_compressed_allocated":10952704,"data_compressed_original":34557952,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":44331008,"data_stored":67109446,"data_compressed":6921515,"data_compressed_allocated":10747904,"data_compressed_original":33529856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:34:55.313 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:34:55.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.446+0000 7fa3c2bd6640 1 Processor -- start 2024-09-15T22:34:55.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.446+0000 7fa3c2bd6640 1 -- start start 2024-09-15T22:34:55.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.447+0000 7fa3c2bd6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc075520 0x7fa3bc14bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:55.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.447+0000 7fa3c2bd6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3bc075900 con 0x7fa3bc1417e0 2024-09-15T22:34:55.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.447+0000 7fa3c2bd6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3bc06dc00 con 0x7fa3bc147a50 2024-09-15T22:34:55.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.447+0000 7fa3c2bd6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa3bc14b6b0 con 0x7fa3bc075520 2024-09-15T22:34:55.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.447+0000 7fa3c1173640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa3bc1417e0 0x7fa3bc141c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60584/0 (socket says 172.21.15.78:60584) 2024-09-15T22:34:55.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.447+0000 7fa3c1173640 1 -- 172.21.15.78:0/3928077089 learned_addr learned my addr 172.21.15.78:0/3928077089 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:34:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.447+0000 7fa3c0972640 1 --2- 172.21.15.78:0/3928077089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc075520 0x7fa3bc14bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.447+0000 7fa3b37fe640 1 -- 172.21.15.78:0/3928077089 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1517272887 0 0) 0x7fa3bc075900 con 0x7fa3bc1417e0 2024-09-15T22:34:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.447+0000 7fa3b37fe640 1 -- 172.21.15.78:0/3928077089 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3a4003520 con 0x7fa3bc1417e0 2024-09-15T22:34:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.447+0000 7fa3b37fe640 1 -- 172.21.15.78:0/3928077089 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755087750 0 0) 0x7fa3bc06dc00 con 0x7fa3bc147a50 2024-09-15T22:34:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.447+0000 7fa3b37fe640 1 -- 172.21.15.78:0/3928077089 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3bc075900 con 0x7fa3bc147a50 2024-09-15T22:34:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.448+0000 7fa3c0972640 1 -- 172.21.15.78:0/3928077089 >> v1:172.21.15.175:6789/0 conn(0x7fa3bc147a50 legacy=0x7fa3bc09cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.448+0000 7fa3b37fe640 1 -- 172.21.15.78:0/3928077089 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2880202494 0 0) 0x7fa3a4003520 con 0x7fa3bc1417e0 2024-09-15T22:34:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.448+0000 7fa3c0972640 1 -- 172.21.15.78:0/3928077089 >> v1:172.21.15.78:6789/0 conn(0x7fa3bc1417e0 legacy=0x7fa3bc141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.448+0000 7fa3c0972640 1 -- 172.21.15.78:0/3928077089 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3bc14b060 con 0x7fa3bc075520 2024-09-15T22:34:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.448+0000 7fa3c0972640 1 --2- 172.21.15.78:0/3928077089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc075520 0x7fa3bc14bb40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80097d0 tx=0x7fa3b802a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53c53f73267d8cc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.448+0000 7fa3b37fe640 1 -- 172.21.15.78:0/3928077089 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8037070 con 0x7fa3bc075520 2024-09-15T22:34:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.449+0000 7fa3b37fe640 1 -- 172.21.15.78:0/3928077089 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b802ab10 con 0x7fa3bc075520 2024-09-15T22:34:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.449+0000 7fa3b37fe640 1 -- 172.21.15.78:0/3928077089 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40019f0 con 0x7fa3bc075520 2024-09-15T22:34:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.449+0000 7fa3c2bd6640 1 -- 172.21.15.78:0/3928077089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc075520 msgr2=0x7fa3bc14bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.449+0000 7fa3c2bd6640 1 --2- 172.21.15.78:0/3928077089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc075520 0x7fa3bc14bb40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80097d0 tx=0x7fa3b802a080 comp rx=0 tx=0).stop 2024-09-15T22:34:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.449+0000 7fa3c2bd6640 1 -- 172.21.15.78:0/3928077089 shutdown_connections 2024-09-15T22:34:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.449+0000 7fa3c2bd6640 1 --2- 172.21.15.78:0/3928077089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc075520 0x7fa3bc14bb40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.449+0000 7fa3c2bd6640 1 -- 172.21.15.78:0/3928077089 >> 172.21.15.78:0/3928077089 conn(0x7fa3bc0bdcb0 msgr2=0x7fa3bc074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.449+0000 7fa3c2bd6640 1 -- 172.21.15.78:0/3928077089 shutdown_connections 2024-09-15T22:34:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.449+0000 7fa3c2bd6640 1 -- 172.21.15.78:0/3928077089 wait complete. 2024-09-15T22:34:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.450+0000 7fa3c2bd6640 1 Processor -- start 2024-09-15T22:34:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.450+0000 7fa3c2bd6640 1 -- start start 2024-09-15T22:34:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3c2bd6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3bc075520 0x7fa3bc144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3c2bd6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3bc1417e0 0x7fa3bc1432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3c2bd6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc147a50 0x7fa3bc1ddbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3c2bd6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc0a2a60 con 0x7fa3bc1417e0 2024-09-15T22:34:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3c2bd6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc147e90 con 0x7fa3bc075520 2024-09-15T22:34:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3c2bd6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa3bc0a2be0 con 0x7fa3bc147a50 2024-09-15T22:34:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3b3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3bc1417e0 0x7fa3bc1432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3b3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3bc1417e0 0x7fa3bc1432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54366/0 (socket says 172.21.15.78:54366) 2024-09-15T22:34:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3c0972640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3bc075520 0x7fa3bc144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3b3fff640 1 -- 172.21.15.78:0/2472904641 learned_addr learned my addr 172.21.15.78:0/2472904641 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3c1173640 1 --2- 172.21.15.78:0/2472904641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc147a50 0x7fa3bc1ddbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3b3fff640 1 -- 172.21.15.78:0/2472904641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc147a50 msgr2=0x7fa3bc1ddbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3b3fff640 1 --2- 172.21.15.78:0/2472904641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc147a50 0x7fa3bc1ddbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3b3fff640 1 -- 172.21.15.78:0/2472904641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3bc075520 msgr2=0x7fa3bc144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3b3fff640 1 --2- 172.21.15.78:0/2472904641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3bc075520 0x7fa3bc144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3b3fff640 1 -- 172.21.15.78:0/2472904641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3bc1d1320 con 0x7fa3bc1417e0 2024-09-15T22:34:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.451+0000 7fa3b3fff640 1 --2- 172.21.15.78:0/2472904641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3bc1417e0 0x7fa3bc1432f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00c460 tx=0x7fa3ac00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.452+0000 7fa3b17fa640 1 -- 172.21.15.78:0/2472904641 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac0052d0 con 0x7fa3bc1417e0 2024-09-15T22:34:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.452+0000 7fa3b17fa640 1 -- 172.21.15.78:0/2472904641 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac005490 con 0x7fa3bc1417e0 2024-09-15T22:34:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.452+0000 7fa3b17fa640 1 -- 172.21.15.78:0/2472904641 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac012870 con 0x7fa3bc1417e0 2024-09-15T22:34:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.452+0000 7fa3c2bd6640 1 -- 172.21.15.78:0/2472904641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3bc144680 con 0x7fa3bc1417e0 2024-09-15T22:34:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.452+0000 7fa3c2bd6640 1 -- 172.21.15.78:0/2472904641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3bc144c40 con 0x7fa3bc1417e0 2024-09-15T22:34:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.452+0000 7fa3c2bd6640 1 -- 172.21.15.78:0/2472904641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3bc145460 con 0x7fa3bc1417e0 2024-09-15T22:34:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.453+0000 7fa3b17fa640 1 -- 172.21.15.78:0/2472904641 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa3ac012a10 con 0x7fa3bc1417e0 2024-09-15T22:34:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.453+0000 7fa3b17fa640 1 --2- 172.21.15.78:0/2472904641 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa3a806c2b0 0x7fa3a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.453+0000 7fa3b17fa640 1 -- 172.21.15.78:0/2472904641 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7fa3ac08b360 con 0x7fa3bc1417e0 2024-09-15T22:34:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.454+0000 7fa3c0972640 1 --2- 172.21.15.78:0/2472904641 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa3a806c2b0 0x7fa3a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.454+0000 7fa3c0972640 1 --2- 172.21.15.78:0/2472904641 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa3a806c2b0 0x7fa3a806e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8034000 tx=0x7fa3b802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.458+0000 7fa3b17fa640 1 -- 172.21.15.78:0/2472904641 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa3ac059030 con 0x7fa3bc1417e0 2024-09-15T22:34:55.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.625+0000 7fa3c2bd6640 1 -- 172.21.15.78:0/2472904641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3bc0bc9c0 con 0x7fa3bc1417e0 2024-09-15T22:34:55.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.627+0000 7fa3b17fa640 1 -- 172.21.15.78:0/2472904641 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+19081 (secure 0 0 0) 0x7fa3ac082e20 con 0x7fa3bc1417e0 2024-09-15T22:34:55.628 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:34:55.628 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":27,"fsid":"34e44e87-1d1a-416f-b208-c16e07980ff5","created":"2024-09-15T22:08:53.842443+0000","modified":"2024-09-15T22:09:59.520866+0000","last_up_change":"2024-09-15T22:09:04.830042+0000","last_in_change":"2024-09-15T22:08:55.864039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:05.999373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:14.532061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:15.710676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:09:19.437681+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"71eb9af6-bf66-4450-a5d1-d4a81f71f95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6817","nonce":3548923409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6819","nonce":3548923409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6823","nonce":3548923409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6821","nonce":3548923409}]},"public_addr":"172.21.15.78:6817/3548923409","cluster_addr":"172.21.15.78:6819/3548923409","heartbeat_back_addr":"172.21.15.78:6823/3548923409","heartbeat_front_addr":"172.21.15.78:6821/3548923409","state":["exists","up"]},{"osd":1,"uuid":"f0070f6d-7998-4ad3-b597-e5777e61d503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6809","nonce":1233827941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6811","nonce":1233827941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6815","nonce":1233827941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6813","nonce":1233827941}]},"public_addr":"172.21.15.78:6809/1233827941","cluster_addr":"172.21.15.78:6811/1233827941","heartbeat_back_addr":"172.21.15.78:6815/1233827941","heartbeat_front_addr":"172.21.15.78:6813/1233827941","state":["exists","up"]},{"osd":2,"uuid":"6d9c91c7-2c8a-48f9-9bef-67ea7320980e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6825","nonce":636523247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6827","nonce":636523247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6831","nonce":636523247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6829","nonce":636523247}]},"public_addr":"172.21.15.78:6825/636523247","cluster_addr":"172.21.15.78:6827/636523247","heartbeat_back_addr":"172.21.15.78:6831/636523247","heartbeat_front_addr":"172.21.15.78:6829/636523247","state":["exists","up"]},{"osd":3,"uuid":"943e38fb-b450-48c0-8f01-d381b0b8e313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6801","nonce":1841812488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6803","nonce":1841812488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6807","nonce":1841812488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6805","nonce":1841812488}]},"public_addr":"172.21.15.78:6801/1841812488","cluster_addr":"172.21.15.78:6803/1841812488","heartbeat_back_addr":"172.21.15.78:6807/1841812488","heartbeat_front_addr":"172.21.15.78:6805/1841812488","state":["exists","up"]},{"osd":4,"uuid":"259f50f8-3223-450d-8cd1-d0d333c278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6817","nonce":1803357070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6819","nonce":1803357070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6823","nonce":1803357070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6821","nonce":1803357070}]},"public_addr":"172.21.15.175:6817/1803357070","cluster_addr":"172.21.15.175:6819/1803357070","heartbeat_back_addr":"172.21.15.175:6823/1803357070","heartbeat_front_addr":"172.21.15.175:6821/1803357070","state":["exists","up"]},{"osd":5,"uuid":"d70426cd-a39b-4a20-8c7b-bedc8352e303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6825","nonce":2221415707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6827","nonce":2221415707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6831","nonce":2221415707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6829","nonce":2221415707}]},"public_addr":"172.21.15.175:6825/2221415707","cluster_addr":"172.21.15.175:6827/2221415707","heartbeat_back_addr":"172.21.15.175:6831/2221415707","heartbeat_front_addr":"172.21.15.175:6829/2221415707","state":["exists","up"]},{"osd":6,"uuid":"95b9ed3a-cbfc-45a5-8967-88db9da099ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6801","nonce":1974018373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6803","nonce":1974018373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6807","nonce":1974018373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6805","nonce":1974018373}]},"public_addr":"172.21.15.175:6801/1974018373","cluster_addr":"172.21.15.175:6803/1974018373","heartbeat_back_addr":"172.21.15.175:6807/1974018373","heartbeat_front_addr":"172.21.15.175:6805/1974018373","state":["exists","up"]},{"osd":7,"uuid":"5fc56286-91e9-4a13-b161-ad7d30fc0119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6809","nonce":2386415083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6811","nonce":2386415083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6815","nonce":2386415083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6813","nonce":2386415083}]},"public_addr":"172.21.15.175:6809/2386415083","cluster_addr":"172.21.15.175:6811/2386415083","heartbeat_back_addr":"172.21.15.175:6815/2386415083","heartbeat_front_addr":"172.21.15.175:6813/2386415083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.191845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.871482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.594323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.463568+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.398880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.490112+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.119097+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.677350+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":4,"to":6}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:34:55.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.629+0000 7fa3c2bd6640 1 -- 172.21.15.78:0/2472904641 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa3a806c2b0 msgr2=0x7fa3a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:55.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.629+0000 7fa3c2bd6640 1 --2- 172.21.15.78:0/2472904641 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa3a806c2b0 0x7fa3a806e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8034000 tx=0x7fa3b802e000 comp rx=0 tx=0).stop 2024-09-15T22:34:55.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.629+0000 7fa3c2bd6640 1 -- 172.21.15.78:0/2472904641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3bc1417e0 msgr2=0x7fa3bc1432f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:55.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.629+0000 7fa3c2bd6640 1 --2- 172.21.15.78:0/2472904641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3bc1417e0 0x7fa3bc1432f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00c460 tx=0x7fa3ac00c920 comp rx=0 tx=0).stop 2024-09-15T22:34:55.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.629+0000 7fa3c2bd6640 1 -- 172.21.15.78:0/2472904641 shutdown_connections 2024-09-15T22:34:55.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.629+0000 7fa3c2bd6640 1 --2- 172.21.15.78:0/2472904641 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa3a806c2b0 0x7fa3a806e770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.629+0000 7fa3c2bd6640 1 --2- 172.21.15.78:0/2472904641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc147a50 0x7fa3bc1ddbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.629+0000 7fa3c2bd6640 1 --2- 172.21.15.78:0/2472904641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3bc1417e0 0x7fa3bc1432f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.629+0000 7fa3c2bd6640 1 --2- 172.21.15.78:0/2472904641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3bc075520 0x7fa3bc144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:55.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.629+0000 7fa3c2bd6640 1 -- 172.21.15.78:0/2472904641 >> 172.21.15.78:0/2472904641 conn(0x7fa3bc0bdcb0 msgr2=0x7fa3bc146020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:55.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.629+0000 7fa3c2bd6640 1 -- 172.21.15.78:0/2472904641 shutdown_connections 2024-09-15T22:34:55.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:55.629+0000 7fa3c2bd6640 1 -- 172.21.15.78:0/2472904641 wait complete. 2024-09-15T22:34:56.641 INFO:tasks.ceph:Scrubbing osd.0 2024-09-15T22:34:56.642 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:34:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.755+0000 7fbb18b8d640 1 Processor -- start 2024-09-15T22:34:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.755+0000 7fbb18b8d640 1 -- start start 2024-09-15T22:34:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.756+0000 7fbb18b8d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbb140be0e0 0x7fbb1409c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.756+0000 7fbb18b8d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb140be4c0 con 0x7fbb1406cb00 2024-09-15T22:34:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.756+0000 7fbb18b8d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1406d1d0 con 0x7fbb14144cb0 2024-09-15T22:34:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.756+0000 7fbb18b8d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbb140bbd10 con 0x7fbb140be0e0 2024-09-15T22:34:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.756+0000 7fbb11d9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbb1406cb00 0x7fbb14147c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60594/0 (socket says 172.21.15.78:60594) 2024-09-15T22:34:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.756+0000 7fbb11d9b640 1 -- 172.21.15.78:0/3127611789 learned_addr learned my addr 172.21.15.78:0/3127611789 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:34:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.756+0000 7fbb1259c640 1 --2- 172.21.15.78:0/3127611789 >> v2:172.21.15.175:3300/0 conn(0x7fbb140be0e0 0x7fbb1409c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.757+0000 7fbb1159a640 1 -- 172.21.15.78:0/3127611789 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 686704701 0 0) 0x7fbb140be4c0 con 0x7fbb1406cb00 2024-09-15T22:34:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.757+0000 7fbb1159a640 1 -- 172.21.15.78:0/3127611789 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbafc003520 con 0x7fbb1406cb00 2024-09-15T22:34:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.757+0000 7fbb1259c640 1 -- 172.21.15.78:0/3127611789 >> v1:172.21.15.175:6789/0 conn(0x7fbb14144cb0 legacy=0x7fbb14145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.757+0000 7fbb1259c640 1 -- 172.21.15.78:0/3127611789 >> v1:172.21.15.78:6789/0 conn(0x7fbb1406cb00 legacy=0x7fbb14147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.757+0000 7fbb1259c640 1 -- 172.21.15.78:0/3127611789 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1406d4b0 con 0x7fbb140be0e0 2024-09-15T22:34:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.758+0000 7fbb1259c640 1 --2- 172.21.15.78:0/3127611789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb140be0e0 0x7fbb1409c680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb040097a0 tx=0x7fbb0402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9c55de3921b4998 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.758+0000 7fbb1159a640 1 -- 172.21.15.78:0/3127611789 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04037070 con 0x7fbb140be0e0 2024-09-15T22:34:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.758+0000 7fbb1159a640 1 -- 172.21.15.78:0/3127611789 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb04032440 con 0x7fbb140be0e0 2024-09-15T22:34:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.758+0000 7fbb1159a640 1 -- 172.21.15.78:0/3127611789 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04032810 con 0x7fbb140be0e0 2024-09-15T22:34:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.758+0000 7fbb18b8d640 1 -- 172.21.15.78:0/3127611789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb140be0e0 msgr2=0x7fbb1409c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.758+0000 7fbb18b8d640 1 --2- 172.21.15.78:0/3127611789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb140be0e0 0x7fbb1409c680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb040097a0 tx=0x7fbb0402a1a0 comp rx=0 tx=0).stop 2024-09-15T22:34:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.758+0000 7fbb18b8d640 1 -- 172.21.15.78:0/3127611789 shutdown_connections 2024-09-15T22:34:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.758+0000 7fbb18b8d640 1 --2- 172.21.15.78:0/3127611789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb140be0e0 0x7fbb1409c680 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.758+0000 7fbb18b8d640 1 -- 172.21.15.78:0/3127611789 >> 172.21.15.78:0/3127611789 conn(0x7fbb140751d0 msgr2=0x7fbb140bd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.759+0000 7fbb18b8d640 1 -- 172.21.15.78:0/3127611789 shutdown_connections 2024-09-15T22:34:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.759+0000 7fbb18b8d640 1 -- 172.21.15.78:0/3127611789 wait complete. 2024-09-15T22:34:56.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.760+0000 7fbb18b8d640 1 Processor -- start 2024-09-15T22:34:56.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.760+0000 7fbb18b8d640 1 -- start start 2024-09-15T22:34:56.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.760+0000 7fbb18b8d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1406cb00 0x7fbb140b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:56.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.760+0000 7fbb18b8d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb140be0e0 0x7fbb140ba9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:56.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.760+0000 7fbb18b8d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb14144cb0 0x7fbb140b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:56.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.760+0000 7fbb18b8d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1406db00 con 0x7fbb14144cb0 2024-09-15T22:34:56.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.760+0000 7fbb18b8d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1406c670 con 0x7fbb1406cb00 2024-09-15T22:34:56.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.760+0000 7fbb18b8d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbb141534f0 con 0x7fbb140be0e0 2024-09-15T22:34:56.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.760+0000 7fbb12d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb14144cb0 0x7fbb140b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:56.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.760+0000 7fbb1259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1406cb00 0x7fbb140b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.761+0000 7fbb12d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb14144cb0 0x7fbb140b4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54374/0 (socket says 172.21.15.78:54374) 2024-09-15T22:34:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.761+0000 7fbb12d9d640 1 -- 172.21.15.78:0/2564631169 learned_addr learned my addr 172.21.15.78:0/2564631169 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.761+0000 7fbb11d9b640 1 --2- 172.21.15.78:0/2564631169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb140be0e0 0x7fbb140ba9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.761+0000 7fbb1259c640 1 -- 172.21.15.78:0/2564631169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb140be0e0 msgr2=0x7fbb140ba9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.761+0000 7fbb1259c640 1 --2- 172.21.15.78:0/2564631169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb140be0e0 0x7fbb140ba9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.761+0000 7fbb1259c640 1 -- 172.21.15.78:0/2564631169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb14144cb0 msgr2=0x7fbb140b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.761+0000 7fbb1259c640 1 --2- 172.21.15.78:0/2564631169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb14144cb0 0x7fbb140b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.761+0000 7fbb1259c640 1 -- 172.21.15.78:0/2564631169 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb140b75a0 con 0x7fbb1406cb00 2024-09-15T22:34:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.761+0000 7fbb1259c640 1 --2- 172.21.15.78:0/2564631169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1406cb00 0x7fbb140b60d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb04031000 tx=0x7fbb040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.761+0000 7fbb02ffd640 1 -- 172.21.15.78:0/2564631169 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04041030 con 0x7fbb1406cb00 2024-09-15T22:34:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.761+0000 7fbb02ffd640 1 -- 172.21.15.78:0/2564631169 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb04030500 con 0x7fbb1406cb00 2024-09-15T22:34:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.761+0000 7fbb02ffd640 1 -- 172.21.15.78:0/2564631169 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04037040 con 0x7fbb1406cb00 2024-09-15T22:34:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.761+0000 7fbb18b8d640 1 -- 172.21.15.78:0/2564631169 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb140b6610 con 0x7fbb1406cb00 2024-09-15T22:34:56.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.761+0000 7fbb18b8d640 1 -- 172.21.15.78:0/2564631169 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb140baef0 con 0x7fbb1406cb00 2024-09-15T22:34:56.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.762+0000 7fbb18b8d640 1 -- 172.21.15.78:0/2564631169 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb140691d0 con 0x7fbb1406cb00 2024-09-15T22:34:56.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.763+0000 7fbb02ffd640 1 -- 172.21.15.78:0/2564631169 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbb04044070 con 0x7fbb1406cb00 2024-09-15T22:34:56.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.763+0000 7fbb02ffd640 1 --2- 172.21.15.78:0/2564631169 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbaf406c2b0 0x7fbaf406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:56.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.763+0000 7fbb02ffd640 1 -- 172.21.15.78:0/2564631169 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7fbb040abe10 con 0x7fbb1406cb00 2024-09-15T22:34:56.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.763+0000 7fbb11d9b640 1 --2- 172.21.15.78:0/2564631169 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbaf406c2b0 0x7fbaf406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:56.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.763+0000 7fbb02ffd640 1 --2- 172.21.15.78:0/2564631169 >> [v2:172.21.15.78:6816/3548923409,v1:172.21.15.78:6817/3548923409] conn(0x7fbaf4075ec0 0x7fbaf4078360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:56.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.763+0000 7fbb02ffd640 1 -- 172.21.15.78:0/2564631169 --> [v2:172.21.15.78:6816/3548923409,v1:172.21.15.78:6817/3548923409] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb0402be50 con 0x7fbaf4075ec0 2024-09-15T22:34:56.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.763+0000 7fbb02ffd640 1 -- 172.21.15.78:0/2564631169 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbb040b13e0 con 0x7fbb1406cb00 2024-09-15T22:34:56.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.764+0000 7fbb12d9d640 1 --2- 172.21.15.78:0/2564631169 >> [v2:172.21.15.78:6816/3548923409,v1:172.21.15.78:6817/3548923409] conn(0x7fbaf4075ec0 0x7fbaf4078360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:56.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.764+0000 7fbb11d9b640 1 --2- 172.21.15.78:0/2564631169 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbaf406c2b0 0x7fbaf406e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbb140a0380 tx=0x7fbb08007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:56.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.764+0000 7fbb12d9d640 1 --2- 172.21.15.78:0/2564631169 >> [v2:172.21.15.78:6816/3548923409,v1:172.21.15.78:6817/3548923409] conn(0x7fbaf4075ec0 0x7fbaf4078360 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:56.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.765+0000 7fbb02ffd640 1 -- 172.21.15.78:0/2564631169 <== osd.0 v2:172.21.15.78:6816/3548923409 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbb0402be50 con 0x7fbaf4075ec0 2024-09-15T22:34:56.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.777+0000 7fbb18b8d640 1 -- 172.21.15.78:0/2564631169 --> [v2:172.21.15.78:6816/3548923409,v1:172.21.15.78:6817/3548923409] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbb1409c680 con 0x7fbaf4075ec0 2024-09-15T22:34:56.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.777+0000 7fbb02ffd640 1 -- 172.21.15.78:0/2564631169 <== osd.0 v2:172.21.15.78:6816/3548923409 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbb1409c680 con 0x7fbaf4075ec0 2024-09-15T22:34:56.778 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-15T22:34:56.778 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:34:56.779 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-15T22:34:56.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.778+0000 7fbb18b8d640 1 -- 172.21.15.78:0/2564631169 >> [v2:172.21.15.78:6816/3548923409,v1:172.21.15.78:6817/3548923409] conn(0x7fbaf4075ec0 msgr2=0x7fbaf4078360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:56.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.778+0000 7fbb18b8d640 1 --2- 172.21.15.78:0/2564631169 >> [v2:172.21.15.78:6816/3548923409,v1:172.21.15.78:6817/3548923409] conn(0x7fbaf4075ec0 0x7fbaf4078360 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:56.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.778+0000 7fbb18b8d640 1 -- 172.21.15.78:0/2564631169 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbaf406c2b0 msgr2=0x7fbaf406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:56.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.778+0000 7fbb18b8d640 1 --2- 172.21.15.78:0/2564631169 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbaf406c2b0 0x7fbaf406e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbb140a0380 tx=0x7fbb08007d30 comp rx=0 tx=0).stop 2024-09-15T22:34:56.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.778+0000 7fbb18b8d640 1 -- 172.21.15.78:0/2564631169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1406cb00 msgr2=0x7fbb140b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:56.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.778+0000 7fbb18b8d640 1 --2- 172.21.15.78:0/2564631169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1406cb00 0x7fbb140b60d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb04031000 tx=0x7fbb040046c0 comp rx=0 tx=0).stop 2024-09-15T22:34:56.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.778+0000 7fbb12d9d640 1 -- 172.21.15.78:0/2564631169 reap_dead start 2024-09-15T22:34:56.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.778+0000 7fbb18b8d640 1 -- 172.21.15.78:0/2564631169 shutdown_connections 2024-09-15T22:34:56.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.778+0000 7fbb18b8d640 1 -- 172.21.15.78:0/2564631169 >> 172.21.15.78:0/2564631169 conn(0x7fbb140751d0 msgr2=0x7fbb14142a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:56.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.778+0000 7fbb18b8d640 1 -- 172.21.15.78:0/2564631169 shutdown_connections 2024-09-15T22:34:56.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.778+0000 7fbb18b8d640 1 -- 172.21.15.78:0/2564631169 wait complete. 2024-09-15T22:34:56.789 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-15T22:34:56.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.887+0000 7faa5d62c640 1 Processor -- start 2024-09-15T22:34:56.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.887+0000 7faa5d62c640 1 -- start start 2024-09-15T22:34:56.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.887+0000 7faa5d62c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faa580ba270 0x7faa580b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:56.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.887+0000 7faa5d62c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa581417f0 0x7faa58141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:56.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.887+0000 7faa5d62c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa580b6c90 con 0x7faa580b7f70 2024-09-15T22:34:56.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.887+0000 7faa5d62c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7faa580b6f00 con 0x7faa580ba270 2024-09-15T22:34:56.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.887+0000 7faa5d62c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faa580b7a80 con 0x7faa581417f0 2024-09-15T22:34:56.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.887+0000 7faa56ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faa580ba270 0x7faa580b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:56.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.887+0000 7faa577fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7faa580b7f70 0x7faa580b8420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60610/0 (socket says 172.21.15.78:60610) 2024-09-15T22:34:56.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.887+0000 7faa577fe640 1 -- 172.21.15.78:0/1791016779 learned_addr learned my addr 172.21.15.78:0/1791016779 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:34:56.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.888+0000 7faa567fc640 1 --2- 172.21.15.78:0/1791016779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa581417f0 0x7faa58141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:56.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.888+0000 7faa56ffd640 1 -- 172.21.15.78:0/1791016779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa581417f0 msgr2=0x7faa58141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:56.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.888+0000 7faa56ffd640 1 --2- 172.21.15.78:0/1791016779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa581417f0 0x7faa58141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:56.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.888+0000 7faa56ffd640 1 -- 172.21.15.78:0/1791016779 >> v1:172.21.15.78:6789/0 conn(0x7faa580b7f70 legacy=0x7faa580b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:56.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.888+0000 7faa55ffb640 1 -- 172.21.15.78:0/1791016779 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 386863077 0 0) 0x7faa580b6c90 con 0x7faa580b7f70 2024-09-15T22:34:56.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.888+0000 7faa56ffd640 1 -- 172.21.15.78:0/1791016779 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa580ba650 con 0x7faa580ba270 2024-09-15T22:34:56.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.888+0000 7faa56ffd640 1 --2- 172.21.15.78:0/1791016779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa580ba270 0x7faa580b97b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faa480097a0 tx=0x7faa4802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79a1d5f6f982c38 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:56.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.889+0000 7faa55ffb640 1 -- 172.21.15.78:0/1791016779 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa48037070 con 0x7faa580ba270 2024-09-15T22:34:56.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.889+0000 7faa55ffb640 1 -- 172.21.15.78:0/1791016779 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4802adb0 con 0x7faa580ba270 2024-09-15T22:34:56.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.889+0000 7faa55ffb640 1 -- 172.21.15.78:0/1791016779 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa48032660 con 0x7faa580ba270 2024-09-15T22:34:56.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.889+0000 7faa5d62c640 1 -- 172.21.15.78:0/1791016779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa580ba270 msgr2=0x7faa580b97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:56.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.889+0000 7faa5d62c640 1 --2- 172.21.15.78:0/1791016779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa580ba270 0x7faa580b97b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faa480097a0 tx=0x7faa4802a060 comp rx=0 tx=0).stop 2024-09-15T22:34:56.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.889+0000 7faa5d62c640 1 -- 172.21.15.78:0/1791016779 shutdown_connections 2024-09-15T22:34:56.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.889+0000 7faa5d62c640 1 --2- 172.21.15.78:0/1791016779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa581417f0 0x7faa58141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:56.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.889+0000 7faa5d62c640 1 --2- 172.21.15.78:0/1791016779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa580ba270 0x7faa580b97b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:56.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.889+0000 7faa5d62c640 1 -- 172.21.15.78:0/1791016779 >> 172.21.15.78:0/1791016779 conn(0x7faa58074ba0 msgr2=0x7faa58074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:56.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.889+0000 7faa5d62c640 1 -- 172.21.15.78:0/1791016779 shutdown_connections 2024-09-15T22:34:56.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.889+0000 7faa5d62c640 1 -- 172.21.15.78:0/1791016779 wait complete. 2024-09-15T22:34:56.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.890+0000 7faa5d62c640 1 Processor -- start 2024-09-15T22:34:56.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.890+0000 7faa5d62c640 1 -- start start 2024-09-15T22:34:56.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa5d62c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa580b7f70 0x7faa58147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:56.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa5d62c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa580ba270 0x7faa580bc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:56.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa5d62c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa581417f0 0x7faa580bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:56.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa5d62c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7faa580b77a0 con 0x7faa581417f0 2024-09-15T22:34:56.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa5d62c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa580b74c0 con 0x7faa580ba270 2024-09-15T22:34:56.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa5d62c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faa580b4a70 con 0x7faa580b7f70 2024-09-15T22:34:56.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa577fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa581417f0 0x7faa580bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:56.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa577fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa581417f0 0x7faa580bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54400/0 (socket says 172.21.15.78:54400) 2024-09-15T22:34:56.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa577fe640 1 -- 172.21.15.78:0/1663292903 learned_addr learned my addr 172.21.15.78:0/1663292903 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:56.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa56ffd640 1 --2- 172.21.15.78:0/1663292903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa580b7f70 0x7faa58147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:56.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa567fc640 1 --2- 172.21.15.78:0/1663292903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa580ba270 0x7faa580bc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:56.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa577fe640 1 -- 172.21.15.78:0/1663292903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa580b7f70 msgr2=0x7faa58147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:56.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa577fe640 1 --2- 172.21.15.78:0/1663292903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa580b7f70 0x7faa58147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:56.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa577fe640 1 -- 172.21.15.78:0/1663292903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa580ba270 msgr2=0x7faa580bc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:56.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa577fe640 1 --2- 172.21.15.78:0/1663292903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa580ba270 0x7faa580bc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:56.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa577fe640 1 -- 172.21.15.78:0/1663292903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa581471c0 con 0x7faa581417f0 2024-09-15T22:34:56.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa577fe640 1 --2- 172.21.15.78:0/1663292903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa581417f0 0x7faa580bcc70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faa5000c7d0 tx=0x7faa5000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:56.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa3f7fe640 1 -- 172.21.15.78:0/1663292903 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa50018070 con 0x7faa581417f0 2024-09-15T22:34:56.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa3f7fe640 1 -- 172.21.15.78:0/1663292903 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa5000a640 con 0x7faa581417f0 2024-09-15T22:34:56.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.891+0000 7faa5d62c640 1 -- 172.21.15.78:0/1663292903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa58146200 con 0x7faa581417f0 2024-09-15T22:34:56.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.892+0000 7faa3f7fe640 1 -- 172.21.15.78:0/1663292903 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5000aa70 con 0x7faa581417f0 2024-09-15T22:34:56.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.892+0000 7faa5d62c640 1 -- 172.21.15.78:0/1663292903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa580aa780 con 0x7faa581417f0 2024-09-15T22:34:56.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.893+0000 7faa5d62c640 1 -- 172.21.15.78:0/1663292903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa580b5ce0 con 0x7faa581417f0 2024-09-15T22:34:56.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.893+0000 7faa3f7fe640 1 -- 172.21.15.78:0/1663292903 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faa5001b070 con 0x7faa581417f0 2024-09-15T22:34:56.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.893+0000 7faa3f7fe640 1 --2- 172.21.15.78:0/1663292903 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7faa4406c2b0 0x7faa4406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:56.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.894+0000 7faa3f7fe640 1 -- 172.21.15.78:0/1663292903 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7faa5008ad80 con 0x7faa581417f0 2024-09-15T22:34:56.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.894+0000 7faa56ffd640 1 --2- 172.21.15.78:0/1663292903 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7faa4406c2b0 0x7faa4406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:56.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.894+0000 7faa56ffd640 1 --2- 172.21.15.78:0/1663292903 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7faa4406c2b0 0x7faa4406e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faa48034000 tx=0x7faa4802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:56.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:56.898+0000 7faa3f7fe640 1 -- 172.21.15.78:0/1663292903 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faa50058ad0 con 0x7faa581417f0 2024-09-15T22:34:57.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.067+0000 7faa5d62c640 1 -- 172.21.15.78:0/1663292903 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7faa5814a570 con 0x7faa4406c2b0 2024-09-15T22:34:57.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.067+0000 7faa3f7fe640 1 -- 172.21.15.78:0/1663292903 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faa5814a570 con 0x7faa4406c2b0 2024-09-15T22:34:57.068 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 0 to deep-scrub 2024-09-15T22:34:57.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.069+0000 7faa5d62c640 1 -- 172.21.15.78:0/1663292903 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7faa4406c2b0 msgr2=0x7faa4406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.069+0000 7faa5d62c640 1 --2- 172.21.15.78:0/1663292903 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7faa4406c2b0 0x7faa4406e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faa48034000 tx=0x7faa4802e000 comp rx=0 tx=0).stop 2024-09-15T22:34:57.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.069+0000 7faa5d62c640 1 -- 172.21.15.78:0/1663292903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa581417f0 msgr2=0x7faa580bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.069+0000 7faa5d62c640 1 --2- 172.21.15.78:0/1663292903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa581417f0 0x7faa580bcc70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faa5000c7d0 tx=0x7faa5000cc90 comp rx=0 tx=0).stop 2024-09-15T22:34:57.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.069+0000 7faa5d62c640 1 -- 172.21.15.78:0/1663292903 shutdown_connections 2024-09-15T22:34:57.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.069+0000 7faa5d62c640 1 --2- 172.21.15.78:0/1663292903 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7faa4406c2b0 0x7faa4406e770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.069+0000 7faa5d62c640 1 --2- 172.21.15.78:0/1663292903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa581417f0 0x7faa580bcc70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.069+0000 7faa5d62c640 1 --2- 172.21.15.78:0/1663292903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa580ba270 0x7faa580bc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.069+0000 7faa5d62c640 1 --2- 172.21.15.78:0/1663292903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa580b7f70 0x7faa58147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.069+0000 7faa5d62c640 1 -- 172.21.15.78:0/1663292903 >> 172.21.15.78:0/1663292903 conn(0x7faa58074ba0 msgr2=0x7faa58074f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:57.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.069+0000 7faa5d62c640 1 -- 172.21.15.78:0/1663292903 shutdown_connections 2024-09-15T22:34:57.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.070+0000 7faa5d62c640 1 -- 172.21.15.78:0/1663292903 wait complete. 2024-09-15T22:34:57.081 INFO:tasks.ceph:Scrubbing osd.1 2024-09-15T22:34:57.081 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:34:57.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.182+0000 7f94ca62e640 1 Processor -- start 2024-09-15T22:34:57.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.183+0000 7f94ca62e640 1 -- start start 2024-09-15T22:34:57.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.183+0000 7f94ca62e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c40b40a0 0x7f94c40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.183+0000 7f94ca62e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f94c40b4b50 0x7f94c4148060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.183+0000 7f94ca62e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94c41485a0 0x7f94c4148a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.183+0000 7f94ca62e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f94c40b92b0 con 0x7f94c40b4b50 2024-09-15T22:34:57.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.183+0000 7f94ca62e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f94c4145ac0 con 0x7f94c41485a0 2024-09-15T22:34:57.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.183+0000 7f94ca62e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f94c40b5ad0 con 0x7f94c40b40a0 2024-09-15T22:34:57.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.183+0000 7f94c37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f94c40b4b50 0x7f94c4148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.183+0000 7f94c37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f94c40b4b50 0x7f94c4148060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54410/0 (socket says 172.21.15.78:54410) 2024-09-15T22:34:57.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.183+0000 7f94c37fe640 1 -- 172.21.15.78:0/2758812866 learned_addr learned my addr 172.21.15.78:0/2758812866 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:57.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.183+0000 7f94c3fff640 1 --2- 172.21.15.78:0/2758812866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c40b40a0 0x7f94c40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.183+0000 7f94c8bcb640 1 --2- 172.21.15.78:0/2758812866 >> v2:172.21.15.175:3300/0 conn(0x7f94c41485a0 0x7f94c4148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.184+0000 7f94c37fe640 1 -- 172.21.15.78:0/2758812866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c40b40a0 msgr2=0x7f94c40b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:57.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.184+0000 7f94c37fe640 1 --2- 172.21.15.78:0/2758812866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c40b40a0 0x7f94c40b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.184+0000 7f94c37fe640 1 -- 172.21.15.78:0/2758812866 >> v2:172.21.15.175:3300/0 conn(0x7f94c41485a0 msgr2=0x7f94c4148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:57.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.184+0000 7f94c37fe640 1 --2- 172.21.15.78:0/2758812866 >> v2:172.21.15.175:3300/0 conn(0x7f94c41485a0 0x7f94c4148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.184+0000 7f94c37fe640 1 -- 172.21.15.78:0/2758812866 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c40b5d00 con 0x7f94c40b4b50 2024-09-15T22:34:57.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.184+0000 7f94c37fe640 1 --2- 172.21.15.78:0/2758812866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c40b4b50 0x7f94c4148060 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94c40b6ff0 tx=0x7f94b802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35917a70edb905c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:57.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.184+0000 7f94c2ffd640 1 -- 172.21.15.78:0/2758812866 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8032790 con 0x7f94c40b4b50 2024-09-15T22:34:57.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.184+0000 7f94c2ffd640 1 -- 172.21.15.78:0/2758812866 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b8038070 con 0x7f94c40b4b50 2024-09-15T22:34:57.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.184+0000 7f94c2ffd640 1 -- 172.21.15.78:0/2758812866 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8032b50 con 0x7f94c40b4b50 2024-09-15T22:34:57.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.185+0000 7f94ca62e640 1 -- 172.21.15.78:0/2758812866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c40b4b50 msgr2=0x7f94c4148060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.185+0000 7f94ca62e640 1 --2- 172.21.15.78:0/2758812866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c40b4b50 0x7f94c4148060 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94c40b6ff0 tx=0x7f94b802c890 comp rx=0 tx=0).stop 2024-09-15T22:34:57.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.185+0000 7f94ca62e640 1 -- 172.21.15.78:0/2758812866 shutdown_connections 2024-09-15T22:34:57.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.185+0000 7f94ca62e640 1 --2- 172.21.15.78:0/2758812866 >> v2:172.21.15.175:3300/0 conn(0x7f94c41485a0 0x7f94c4148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.185+0000 7f94ca62e640 1 --2- 172.21.15.78:0/2758812866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c40b4b50 0x7f94c4148060 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.185+0000 7f94ca62e640 1 --2- 172.21.15.78:0/2758812866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c40b40a0 0x7f94c40b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.185+0000 7f94ca62e640 1 -- 172.21.15.78:0/2758812866 >> 172.21.15.78:0/2758812866 conn(0x7f94c40b9430 msgr2=0x7f94c40b9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:57.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.185+0000 7f94ca62e640 1 -- 172.21.15.78:0/2758812866 shutdown_connections 2024-09-15T22:34:57.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.185+0000 7f94ca62e640 1 -- 172.21.15.78:0/2758812866 wait complete. 2024-09-15T22:34:57.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.186+0000 7f94ca62e640 1 Processor -- start 2024-09-15T22:34:57.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.186+0000 7f94ca62e640 1 -- start start 2024-09-15T22:34:57.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94ca62e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c40b40a0 0x7f94c41d90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94ca62e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94c40b4b50 0x7f94c41406e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94ca62e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c41485a0 0x7f94c4072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94ca62e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f94c40b5fa0 con 0x7f94c40b40a0 2024-09-15T22:34:57.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94ca62e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f94c40b5360 con 0x7f94c40b4b50 2024-09-15T22:34:57.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94ca62e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f94c40b8bb0 con 0x7f94c41485a0 2024-09-15T22:34:57.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94c3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c40b40a0 0x7f94c41d90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94c3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c40b40a0 0x7f94c41d90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54418/0 (socket says 172.21.15.78:54418) 2024-09-15T22:34:57.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94c3fff640 1 -- 172.21.15.78:0/2626194403 learned_addr learned my addr 172.21.15.78:0/2626194403 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:57.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94c37fe640 1 --2- 172.21.15.78:0/2626194403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94c40b4b50 0x7f94c41406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94c8bcb640 1 --2- 172.21.15.78:0/2626194403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c41485a0 0x7f94c4072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94c3fff640 1 -- 172.21.15.78:0/2626194403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c41485a0 msgr2=0x7f94c4072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94c3fff640 1 --2- 172.21.15.78:0/2626194403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94c41485a0 0x7f94c4072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94c3fff640 1 -- 172.21.15.78:0/2626194403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94c40b4b50 msgr2=0x7f94c41406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94c3fff640 1 --2- 172.21.15.78:0/2626194403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94c40b4b50 0x7f94c41406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94c3fff640 1 -- 172.21.15.78:0/2626194403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c41d9740 con 0x7f94c40b40a0 2024-09-15T22:34:57.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.187+0000 7f94c3fff640 1 --2- 172.21.15.78:0/2626194403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c40b40a0 0x7f94c41d90b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f94b400e9b0 tx=0x7f94b400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:57.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.188+0000 7f94c0ff9640 1 -- 172.21.15.78:0/2626194403 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4017070 con 0x7f94c40b40a0 2024-09-15T22:34:57.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.188+0000 7f94c0ff9640 1 -- 172.21.15.78:0/2626194403 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b400c9a0 con 0x7f94c40b40a0 2024-09-15T22:34:57.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.188+0000 7f94ca62e640 1 -- 172.21.15.78:0/2626194403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c41d9a20 con 0x7f94c40b40a0 2024-09-15T22:34:57.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.188+0000 7f94c0ff9640 1 -- 172.21.15.78:0/2626194403 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b400cd90 con 0x7f94c40b40a0 2024-09-15T22:34:57.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.188+0000 7f94ca62e640 1 -- 172.21.15.78:0/2626194403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c4140d60 con 0x7f94c40b40a0 2024-09-15T22:34:57.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.189+0000 7f94ca62e640 1 -- 172.21.15.78:0/2626194403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f94c41d9e00 con 0x7f94c40b40a0 2024-09-15T22:34:57.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.189+0000 7f94c0ff9640 1 -- 172.21.15.78:0/2626194403 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f94b401a070 con 0x7f94c40b40a0 2024-09-15T22:34:57.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.189+0000 7f94c0ff9640 1 --2- 172.21.15.78:0/2626194403 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f94b006c2b0 0x7f94b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.189+0000 7f94c0ff9640 1 -- 172.21.15.78:0/2626194403 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7f94b408bb50 con 0x7f94c40b40a0 2024-09-15T22:34:57.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.189+0000 7f94c37fe640 1 --2- 172.21.15.78:0/2626194403 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f94b006c2b0 0x7f94b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.190+0000 7f94c0ff9640 1 --2- 172.21.15.78:0/2626194403 >> [v2:172.21.15.78:6808/1233827941,v1:172.21.15.78:6809/1233827941] conn(0x7f94b0075e40 0x7f94b00782e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.190+0000 7f94c0ff9640 1 -- 172.21.15.78:0/2626194403 --> [v2:172.21.15.78:6808/1233827941,v1:172.21.15.78:6809/1233827941] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f94b401fe50 con 0x7f94b0075e40 2024-09-15T22:34:57.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.190+0000 7f94c0ff9640 1 -- 172.21.15.78:0/2626194403 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f94b40902c0 con 0x7f94c40b40a0 2024-09-15T22:34:57.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.190+0000 7f94c8bcb640 1 --2- 172.21.15.78:0/2626194403 >> [v2:172.21.15.78:6808/1233827941,v1:172.21.15.78:6809/1233827941] conn(0x7f94b0075e40 0x7f94b00782e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.190+0000 7f94c37fe640 1 --2- 172.21.15.78:0/2626194403 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f94b006c2b0 0x7f94b006e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f94b8037000 tx=0x7f94b803e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:57.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.190+0000 7f94c8bcb640 1 --2- 172.21.15.78:0/2626194403 >> [v2:172.21.15.78:6808/1233827941,v1:172.21.15.78:6809/1233827941] conn(0x7f94b0075e40 0x7f94b00782e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:57.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.191+0000 7f94c0ff9640 1 -- 172.21.15.78:0/2626194403 <== osd.1 v2:172.21.15.78:6808/1233827941 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f94b401fe50 con 0x7f94b0075e40 2024-09-15T22:34:57.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.203+0000 7f94ca62e640 1 -- 172.21.15.78:0/2626194403 --> [v2:172.21.15.78:6808/1233827941,v1:172.21.15.78:6809/1233827941] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f94c40734a0 con 0x7f94b0075e40 2024-09-15T22:34:57.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.203+0000 7f94c0ff9640 1 -- 172.21.15.78:0/2626194403 <== osd.1 v2:172.21.15.78:6808/1233827941 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f94c40734a0 con 0x7f94b0075e40 2024-09-15T22:34:57.204 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-15T22:34:57.204 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:34:57.204 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-15T22:34:57.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.203+0000 7f94ca62e640 1 -- 172.21.15.78:0/2626194403 >> [v2:172.21.15.78:6808/1233827941,v1:172.21.15.78:6809/1233827941] conn(0x7f94b0075e40 msgr2=0x7f94b00782e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.203+0000 7f94ca62e640 1 --2- 172.21.15.78:0/2626194403 >> [v2:172.21.15.78:6808/1233827941,v1:172.21.15.78:6809/1233827941] conn(0x7f94b0075e40 0x7f94b00782e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.203+0000 7f94ca62e640 1 -- 172.21.15.78:0/2626194403 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f94b006c2b0 msgr2=0x7f94b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.204+0000 7f94ca62e640 1 --2- 172.21.15.78:0/2626194403 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f94b006c2b0 0x7f94b006e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f94b8037000 tx=0x7f94b803e040 comp rx=0 tx=0).stop 2024-09-15T22:34:57.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.204+0000 7f94ca62e640 1 -- 172.21.15.78:0/2626194403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c40b40a0 msgr2=0x7f94c41d90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.204+0000 7f94ca62e640 1 --2- 172.21.15.78:0/2626194403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c40b40a0 0x7f94c41d90b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f94b400e9b0 tx=0x7f94b400ee70 comp rx=0 tx=0).stop 2024-09-15T22:34:57.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.204+0000 7f94c8bcb640 1 -- 172.21.15.78:0/2626194403 reap_dead start 2024-09-15T22:34:57.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.204+0000 7f94ca62e640 1 -- 172.21.15.78:0/2626194403 shutdown_connections 2024-09-15T22:34:57.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.204+0000 7f94ca62e640 1 -- 172.21.15.78:0/2626194403 >> 172.21.15.78:0/2626194403 conn(0x7f94c40b9430 msgr2=0x7f94c4143b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:57.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.204+0000 7f94ca62e640 1 -- 172.21.15.78:0/2626194403 shutdown_connections 2024-09-15T22:34:57.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.204+0000 7f94ca62e640 1 -- 172.21.15.78:0/2626194403 wait complete. 2024-09-15T22:34:57.215 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-15T22:34:57.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.313+0000 7f7dd31b7640 1 Processor -- start 2024-09-15T22:34:57.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.313+0000 7f7dd31b7640 1 -- start start 2024-09-15T22:34:57.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.313+0000 7f7dd31b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dcc1431c0 0x7f7dcc1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.313+0000 7f7dd31b7640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc0634a0 con 0x7f7dcc0630c0 2024-09-15T22:34:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.313+0000 7f7dd31b7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc0709b0 con 0x7f7dcc146200 2024-09-15T22:34:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.313+0000 7f7dd31b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7dcc0b6050 con 0x7f7dcc1431c0 2024-09-15T22:34:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.314+0000 7f7dd0f53640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7dcc0630c0 0x7f7dcc145af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60620/0 (socket says 172.21.15.78:60620) 2024-09-15T22:34:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.314+0000 7f7dd0f53640 1 -- 172.21.15.78:0/4246001733 learned_addr learned my addr 172.21.15.78:0/4246001733 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:34:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.314+0000 7f7dd1754640 1 --2- 172.21.15.78:0/4246001733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dcc1431c0 0x7f7dcc1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.314+0000 7f7dc37fe640 1 -- 172.21.15.78:0/4246001733 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2995791701 0 0) 0x7f7dcc0634a0 con 0x7f7dcc0630c0 2024-09-15T22:34:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.314+0000 7f7dc37fe640 1 -- 172.21.15.78:0/4246001733 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7db4003520 con 0x7f7dcc0630c0 2024-09-15T22:34:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.314+0000 7f7dc37fe640 1 -- 172.21.15.78:0/4246001733 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 485777239 0 0) 0x7f7dcc0709b0 con 0x7f7dcc146200 2024-09-15T22:34:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.314+0000 7f7dc37fe640 1 -- 172.21.15.78:0/4246001733 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dcc0634a0 con 0x7f7dcc146200 2024-09-15T22:34:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.314+0000 7f7dd1754640 1 -- 172.21.15.78:0/4246001733 >> v1:172.21.15.175:6789/0 conn(0x7f7dcc146200 legacy=0x7f7dcc142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.314+0000 7f7dd1754640 1 -- 172.21.15.78:0/4246001733 >> v1:172.21.15.78:6789/0 conn(0x7f7dcc0630c0 legacy=0x7f7dcc145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.314+0000 7f7dd1754640 1 -- 172.21.15.78:0/4246001733 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc0b0b10 con 0x7f7dcc1431c0 2024-09-15T22:34:57.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.315+0000 7f7dd1754640 1 --2- 172.21.15.78:0/4246001733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dcc1431c0 0x7f7dcc1512c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009dc0 tx=0x7f7dc402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5af0ad66724ef702 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:57.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.315+0000 7f7dc37fe640 1 -- 172.21.15.78:0/4246001733 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc402ae60 con 0x7f7dcc1431c0 2024-09-15T22:34:57.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.315+0000 7f7dc37fe640 1 -- 172.21.15.78:0/4246001733 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc4007740 con 0x7f7dcc1431c0 2024-09-15T22:34:57.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.315+0000 7f7dc37fe640 1 -- 172.21.15.78:0/4246001733 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4007b10 con 0x7f7dcc1431c0 2024-09-15T22:34:57.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.315+0000 7f7dd31b7640 1 -- 172.21.15.78:0/4246001733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dcc1431c0 msgr2=0x7f7dcc1512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.315+0000 7f7dd31b7640 1 --2- 172.21.15.78:0/4246001733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dcc1431c0 0x7f7dcc1512c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009dc0 tx=0x7f7dc402a640 comp rx=0 tx=0).stop 2024-09-15T22:34:57.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.316+0000 7f7dd31b7640 1 -- 172.21.15.78:0/4246001733 shutdown_connections 2024-09-15T22:34:57.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.316+0000 7f7dd31b7640 1 --2- 172.21.15.78:0/4246001733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dcc1431c0 0x7f7dcc1512c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.316+0000 7f7dd31b7640 1 -- 172.21.15.78:0/4246001733 >> 172.21.15.78:0/4246001733 conn(0x7f7dcc0b6470 msgr2=0x7f7dcc0b6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:57.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.316+0000 7f7dd31b7640 1 -- 172.21.15.78:0/4246001733 shutdown_connections 2024-09-15T22:34:57.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.316+0000 7f7dd31b7640 1 -- 172.21.15.78:0/4246001733 wait complete. 2024-09-15T22:34:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.316+0000 7f7dd31b7640 1 Processor -- start 2024-09-15T22:34:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.317+0000 7f7dd31b7640 1 -- start start 2024-09-15T22:34:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.317+0000 7f7dd31b7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dcc0630c0 0x7f7dcc13a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.317+0000 7f7dd31b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dcc1431c0 0x7f7dcc1ded80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.317+0000 7f7dd31b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dcc146200 0x7f7dcc13aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.317+0000 7f7dd31b7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc070610 con 0x7f7dcc0630c0 2024-09-15T22:34:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.317+0000 7f7dd31b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc070c90 con 0x7f7dcc1431c0 2024-09-15T22:34:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.317+0000 7f7dd31b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7dcc0b30c0 con 0x7f7dcc146200 2024-09-15T22:34:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.317+0000 7f7dd0f53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dcc0630c0 0x7f7dcc13a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.317+0000 7f7dd0f53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dcc0630c0 0x7f7dcc13a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54426/0 (socket says 172.21.15.78:54426) 2024-09-15T22:34:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.317+0000 7f7dd0f53640 1 -- 172.21.15.78:0/509637561 learned_addr learned my addr 172.21.15.78:0/509637561 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.318+0000 7f7dd1754640 1 --2- 172.21.15.78:0/509637561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dcc146200 0x7f7dcc13aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.318+0000 7f7dc3fff640 1 --2- 172.21.15.78:0/509637561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dcc1431c0 0x7f7dcc1ded80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.318+0000 7f7dd0f53640 1 -- 172.21.15.78:0/509637561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dcc146200 msgr2=0x7f7dcc13aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.318+0000 7f7dd0f53640 1 --2- 172.21.15.78:0/509637561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dcc146200 0x7f7dcc13aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.318+0000 7f7dd0f53640 1 -- 172.21.15.78:0/509637561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dcc1431c0 msgr2=0x7f7dcc1ded80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.318+0000 7f7dd0f53640 1 --2- 172.21.15.78:0/509637561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dcc1431c0 0x7f7dcc1ded80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.318+0000 7f7dd0f53640 1 -- 172.21.15.78:0/509637561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc13fb30 con 0x7f7dcc0630c0 2024-09-15T22:34:57.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.318+0000 7f7dd0f53640 1 --2- 172.21.15.78:0/509637561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dcc0630c0 0x7f7dcc13a1c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800c440 tx=0x7f7dc800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:57.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.318+0000 7f7dc17fa640 1 -- 172.21.15.78:0/509637561 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8017070 con 0x7f7dcc0630c0 2024-09-15T22:34:57.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.318+0000 7f7dc17fa640 1 -- 172.21.15.78:0/509637561 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc8005ce0 con 0x7f7dcc0630c0 2024-09-15T22:34:57.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.318+0000 7f7dd31b7640 1 -- 172.21.15.78:0/509637561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc0aff60 con 0x7f7dcc0630c0 2024-09-15T22:34:57.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.318+0000 7f7dc17fa640 1 -- 172.21.15.78:0/509637561 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8007270 con 0x7f7dcc0630c0 2024-09-15T22:34:57.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.318+0000 7f7dd31b7640 1 -- 172.21.15.78:0/509637561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc1de860 con 0x7f7dcc0630c0 2024-09-15T22:34:57.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.319+0000 7f7dd31b7640 1 -- 172.21.15.78:0/509637561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dcc0afd90 con 0x7f7dcc0630c0 2024-09-15T22:34:57.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.320+0000 7f7dc17fa640 1 -- 172.21.15.78:0/509637561 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7dc801a070 con 0x7f7dcc0630c0 2024-09-15T22:34:57.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.320+0000 7f7dc17fa640 1 --2- 172.21.15.78:0/509637561 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7db806c2b0 0x7f7db806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.320+0000 7f7dc17fa640 1 -- 172.21.15.78:0/509637561 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7f7dc808aa50 con 0x7f7dcc0630c0 2024-09-15T22:34:57.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.320+0000 7f7dc3fff640 1 --2- 172.21.15.78:0/509637561 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7db806c2b0 0x7f7db806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.321+0000 7f7dc3fff640 1 --2- 172.21.15.78:0/509637561 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7db806c2b0 0x7f7db806e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc13cc90 tx=0x7f7dbc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:57.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.325+0000 7f7dc17fa640 1 -- 172.21.15.78:0/509637561 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7dc80587a0 con 0x7f7dcc0630c0 2024-09-15T22:34:57.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.490+0000 7f7dd31b7640 1 -- 172.21.15.78:0/509637561 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f7dcc0691d0 con 0x7f7db806c2b0 2024-09-15T22:34:57.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.491+0000 7f7dc17fa640 1 -- 172.21.15.78:0/509637561 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7dbc001480 con 0x7f7db806c2b0 2024-09-15T22:34:57.492 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 1 to deep-scrub 2024-09-15T22:34:57.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.493+0000 7f7dd31b7640 1 -- 172.21.15.78:0/509637561 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7db806c2b0 msgr2=0x7f7db806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.493+0000 7f7dd31b7640 1 --2- 172.21.15.78:0/509637561 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7db806c2b0 0x7f7db806e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc13cc90 tx=0x7f7dbc009040 comp rx=0 tx=0).stop 2024-09-15T22:34:57.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.493+0000 7f7dd31b7640 1 -- 172.21.15.78:0/509637561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dcc0630c0 msgr2=0x7f7dcc13a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.493+0000 7f7dd31b7640 1 --2- 172.21.15.78:0/509637561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dcc0630c0 0x7f7dcc13a1c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800c440 tx=0x7f7dc800c900 comp rx=0 tx=0).stop 2024-09-15T22:34:57.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.493+0000 7f7dd31b7640 1 -- 172.21.15.78:0/509637561 shutdown_connections 2024-09-15T22:34:57.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.493+0000 7f7dd31b7640 1 --2- 172.21.15.78:0/509637561 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f7db806c2b0 0x7f7db806e770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.493+0000 7f7dd31b7640 1 --2- 172.21.15.78:0/509637561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dcc146200 0x7f7dcc13aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.493+0000 7f7dd31b7640 1 --2- 172.21.15.78:0/509637561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dcc1431c0 0x7f7dcc1ded80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.493+0000 7f7dd31b7640 1 --2- 172.21.15.78:0/509637561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dcc0630c0 0x7f7dcc13a1c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.493+0000 7f7dd31b7640 1 -- 172.21.15.78:0/509637561 >> 172.21.15.78:0/509637561 conn(0x7f7dcc0b6470 msgr2=0x7f7dcc0b7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:57.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.494+0000 7f7dd31b7640 1 -- 172.21.15.78:0/509637561 shutdown_connections 2024-09-15T22:34:57.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.494+0000 7f7dd31b7640 1 -- 172.21.15.78:0/509637561 wait complete. 2024-09-15T22:34:57.506 INFO:tasks.ceph:Scrubbing osd.2 2024-09-15T22:34:57.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:34:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.608+0000 7fed46bc4640 1 Processor -- start 2024-09-15T22:34:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.608+0000 7fed46bc4640 1 -- start start 2024-09-15T22:34:57.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.608+0000 7fed46bc4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed400b6810 0x7fed400b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.608+0000 7fed46bc4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fed4006e6e0 0x7fed4014b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.608+0000 7fed46bc4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed4006eb00 0x7fed4014bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.608+0000 7fed46bc4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fed4014b330 con 0x7fed400b6810 2024-09-15T22:34:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.608+0000 7fed46bc4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fed4006efd0 con 0x7fed4006e6e0 2024-09-15T22:34:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.608+0000 7fed46bc4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fed4006f2b0 con 0x7fed4006eb00 2024-09-15T22:34:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.609+0000 7fed44960640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed400b6810 0x7fed400b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.609+0000 7fed44960640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed400b6810 0x7fed400b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54434/0 (socket says 172.21.15.78:54434) 2024-09-15T22:34:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.609+0000 7fed44960640 1 -- 172.21.15.78:0/54955278 learned_addr learned my addr 172.21.15.78:0/54955278 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.609+0000 7fed37fff640 1 --2- 172.21.15.78:0/54955278 >> v2:172.21.15.175:3300/0 conn(0x7fed4006e6e0 0x7fed4014b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.609+0000 7fed45161640 1 --2- 172.21.15.78:0/54955278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed4006eb00 0x7fed4014bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.609+0000 7fed44960640 1 -- 172.21.15.78:0/54955278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed4006eb00 msgr2=0x7fed4014bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.609+0000 7fed44960640 1 --2- 172.21.15.78:0/54955278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed4006eb00 0x7fed4014bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.609+0000 7fed44960640 1 -- 172.21.15.78:0/54955278 >> v2:172.21.15.175:3300/0 conn(0x7fed4006e6e0 msgr2=0x7fed4014b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.609+0000 7fed44960640 1 --2- 172.21.15.78:0/54955278 >> v2:172.21.15.175:3300/0 conn(0x7fed4006e6e0 0x7fed4014b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.609+0000 7fed44960640 1 -- 172.21.15.78:0/54955278 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4006d230 con 0x7fed400b6810 2024-09-15T22:34:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.610+0000 7fed44960640 1 --2- 172.21.15.78:0/54955278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed400b6810 0x7fed400b6bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fed400b5c20 tx=0x7fed3c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d762c0b5cb4fa79 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.610+0000 7fed377fe640 1 -- 172.21.15.78:0/54955278 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c037070 con 0x7fed400b6810 2024-09-15T22:34:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.610+0000 7fed377fe640 1 -- 172.21.15.78:0/54955278 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3c032440 con 0x7fed400b6810 2024-09-15T22:34:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.610+0000 7fed377fe640 1 -- 172.21.15.78:0/54955278 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c032810 con 0x7fed400b6810 2024-09-15T22:34:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.610+0000 7fed46bc4640 1 -- 172.21.15.78:0/54955278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed400b6810 msgr2=0x7fed400b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.610+0000 7fed46bc4640 1 --2- 172.21.15.78:0/54955278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed400b6810 0x7fed400b6bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fed400b5c20 tx=0x7fed3c02a1e0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.610+0000 7fed46bc4640 1 -- 172.21.15.78:0/54955278 shutdown_connections 2024-09-15T22:34:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.610+0000 7fed46bc4640 1 --2- 172.21.15.78:0/54955278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed4006eb00 0x7fed4014bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.610+0000 7fed46bc4640 1 --2- 172.21.15.78:0/54955278 >> v2:172.21.15.175:3300/0 conn(0x7fed4006e6e0 0x7fed4014b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.610+0000 7fed46bc4640 1 --2- 172.21.15.78:0/54955278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed400b6810 0x7fed400b6bf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.610+0000 7fed46bc4640 1 -- 172.21.15.78:0/54955278 >> 172.21.15.78:0/54955278 conn(0x7fed4009d310 msgr2=0x7fed4009d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.610+0000 7fed46bc4640 1 -- 172.21.15.78:0/54955278 shutdown_connections 2024-09-15T22:34:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.610+0000 7fed46bc4640 1 -- 172.21.15.78:0/54955278 wait complete. 2024-09-15T22:34:57.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.611+0000 7fed46bc4640 1 Processor -- start 2024-09-15T22:34:57.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.612+0000 7fed46bc4640 1 -- start start 2024-09-15T22:34:57.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.612+0000 7fed46bc4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed4006e6e0 0x7fed401ddc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.612+0000 7fed46bc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed4006eb00 0x7fed400b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.612+0000 7fed46bc4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed400b6810 0x7fed400b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.612+0000 7fed46bc4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fed4006d970 con 0x7fed4006eb00 2024-09-15T22:34:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.612+0000 7fed46bc4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fed4006d7f0 con 0x7fed4006e6e0 2024-09-15T22:34:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.612+0000 7fed46bc4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fed4006daf0 con 0x7fed400b6810 2024-09-15T22:34:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.612+0000 7fed37fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed4006eb00 0x7fed400b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.612+0000 7fed37fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed4006eb00 0x7fed400b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54438/0 (socket says 172.21.15.78:54438) 2024-09-15T22:34:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.612+0000 7fed37fff640 1 -- 172.21.15.78:0/3683586605 learned_addr learned my addr 172.21.15.78:0/3683586605 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.612+0000 7fed45161640 1 --2- 172.21.15.78:0/3683586605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed400b6810 0x7fed400b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.612+0000 7fed44960640 1 --2- 172.21.15.78:0/3683586605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed4006e6e0 0x7fed401ddc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.613+0000 7fed37fff640 1 -- 172.21.15.78:0/3683586605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed400b6810 msgr2=0x7fed400b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.613+0000 7fed37fff640 1 --2- 172.21.15.78:0/3683586605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed400b6810 0x7fed400b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.613+0000 7fed37fff640 1 -- 172.21.15.78:0/3683586605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed4006e6e0 msgr2=0x7fed401ddc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.613+0000 7fed37fff640 1 --2- 172.21.15.78:0/3683586605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed4006e6e0 0x7fed401ddc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.613+0000 7fed37fff640 1 -- 172.21.15.78:0/3683586605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed400b29c0 con 0x7fed4006eb00 2024-09-15T22:34:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.613+0000 7fed37fff640 1 --2- 172.21.15.78:0/3683586605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed4006eb00 0x7fed400b0eb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fed3000e870 tx=0x7fed3000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.613+0000 7fed357fa640 1 -- 172.21.15.78:0/3683586605 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30017070 con 0x7fed4006eb00 2024-09-15T22:34:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.613+0000 7fed357fa640 1 -- 172.21.15.78:0/3683586605 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3000ee60 con 0x7fed4006eb00 2024-09-15T22:34:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.613+0000 7fed46bc4640 1 -- 172.21.15.78:0/3683586605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed400a0fc0 con 0x7fed4006eb00 2024-09-15T22:34:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.613+0000 7fed357fa640 1 -- 172.21.15.78:0/3683586605 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3000cb80 con 0x7fed4006eb00 2024-09-15T22:34:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.613+0000 7fed46bc4640 1 -- 172.21.15.78:0/3683586605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed400b06b0 con 0x7fed4006eb00 2024-09-15T22:34:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.614+0000 7fed46bc4640 1 -- 172.21.15.78:0/3683586605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed400b6bf0 con 0x7fed4006eb00 2024-09-15T22:34:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.615+0000 7fed357fa640 1 -- 172.21.15.78:0/3683586605 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fed3001a070 con 0x7fed4006eb00 2024-09-15T22:34:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.615+0000 7fed357fa640 1 --2- 172.21.15.78:0/3683586605 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fed2c06c2b0 0x7fed2c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.615+0000 7fed357fa640 1 -- 172.21.15.78:0/3683586605 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7fed3008b5d0 con 0x7fed4006eb00 2024-09-15T22:34:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.615+0000 7fed44960640 1 --2- 172.21.15.78:0/3683586605 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fed2c06c2b0 0x7fed2c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.615+0000 7fed357fa640 1 --2- 172.21.15.78:0/3683586605 >> [v2:172.21.15.78:6824/636523247,v1:172.21.15.78:6825/636523247] conn(0x7fed2c075e50 0x7fed2c0782f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.615+0000 7fed357fa640 1 -- 172.21.15.78:0/3683586605 --> [v2:172.21.15.78:6824/636523247,v1:172.21.15.78:6825/636523247] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed30022e50 con 0x7fed2c075e50 2024-09-15T22:34:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.615+0000 7fed357fa640 1 -- 172.21.15.78:0/3683586605 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fed30092050 con 0x7fed4006eb00 2024-09-15T22:34:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.615+0000 7fed45161640 1 --2- 172.21.15.78:0/3683586605 >> [v2:172.21.15.78:6824/636523247,v1:172.21.15.78:6825/636523247] conn(0x7fed2c075e50 0x7fed2c0782f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.615+0000 7fed44960640 1 --2- 172.21.15.78:0/3683586605 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fed2c06c2b0 0x7fed2c06e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed3c034000 tx=0x7fed3c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.616+0000 7fed45161640 1 --2- 172.21.15.78:0/3683586605 >> [v2:172.21.15.78:6824/636523247,v1:172.21.15.78:6825/636523247] conn(0x7fed2c075e50 0x7fed2c0782f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.616+0000 7fed357fa640 1 -- 172.21.15.78:0/3683586605 <== osd.2 v2:172.21.15.78:6824/636523247 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed30022e50 con 0x7fed2c075e50 2024-09-15T22:34:57.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.629+0000 7fed46bc4640 1 -- 172.21.15.78:0/3683586605 --> [v2:172.21.15.78:6824/636523247,v1:172.21.15.78:6825/636523247] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fed40149330 con 0x7fed2c075e50 2024-09-15T22:34:57.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.629+0000 7fed357fa640 1 -- 172.21.15.78:0/3683586605 <== osd.2 v2:172.21.15.78:6824/636523247 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fed40149330 con 0x7fed2c075e50 2024-09-15T22:34:57.630 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-15T22:34:57.630 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:34:57.630 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-15T22:34:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.629+0000 7fed46bc4640 1 -- 172.21.15.78:0/3683586605 >> [v2:172.21.15.78:6824/636523247,v1:172.21.15.78:6825/636523247] conn(0x7fed2c075e50 msgr2=0x7fed2c0782f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.629+0000 7fed46bc4640 1 --2- 172.21.15.78:0/3683586605 >> [v2:172.21.15.78:6824/636523247,v1:172.21.15.78:6825/636523247] conn(0x7fed2c075e50 0x7fed2c0782f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.629+0000 7fed46bc4640 1 -- 172.21.15.78:0/3683586605 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fed2c06c2b0 msgr2=0x7fed2c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.629+0000 7fed46bc4640 1 --2- 172.21.15.78:0/3683586605 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fed2c06c2b0 0x7fed2c06e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed3c034000 tx=0x7fed3c02e000 comp rx=0 tx=0).stop 2024-09-15T22:34:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.629+0000 7fed46bc4640 1 -- 172.21.15.78:0/3683586605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed4006eb00 msgr2=0x7fed400b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.629+0000 7fed46bc4640 1 --2- 172.21.15.78:0/3683586605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed4006eb00 0x7fed400b0eb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fed3000e870 tx=0x7fed3000ed30 comp rx=0 tx=0).stop 2024-09-15T22:34:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.629+0000 7fed45161640 1 -- 172.21.15.78:0/3683586605 reap_dead start 2024-09-15T22:34:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.629+0000 7fed46bc4640 1 -- 172.21.15.78:0/3683586605 shutdown_connections 2024-09-15T22:34:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.629+0000 7fed46bc4640 1 -- 172.21.15.78:0/3683586605 >> 172.21.15.78:0/3683586605 conn(0x7fed4009d310 msgr2=0x7fed400b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.629+0000 7fed46bc4640 1 -- 172.21.15.78:0/3683586605 shutdown_connections 2024-09-15T22:34:57.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.629+0000 7fed46bc4640 1 -- 172.21.15.78:0/3683586605 wait complete. 2024-09-15T22:34:57.640 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-15T22:34:57.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.737+0000 7fe2b3b8d640 1 Processor -- start 2024-09-15T22:34:57.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.737+0000 7fe2b3b8d640 1 -- start start 2024-09-15T22:34:57.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b3b8d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2ac075520 0x7fe2ac14bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b3b8d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe2ac1417e0 0x7fe2ac141c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b3b8d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2ac075900 con 0x7fe2ac147a50 2024-09-15T22:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b3b8d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fe2ac14b6b0 con 0x7fe2ac1417e0 2024-09-15T22:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b3b8d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ac06dc00 con 0x7fe2ac075520 2024-09-15T22:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b212a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe2ac1417e0 0x7fe2ac141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b1128640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe2ac147a50 0x7fe2ac09cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60626/0 (socket says 172.21.15.78:60626) 2024-09-15T22:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b212a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe2ac1417e0 0x7fe2ac141c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54442/0 (socket says 172.21.15.78:54442) 2024-09-15T22:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b1128640 1 -- 172.21.15.78:0/3064530735 learned_addr learned my addr 172.21.15.78:0/3064530735 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b1929640 1 --2- 172.21.15.78:0/3064530735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2ac075520 0x7fe2ac14bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b212a640 1 -- 172.21.15.78:0/3064530735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2ac075520 msgr2=0x7fe2ac14bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b212a640 1 --2- 172.21.15.78:0/3064530735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2ac075520 0x7fe2ac14bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b212a640 1 -- 172.21.15.78:0/3064530735 >> v1:172.21.15.78:6789/0 conn(0x7fe2ac147a50 legacy=0x7fe2ac09cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b212a640 1 -- 172.21.15.78:0/3064530735 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ac14b060 con 0x7fe2ac1417e0 2024-09-15T22:34:57.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b0927640 1 -- 172.21.15.78:0/3064530735 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1107225042 0 0) 0x7fe2ac075900 con 0x7fe2ac147a50 2024-09-15T22:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.738+0000 7fe2b1929640 1 --2- 172.21.15.78:0/3064530735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2ac075520 0x7fe2ac14bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.739+0000 7fe2b212a640 1 --2- 172.21.15.78:0/3064530735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2ac1417e0 0x7fe2ac141c90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40097a0 tx=0x7fe2a402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64f59d1cdea3b7e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.739+0000 7fe2b0927640 1 -- 172.21.15.78:0/3064530735 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4037070 con 0x7fe2ac1417e0 2024-09-15T22:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.739+0000 7fe2b0927640 1 -- 172.21.15.78:0/3064530735 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a402ae50 con 0x7fe2ac1417e0 2024-09-15T22:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.739+0000 7fe2b0927640 1 -- 172.21.15.78:0/3064530735 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4032660 con 0x7fe2ac1417e0 2024-09-15T22:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.739+0000 7fe2b3b8d640 1 -- 172.21.15.78:0/3064530735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2ac1417e0 msgr2=0x7fe2ac141c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.739+0000 7fe2b3b8d640 1 --2- 172.21.15.78:0/3064530735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2ac1417e0 0x7fe2ac141c90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40097a0 tx=0x7fe2a402a100 comp rx=0 tx=0).stop 2024-09-15T22:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.740+0000 7fe2b3b8d640 1 -- 172.21.15.78:0/3064530735 shutdown_connections 2024-09-15T22:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.740+0000 7fe2b3b8d640 1 --2- 172.21.15.78:0/3064530735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2ac1417e0 0x7fe2ac141c90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.740+0000 7fe2b3b8d640 1 --2- 172.21.15.78:0/3064530735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2ac075520 0x7fe2ac14bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.740+0000 7fe2b3b8d640 1 -- 172.21.15.78:0/3064530735 >> 172.21.15.78:0/3064530735 conn(0x7fe2ac0bdcb0 msgr2=0x7fe2ac074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.740+0000 7fe2b3b8d640 1 -- 172.21.15.78:0/3064530735 shutdown_connections 2024-09-15T22:34:57.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.740+0000 7fe2b3b8d640 1 -- 172.21.15.78:0/3064530735 wait complete. 2024-09-15T22:34:57.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.741+0000 7fe2b3b8d640 1 Processor -- start 2024-09-15T22:34:57.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.741+0000 7fe2b3b8d640 1 -- start start 2024-09-15T22:34:57.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.741+0000 7fe2b3b8d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2ac075520 0x7fe2ac148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.741+0000 7fe2b3b8d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2ac1417e0 0x7fe2ac1e0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.741+0000 7fe2b3b8d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2ac147a50 0x7fe2ac0ba540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.741+0000 7fe2b3b8d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac147e90 con 0x7fe2ac147a50 2024-09-15T22:34:57.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.741+0000 7fe2b3b8d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac1421d0 con 0x7fe2ac075520 2024-09-15T22:34:57.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.741+0000 7fe2b3b8d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ac0a2a60 con 0x7fe2ac1417e0 2024-09-15T22:34:57.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.741+0000 7fe2b212a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2ac147a50 0x7fe2ac0ba540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.741+0000 7fe2b212a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2ac147a50 0x7fe2ac0ba540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54452/0 (socket says 172.21.15.78:54452) 2024-09-15T22:34:57.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.741+0000 7fe2b212a640 1 -- 172.21.15.78:0/706507361 learned_addr learned my addr 172.21.15.78:0/706507361 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:57.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.741+0000 7fe2b1128640 1 --2- 172.21.15.78:0/706507361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2ac1417e0 0x7fe2ac1e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.741+0000 7fe2b1929640 1 --2- 172.21.15.78:0/706507361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2ac075520 0x7fe2ac148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.742+0000 7fe2b212a640 1 -- 172.21.15.78:0/706507361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2ac1417e0 msgr2=0x7fe2ac1e0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.742+0000 7fe2b212a640 1 --2- 172.21.15.78:0/706507361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2ac1417e0 0x7fe2ac1e0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.742+0000 7fe2b212a640 1 -- 172.21.15.78:0/706507361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2ac075520 msgr2=0x7fe2ac148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.742+0000 7fe2b212a640 1 --2- 172.21.15.78:0/706507361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2ac075520 0x7fe2ac148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.742+0000 7fe2b212a640 1 -- 172.21.15.78:0/706507361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ac14a730 con 0x7fe2ac147a50 2024-09-15T22:34:57.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.742+0000 7fe2b212a640 1 --2- 172.21.15.78:0/706507361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2ac147a50 0x7fe2ac0ba540 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40098c0 tx=0x7fe2a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:57.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.742+0000 7fe2a27fc640 1 -- 172.21.15.78:0/706507361 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4041020 con 0x7fe2ac147a50 2024-09-15T22:34:57.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.742+0000 7fe2a27fc640 1 -- 172.21.15.78:0/706507361 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a403c670 con 0x7fe2ac147a50 2024-09-15T22:34:57.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.742+0000 7fe2a27fc640 1 -- 172.21.15.78:0/706507361 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4037040 con 0x7fe2ac147a50 2024-09-15T22:34:57.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.742+0000 7fe2b3b8d640 1 -- 172.21.15.78:0/706507361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2ac1e0540 con 0x7fe2ac147a50 2024-09-15T22:34:57.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.742+0000 7fe2b3b8d640 1 -- 172.21.15.78:0/706507361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2ac0a1780 con 0x7fe2ac147a50 2024-09-15T22:34:57.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.743+0000 7fe2b3b8d640 1 -- 172.21.15.78:0/706507361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2ac075900 con 0x7fe2ac147a50 2024-09-15T22:34:57.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.743+0000 7fe2a27fc640 1 -- 172.21.15.78:0/706507361 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe2a4044020 con 0x7fe2ac147a50 2024-09-15T22:34:57.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.744+0000 7fe2a27fc640 1 --2- 172.21.15.78:0/706507361 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe29006c2e0 0x7fe29006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:57.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.744+0000 7fe2b1929640 1 --2- 172.21.15.78:0/706507361 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe29006c2e0 0x7fe29006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:57.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.744+0000 7fe2a27fc640 1 -- 172.21.15.78:0/706507361 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7fe2a40aba50 con 0x7fe2ac147a50 2024-09-15T22:34:57.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.744+0000 7fe2b1929640 1 --2- 172.21.15.78:0/706507361 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe29006c2e0 0x7fe29006e7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8003b80 tx=0x7fe2a8009910 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:57.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.748+0000 7fe2a27fc640 1 -- 172.21.15.78:0/706507361 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe2a404b070 con 0x7fe2ac147a50 2024-09-15T22:34:57.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.914+0000 7fe2b3b8d640 1 -- 172.21.15.78:0/706507361 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fe2ac06bc10 con 0x7fe29006c2e0 2024-09-15T22:34:57.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.914+0000 7fe2a27fc640 1 -- 172.21.15.78:0/706507361 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe2ac06bc10 con 0x7fe29006c2e0 2024-09-15T22:34:57.916 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 2 to deep-scrub 2024-09-15T22:34:57.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.917+0000 7fe2b3b8d640 1 -- 172.21.15.78:0/706507361 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe29006c2e0 msgr2=0x7fe29006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.917+0000 7fe2b3b8d640 1 --2- 172.21.15.78:0/706507361 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe29006c2e0 0x7fe29006e7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8003b80 tx=0x7fe2a8009910 comp rx=0 tx=0).stop 2024-09-15T22:34:57.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.917+0000 7fe2b3b8d640 1 -- 172.21.15.78:0/706507361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2ac147a50 msgr2=0x7fe2ac0ba540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:57.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.917+0000 7fe2b3b8d640 1 --2- 172.21.15.78:0/706507361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2ac147a50 0x7fe2ac0ba540 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40098c0 tx=0x7fe2a40046c0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.917+0000 7fe2b3b8d640 1 -- 172.21.15.78:0/706507361 shutdown_connections 2024-09-15T22:34:57.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.917+0000 7fe2b3b8d640 1 --2- 172.21.15.78:0/706507361 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fe29006c2e0 0x7fe29006e7a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.917+0000 7fe2b3b8d640 1 --2- 172.21.15.78:0/706507361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2ac147a50 0x7fe2ac0ba540 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.917+0000 7fe2b3b8d640 1 --2- 172.21.15.78:0/706507361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2ac1417e0 0x7fe2ac1e0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.917+0000 7fe2b3b8d640 1 --2- 172.21.15.78:0/706507361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2ac075520 0x7fe2ac148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:57.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.917+0000 7fe2b3b8d640 1 -- 172.21.15.78:0/706507361 >> 172.21.15.78:0/706507361 conn(0x7fe2ac0bdcb0 msgr2=0x7fe2ac06c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:57.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.917+0000 7fe2b3b8d640 1 -- 172.21.15.78:0/706507361 shutdown_connections 2024-09-15T22:34:57.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:57.917+0000 7fe2b3b8d640 1 -- 172.21.15.78:0/706507361 wait complete. 2024-09-15T22:34:57.928 INFO:tasks.ceph:Scrubbing osd.3 2024-09-15T22:34:57.928 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:34:58.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.034+0000 7f9147442640 1 Processor -- start 2024-09-15T22:34:58.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.034+0000 7f9147442640 1 -- start start 2024-09-15T22:34:58.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.035+0000 7f9147442640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91400630c0 0x7f9140146130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.035+0000 7f9147442640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9140146670 0x7f9140150280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.035+0000 7f9147442640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91400b28e0 con 0x7f91400b2400 2024-09-15T22:34:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.035+0000 7f9147442640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f91400b13b0 con 0x7f9140146670 2024-09-15T22:34:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.035+0000 7f9147442640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f91400634a0 con 0x7f91400630c0 2024-09-15T22:34:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.035+0000 7f91459df640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9140146670 0x7f9140150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.035+0000 7f91459df640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9140146670 0x7f9140150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54458/0 (socket says 172.21.15.78:54458) 2024-09-15T22:34:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.035+0000 7f91459df640 1 -- 172.21.15.78:0/3732076988 learned_addr learned my addr 172.21.15.78:0/3732076988 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.035+0000 7f91451de640 1 --2- 172.21.15.78:0/3732076988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91400630c0 0x7f9140146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.035+0000 7f91459df640 1 -- 172.21.15.78:0/3732076988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91400630c0 msgr2=0x7f9140146130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.035+0000 7f91459df640 1 --2- 172.21.15.78:0/3732076988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91400630c0 0x7f9140146130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.035+0000 7f91459df640 1 -- 172.21.15.78:0/3732076988 >> v1:172.21.15.175:6789/0 conn(0x7f91400b2400 legacy=0x7f91400b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.035+0000 7f91459df640 1 -- 172.21.15.78:0/3732076988 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91400b2bc0 con 0x7f9140146670 2024-09-15T22:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.036+0000 7f91459df640 1 --2- 172.21.15.78:0/3732076988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9140146670 0x7f9140150280 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9138009e50 tx=0x7f913802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69448c1d01850b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.036+0000 7f913ffff640 1 -- 172.21.15.78:0/3732076988 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9138036070 con 0x7f9140146670 2024-09-15T22:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.036+0000 7f913ffff640 1 -- 172.21.15.78:0/3732076988 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9138031600 con 0x7f9140146670 2024-09-15T22:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.036+0000 7f913ffff640 1 -- 172.21.15.78:0/3732076988 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91380319d0 con 0x7f9140146670 2024-09-15T22:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.037+0000 7f9147442640 1 -- 172.21.15.78:0/3732076988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9140146670 msgr2=0x7f9140150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.037+0000 7f9147442640 1 --2- 172.21.15.78:0/3732076988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9140146670 0x7f9140150280 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9138009e50 tx=0x7f913802a5f0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.037+0000 7f9147442640 1 -- 172.21.15.78:0/3732076988 shutdown_connections 2024-09-15T22:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.037+0000 7f9147442640 1 --2- 172.21.15.78:0/3732076988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9140146670 0x7f9140150280 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.037+0000 7f9147442640 1 --2- 172.21.15.78:0/3732076988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91400630c0 0x7f9140146130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.037+0000 7f9147442640 1 -- 172.21.15.78:0/3732076988 >> 172.21.15.78:0/3732076988 conn(0x7f91400b6790 msgr2=0x7f91400b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.037+0000 7f9147442640 1 -- 172.21.15.78:0/3732076988 shutdown_connections 2024-09-15T22:34:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.037+0000 7f9147442640 1 -- 172.21.15.78:0/3732076988 wait complete. 2024-09-15T22:34:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.038+0000 7f9147442640 1 Processor -- start 2024-09-15T22:34:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.038+0000 7f9147442640 1 -- start start 2024-09-15T22:34:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f9147442640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91400630c0 0x7f914009f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f9147442640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91400b2400 0x7f9140147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f9147442640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9140146670 0x7f91401de850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f9147442640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f91400b5e80 con 0x7f91400630c0 2024-09-15T22:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f9147442640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91400b18e0 con 0x7f9140146670 2024-09-15T22:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f9147442640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f91400b6000 con 0x7f91400b2400 2024-09-15T22:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f91451de640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91400630c0 0x7f914009f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f91451de640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91400630c0 0x7f914009f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54468/0 (socket says 172.21.15.78:54468) 2024-09-15T22:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f91451de640 1 -- 172.21.15.78:0/1519544812 learned_addr learned my addr 172.21.15.78:0/1519544812 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f91449dd640 1 --2- 172.21.15.78:0/1519544812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91400b2400 0x7f9140147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f91459df640 1 --2- 172.21.15.78:0/1519544812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9140146670 0x7f91401de850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f91451de640 1 -- 172.21.15.78:0/1519544812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91400b2400 msgr2=0x7f9140147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f91451de640 1 --2- 172.21.15.78:0/1519544812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91400b2400 0x7f9140147aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f91451de640 1 -- 172.21.15.78:0/1519544812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9140146670 msgr2=0x7f91401de850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f91451de640 1 --2- 172.21.15.78:0/1519544812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9140146670 0x7f91401de850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f91451de640 1 -- 172.21.15.78:0/1519544812 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91401db260 con 0x7f91400630c0 2024-09-15T22:34:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f91451de640 1 --2- 172.21.15.78:0/1519544812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91400630c0 0x7f914009f200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f913000e9e0 tx=0x7f913000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f913dffb640 1 -- 172.21.15.78:0/1519544812 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130017070 con 0x7f91400630c0 2024-09-15T22:34:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f913dffb640 1 -- 172.21.15.78:0/1519544812 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913000c9d0 con 0x7f91400630c0 2024-09-15T22:34:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f913dffb640 1 -- 172.21.15.78:0/1519544812 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913000cdc0 con 0x7f91400630c0 2024-09-15T22:34:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.039+0000 7f9147442640 1 -- 172.21.15.78:0/1519544812 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9140147fe0 con 0x7f91400630c0 2024-09-15T22:34:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.040+0000 7f9147442640 1 -- 172.21.15.78:0/1519544812 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91401db4e0 con 0x7f91400630c0 2024-09-15T22:34:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.040+0000 7f9147442640 1 -- 172.21.15.78:0/1519544812 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9140146130 con 0x7f91400630c0 2024-09-15T22:34:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.041+0000 7f913dffb640 1 -- 172.21.15.78:0/1519544812 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f913001a070 con 0x7f91400630c0 2024-09-15T22:34:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.041+0000 7f913dffb640 1 --2- 172.21.15.78:0/1519544812 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f912c06c2b0 0x7f912c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.041+0000 7f913dffb640 1 -- 172.21.15.78:0/1519544812 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7f913008bb90 con 0x7f91400630c0 2024-09-15T22:34:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.042+0000 7f91449dd640 1 --2- 172.21.15.78:0/1519544812 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f912c06c2b0 0x7f912c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.042+0000 7f913dffb640 1 --2- 172.21.15.78:0/1519544812 >> [v2:172.21.15.78:6800/1841812488,v1:172.21.15.78:6801/1841812488] conn(0x7f912c075e40 0x7f912c0782e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.042+0000 7f913dffb640 1 -- 172.21.15.78:0/1519544812 --> [v2:172.21.15.78:6800/1841812488,v1:172.21.15.78:6801/1841812488] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9130022e50 con 0x7f912c075e40 2024-09-15T22:34:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.042+0000 7f913dffb640 1 -- 172.21.15.78:0/1519544812 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f913008c020 con 0x7f91400630c0 2024-09-15T22:34:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.042+0000 7f91459df640 1 --2- 172.21.15.78:0/1519544812 >> [v2:172.21.15.78:6800/1841812488,v1:172.21.15.78:6801/1841812488] conn(0x7f912c075e40 0x7f912c0782e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.042+0000 7f91449dd640 1 --2- 172.21.15.78:0/1519544812 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f912c06c2b0 0x7f912c06e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f91400b7fd0 tx=0x7f9134009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.042+0000 7f91459df640 1 --2- 172.21.15.78:0/1519544812 >> [v2:172.21.15.78:6800/1841812488,v1:172.21.15.78:6801/1841812488] conn(0x7f912c075e40 0x7f912c0782e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.043+0000 7f913dffb640 1 -- 172.21.15.78:0/1519544812 <== osd.3 v2:172.21.15.78:6800/1841812488 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9130022e50 con 0x7f912c075e40 2024-09-15T22:34:58.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.055+0000 7f9147442640 1 -- 172.21.15.78:0/1519544812 --> [v2:172.21.15.78:6800/1841812488,v1:172.21.15.78:6801/1841812488] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f91400b1190 con 0x7f912c075e40 2024-09-15T22:34:58.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.055+0000 7f913dffb640 1 -- 172.21.15.78:0/1519544812 <== osd.3 v2:172.21.15.78:6800/1841812488 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f91400b1190 con 0x7f912c075e40 2024-09-15T22:34:58.056 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-15T22:34:58.056 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:34:58.056 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-15T22:34:58.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.055+0000 7f9147442640 1 -- 172.21.15.78:0/1519544812 >> [v2:172.21.15.78:6800/1841812488,v1:172.21.15.78:6801/1841812488] conn(0x7f912c075e40 msgr2=0x7f912c0782e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.055+0000 7f9147442640 1 --2- 172.21.15.78:0/1519544812 >> [v2:172.21.15.78:6800/1841812488,v1:172.21.15.78:6801/1841812488] conn(0x7f912c075e40 0x7f912c0782e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.056+0000 7f9147442640 1 -- 172.21.15.78:0/1519544812 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f912c06c2b0 msgr2=0x7f912c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.056+0000 7f9147442640 1 --2- 172.21.15.78:0/1519544812 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f912c06c2b0 0x7f912c06e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f91400b7fd0 tx=0x7f9134009040 comp rx=0 tx=0).stop 2024-09-15T22:34:58.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.056+0000 7f9147442640 1 -- 172.21.15.78:0/1519544812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91400630c0 msgr2=0x7f914009f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.056+0000 7f9147442640 1 --2- 172.21.15.78:0/1519544812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91400630c0 0x7f914009f200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f913000e9e0 tx=0x7f913000eea0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.056+0000 7f91459df640 1 -- 172.21.15.78:0/1519544812 reap_dead start 2024-09-15T22:34:58.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.056+0000 7f9147442640 1 -- 172.21.15.78:0/1519544812 shutdown_connections 2024-09-15T22:34:58.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.056+0000 7f9147442640 1 -- 172.21.15.78:0/1519544812 >> 172.21.15.78:0/1519544812 conn(0x7f91400b6790 msgr2=0x7f91400b8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.056+0000 7f9147442640 1 -- 172.21.15.78:0/1519544812 shutdown_connections 2024-09-15T22:34:58.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.056+0000 7f9147442640 1 -- 172.21.15.78:0/1519544812 wait complete. 2024-09-15T22:34:58.067 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-15T22:34:58.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.165+0000 7f1c2894b640 1 Processor -- start 2024-09-15T22:34:58.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.165+0000 7f1c2894b640 1 -- start start 2024-09-15T22:34:58.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.166+0000 7f1c2894b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240ba200 0x7f1c24147920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.166+0000 7f1c2894b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1c240b58d0 0x7f1c241416f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.166+0000 7f1c2894b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c240ba5e0 con 0x7f1c24141c30 2024-09-15T22:34:58.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.166+0000 7f1c2894b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1c240b72e0 con 0x7f1c240b58d0 2024-09-15T22:34:58.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.166+0000 7f1c2894b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1c240b7880 con 0x7f1c240ba200 2024-09-15T22:34:58.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.166+0000 7f1c21d9b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1c240b58d0 0x7f1c241416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.166+0000 7f1c2259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240ba200 0x7f1c24147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.166+0000 7f1c22d9d640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f1c24141c30 0x7f1c2414af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.78:50130/0 (socket says 172.21.15.78:50130) 2024-09-15T22:34:58.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.166+0000 7f1c21d9b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1c240b58d0 0x7f1c241416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.78:41070/0 (socket says 172.21.15.78:41070) 2024-09-15T22:34:58.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.166+0000 7f1c22d9d640 1 -- 172.21.15.78:0/2100677902 learned_addr learned my addr 172.21.15.78:0/2100677902 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:34:58.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.167+0000 7f1c2259c640 1 -- 172.21.15.78:0/2100677902 >> v2:172.21.15.175:3300/0 conn(0x7f1c240b58d0 msgr2=0x7f1c241416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:58.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.167+0000 7f1c2259c640 1 --2- 172.21.15.78:0/2100677902 >> v2:172.21.15.175:3300/0 conn(0x7f1c240b58d0 0x7f1c241416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.167+0000 7f1c2259c640 1 -- 172.21.15.78:0/2100677902 >> v1:172.21.15.175:6789/0 conn(0x7f1c24141c30 legacy=0x7f1c2414af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.167+0000 7f1c2259c640 1 -- 172.21.15.78:0/2100677902 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c240b6b70 con 0x7f1c240ba200 2024-09-15T22:34:58.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.167+0000 7f1c2159a640 1 -- 172.21.15.78:0/2100677902 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738982222 0 0) 0x7f1c240ba5e0 con 0x7f1c24141c30 2024-09-15T22:34:58.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.167+0000 7f1c21d9b640 1 --2- 172.21.15.78:0/2100677902 >> v2:172.21.15.175:3300/0 conn(0x7f1c240b58d0 0x7f1c241416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:34:58.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.167+0000 7f1c2259c640 1 --2- 172.21.15.78:0/2100677902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240ba200 0x7f1c24147920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009d90 tx=0x7f1c1402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10e0ba2ee03c318d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.167+0000 7f1c2159a640 1 -- 172.21.15.78:0/2100677902 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14031600 con 0x7f1c240ba200 2024-09-15T22:34:58.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.167+0000 7f1c2159a640 1 -- 172.21.15.78:0/2100677902 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c140317a0 con 0x7f1c240ba200 2024-09-15T22:34:58.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.167+0000 7f1c2159a640 1 -- 172.21.15.78:0/2100677902 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14031b70 con 0x7f1c240ba200 2024-09-15T22:34:58.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.168+0000 7f1c2894b640 1 -- 172.21.15.78:0/2100677902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240ba200 msgr2=0x7f1c24147920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.168+0000 7f1c2894b640 1 --2- 172.21.15.78:0/2100677902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240ba200 0x7f1c24147920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009d90 tx=0x7f1c1402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.168+0000 7f1c2894b640 1 -- 172.21.15.78:0/2100677902 shutdown_connections 2024-09-15T22:34:58.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.168+0000 7f1c2894b640 1 --2- 172.21.15.78:0/2100677902 >> v2:172.21.15.175:3300/0 conn(0x7f1c240b58d0 0x7f1c241416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.168+0000 7f1c2894b640 1 --2- 172.21.15.78:0/2100677902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240ba200 0x7f1c24147920 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.168+0000 7f1c2894b640 1 -- 172.21.15.78:0/2100677902 >> 172.21.15.78:0/2100677902 conn(0x7f1c24074160 msgr2=0x7f1c24074bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.168+0000 7f1c2894b640 1 -- 172.21.15.78:0/2100677902 shutdown_connections 2024-09-15T22:34:58.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.168+0000 7f1c2894b640 1 -- 172.21.15.78:0/2100677902 wait complete. 2024-09-15T22:34:58.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.169+0000 7f1c2894b640 1 Processor -- start 2024-09-15T22:34:58.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.169+0000 7f1c2894b640 1 -- start start 2024-09-15T22:34:58.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c2894b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c240b58d0 0x7f1c240bd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c2894b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240ba200 0x7f1c241d2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c2894b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c24141c30 0x7f1c241e0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c2894b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1c240b67f0 con 0x7f1c24141c30 2024-09-15T22:34:58.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c2894b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1c240b9370 con 0x7f1c240b58d0 2024-09-15T22:34:58.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c2894b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1c240b5d10 con 0x7f1c240ba200 2024-09-15T22:34:58.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c22d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c24141c30 0x7f1c241e0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c2259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c240b58d0 0x7f1c240bd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c22d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c24141c30 0x7f1c241e0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54476/0 (socket says 172.21.15.78:54476) 2024-09-15T22:34:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c22d9d640 1 -- 172.21.15.78:0/3033628214 learned_addr learned my addr 172.21.15.78:0/3033628214 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c21d9b640 1 --2- 172.21.15.78:0/3033628214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240ba200 0x7f1c241d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c2259c640 1 -- 172.21.15.78:0/3033628214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240ba200 msgr2=0x7f1c241d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c2259c640 1 --2- 172.21.15.78:0/3033628214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240ba200 0x7f1c241d2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c2259c640 1 -- 172.21.15.78:0/3033628214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c24141c30 msgr2=0x7f1c241e0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c2259c640 1 --2- 172.21.15.78:0/3033628214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c24141c30 0x7f1c241e0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c2259c640 1 -- 172.21.15.78:0/3033628214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c240ab240 con 0x7f1c240b58d0 2024-09-15T22:34:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.170+0000 7f1c22d9d640 1 --2- 172.21.15.78:0/3033628214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c24141c30 0x7f1c241e0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:34:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.171+0000 7f1c2259c640 1 --2- 172.21.15.78:0/3033628214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c240b58d0 0x7f1c240bd030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1c14031000 tx=0x7f1c14004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.171+0000 7f1c1affd640 1 -- 172.21.15.78:0/3033628214 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14040070 con 0x7f1c240b58d0 2024-09-15T22:34:58.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.171+0000 7f1c1affd640 1 -- 172.21.15.78:0/3033628214 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c14030be0 con 0x7f1c240b58d0 2024-09-15T22:34:58.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.171+0000 7f1c2894b640 1 -- 172.21.15.78:0/3033628214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c241d10a0 con 0x7f1c240b58d0 2024-09-15T22:34:58.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.171+0000 7f1c1affd640 1 -- 172.21.15.78:0/3033628214 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14009450 con 0x7f1c240b58d0 2024-09-15T22:34:58.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.171+0000 7f1c2894b640 1 -- 172.21.15.78:0/3033628214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c240bdc30 con 0x7f1c240b58d0 2024-09-15T22:34:58.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.172+0000 7f1c2894b640 1 -- 172.21.15.78:0/3033628214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c240b4a00 con 0x7f1c240b58d0 2024-09-15T22:34:58.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.172+0000 7f1c1affd640 1 -- 172.21.15.78:0/3033628214 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1c14039040 con 0x7f1c240b58d0 2024-09-15T22:34:58.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.173+0000 7f1c1affd640 1 --2- 172.21.15.78:0/3033628214 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f1c0406c2e0 0x7f1c0406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.173+0000 7f1c21d9b640 1 --2- 172.21.15.78:0/3033628214 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f1c0406c2e0 0x7f1c0406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.173+0000 7f1c1affd640 1 -- 172.21.15.78:0/3033628214 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7f1c140ac670 con 0x7f1c240b58d0 2024-09-15T22:34:58.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.173+0000 7f1c21d9b640 1 --2- 172.21.15.78:0/3033628214 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f1c0406c2e0 0x7f1c0406e7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009560 tx=0x7f1c0c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.177+0000 7f1c1affd640 1 -- 172.21.15.78:0/3033628214 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c1407a3c0 con 0x7f1c240b58d0 2024-09-15T22:34:58.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.343+0000 7f1c2894b640 1 -- 172.21.15.78:0/3033628214 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f1c24145340 con 0x7f1c0406c2e0 2024-09-15T22:34:58.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.344+0000 7f1c1affd640 1 -- 172.21.15.78:0/3033628214 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1c24145340 con 0x7f1c0406c2e0 2024-09-15T22:34:58.345 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 3 to deep-scrub 2024-09-15T22:34:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.346+0000 7f1c2894b640 1 -- 172.21.15.78:0/3033628214 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f1c0406c2e0 msgr2=0x7f1c0406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.346+0000 7f1c2894b640 1 --2- 172.21.15.78:0/3033628214 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f1c0406c2e0 0x7f1c0406e7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009560 tx=0x7f1c0c009190 comp rx=0 tx=0).stop 2024-09-15T22:34:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.346+0000 7f1c2894b640 1 -- 172.21.15.78:0/3033628214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c240b58d0 msgr2=0x7f1c240bd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.346+0000 7f1c2894b640 1 --2- 172.21.15.78:0/3033628214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c240b58d0 0x7f1c240bd030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1c14031000 tx=0x7f1c14004a40 comp rx=0 tx=0).stop 2024-09-15T22:34:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.346+0000 7f1c2894b640 1 -- 172.21.15.78:0/3033628214 shutdown_connections 2024-09-15T22:34:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.346+0000 7f1c2894b640 1 --2- 172.21.15.78:0/3033628214 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f1c0406c2e0 0x7f1c0406e7a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.346+0000 7f1c2894b640 1 --2- 172.21.15.78:0/3033628214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c24141c30 0x7f1c241e0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.346+0000 7f1c2894b640 1 --2- 172.21.15.78:0/3033628214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240ba200 0x7f1c241d2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.346+0000 7f1c2894b640 1 --2- 172.21.15.78:0/3033628214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c240b58d0 0x7f1c240bd030 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.346+0000 7f1c2894b640 1 -- 172.21.15.78:0/3033628214 >> 172.21.15.78:0/3033628214 conn(0x7f1c24074160 msgr2=0x7f1c24142c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.346+0000 7f1c2894b640 1 -- 172.21.15.78:0/3033628214 shutdown_connections 2024-09-15T22:34:58.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.346+0000 7f1c2894b640 1 -- 172.21.15.78:0/3033628214 wait complete. 2024-09-15T22:34:58.358 INFO:tasks.ceph:Scrubbing osd.4 2024-09-15T22:34:58.358 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:34:58.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.460+0000 7f3fc5896640 1 Processor -- start 2024-09-15T22:34:58.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.460+0000 7f3fc5896640 1 -- start start 2024-09-15T22:34:58.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.461+0000 7f3fc5896640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3fc006c6a0 0x7f3fc00bcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.461+0000 7f3fc5896640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3fc0144cd0 0x7f3fc0145160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.461+0000 7f3fc5896640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fc006da20 con 0x7f3fc014b3b0 2024-09-15T22:34:58.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.461+0000 7f3fc5896640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f3fc01456a0 con 0x7f3fc006c6a0 2024-09-15T22:34:58.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.461+0000 7f3fc5896640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f3fc006d7d0 con 0x7f3fc0144cd0 2024-09-15T22:34:58.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.461+0000 7f3fbe7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3fc006c6a0 0x7f3fc00bcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.461+0000 7f3fbe7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3fc006c6a0 0x7f3fc00bcfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54490/0 (socket says 172.21.15.78:54490) 2024-09-15T22:34:58.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.461+0000 7f3fbe7fc640 1 -- 172.21.15.78:0/2328179678 learned_addr learned my addr 172.21.15.78:0/2328179678 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:58.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.461+0000 7f3fbf7fe640 1 --2- 172.21.15.78:0/2328179678 >> v2:172.21.15.175:3300/0 conn(0x7f3fc0144cd0 0x7f3fc0145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.461+0000 7f3fbe7fc640 1 -- 172.21.15.78:0/2328179678 >> v2:172.21.15.175:3300/0 conn(0x7f3fc0144cd0 msgr2=0x7f3fc0145160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:58.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.461+0000 7f3fbe7fc640 1 --2- 172.21.15.78:0/2328179678 >> v2:172.21.15.175:3300/0 conn(0x7f3fc0144cd0 0x7f3fc0145160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.461+0000 7f3fbe7fc640 1 -- 172.21.15.78:0/2328179678 >> v1:172.21.15.175:6789/0 conn(0x7f3fc014b3b0 legacy=0x7f3fc014b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.461+0000 7f3fbe7fc640 1 -- 172.21.15.78:0/2328179678 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc00bb670 con 0x7f3fc006c6a0 2024-09-15T22:34:58.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.462+0000 7f3fbe7fc640 1 --2- 172.21.15.78:0/2328179678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc006c6a0 0x7f3fc00bcfc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00bc400 tx=0x7f3fb402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f391bacffb8dbf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.462+0000 7f3fbdffb640 1 -- 172.21.15.78:0/2328179678 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4037070 con 0x7f3fc006c6a0 2024-09-15T22:34:58.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.462+0000 7f3fbdffb640 1 -- 172.21.15.78:0/2328179678 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb4032440 con 0x7f3fc006c6a0 2024-09-15T22:34:58.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.462+0000 7f3fbdffb640 1 -- 172.21.15.78:0/2328179678 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4032810 con 0x7f3fc006c6a0 2024-09-15T22:34:58.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.463+0000 7f3fc5896640 1 -- 172.21.15.78:0/2328179678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc006c6a0 msgr2=0x7f3fc00bcfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.463+0000 7f3fc5896640 1 --2- 172.21.15.78:0/2328179678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc006c6a0 0x7f3fc00bcfc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00bc400 tx=0x7f3fb402a1e0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.463+0000 7f3fc5896640 1 -- 172.21.15.78:0/2328179678 shutdown_connections 2024-09-15T22:34:58.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.463+0000 7f3fc5896640 1 --2- 172.21.15.78:0/2328179678 >> v2:172.21.15.175:3300/0 conn(0x7f3fc0144cd0 0x7f3fc0145160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.463+0000 7f3fc5896640 1 --2- 172.21.15.78:0/2328179678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc006c6a0 0x7f3fc00bcfc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.463+0000 7f3fc5896640 1 -- 172.21.15.78:0/2328179678 >> 172.21.15.78:0/2328179678 conn(0x7f3fc00bd8d0 msgr2=0x7f3fc00bdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.463+0000 7f3fc5896640 1 -- 172.21.15.78:0/2328179678 shutdown_connections 2024-09-15T22:34:58.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.463+0000 7f3fc5896640 1 -- 172.21.15.78:0/2328179678 wait complete. 2024-09-15T22:34:58.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.464+0000 7f3fc5896640 1 Processor -- start 2024-09-15T22:34:58.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.464+0000 7f3fc5896640 1 -- start start 2024-09-15T22:34:58.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.464+0000 7f3fc5896640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fc006c6a0 0x7f3fc01dd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.464+0000 7f3fc5896640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc0144cd0 0x7f3fc00a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.464+0000 7f3fc5896640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fc014b3b0 0x7f3fc01e0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.464+0000 7f3fc5896640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc014c020 con 0x7f3fc0144cd0 2024-09-15T22:34:58.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.464+0000 7f3fc5896640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc014bea0 con 0x7f3fc006c6a0 2024-09-15T22:34:58.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.464+0000 7f3fc5896640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc0152470 con 0x7f3fc014b3b0 2024-09-15T22:34:58.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fbe7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc0144cd0 0x7f3fc00a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fbe7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc0144cd0 0x7f3fc00a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54494/0 (socket says 172.21.15.78:54494) 2024-09-15T22:34:58.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fbe7fc640 1 -- 172.21.15.78:0/883603983 learned_addr learned my addr 172.21.15.78:0/883603983 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:58.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fbeffd640 1 --2- 172.21.15.78:0/883603983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fc006c6a0 0x7f3fc01dd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fbf7fe640 1 --2- 172.21.15.78:0/883603983 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fc014b3b0 0x7f3fc01e0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fbe7fc640 1 -- 172.21.15.78:0/883603983 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fc014b3b0 msgr2=0x7f3fc01e0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fbe7fc640 1 --2- 172.21.15.78:0/883603983 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fc014b3b0 0x7f3fc01e0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fbe7fc640 1 -- 172.21.15.78:0/883603983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fc006c6a0 msgr2=0x7f3fc01dd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fbe7fc640 1 --2- 172.21.15.78:0/883603983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fc006c6a0 0x7f3fc01dd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fbe7fc640 1 -- 172.21.15.78:0/883603983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc00a1270 con 0x7f3fc0144cd0 2024-09-15T22:34:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fbe7fc640 1 --2- 172.21.15.78:0/883603983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc0144cd0 0x7f3fc00a16f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3fb402a220 tx=0x7f3fb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fa7fff640 1 -- 172.21.15.78:0/883603983 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4037040 con 0x7f3fc0144cd0 2024-09-15T22:34:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fa7fff640 1 -- 172.21.15.78:0/883603983 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb4042070 con 0x7f3fc0144cd0 2024-09-15T22:34:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fc5896640 1 -- 172.21.15.78:0/883603983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc00a2cc0 con 0x7f3fc0144cd0 2024-09-15T22:34:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fa7fff640 1 -- 172.21.15.78:0/883603983 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4030880 con 0x7f3fc0144cd0 2024-09-15T22:34:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.465+0000 7f3fc5896640 1 -- 172.21.15.78:0/883603983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc0147a90 con 0x7f3fc0144cd0 2024-09-15T22:34:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.466+0000 7f3fc5896640 1 -- 172.21.15.78:0/883603983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3fc00bcfc0 con 0x7f3fc0144cd0 2024-09-15T22:34:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.467+0000 7f3fa7fff640 1 -- 172.21.15.78:0/883603983 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3fb4030a20 con 0x7f3fc0144cd0 2024-09-15T22:34:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.467+0000 7f3fa7fff640 1 --2- 172.21.15.78:0/883603983 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3fac06c2b0 0x7f3fac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.467+0000 7f3fbeffd640 1 --2- 172.21.15.78:0/883603983 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3fac06c2b0 0x7f3fac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.467+0000 7f3fa7fff640 1 -- 172.21.15.78:0/883603983 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7f3fb40abf60 con 0x7f3fc0144cd0 2024-09-15T22:34:58.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.467+0000 7f3fa7fff640 1 --2- 172.21.15.78:0/883603983 >> [v2:172.21.15.175:6816/1803357070,v1:172.21.15.175:6817/1803357070] conn(0x7f3fac075e50 0x7f3fac0782f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.467+0000 7f3fa7fff640 1 -- 172.21.15.78:0/883603983 --> [v2:172.21.15.175:6816/1803357070,v1:172.21.15.175:6817/1803357070] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3fb400af30 con 0x7f3fac075e50 2024-09-15T22:34:58.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.467+0000 7f3fa7fff640 1 -- 172.21.15.78:0/883603983 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3fb40ae600 con 0x7f3fc0144cd0 2024-09-15T22:34:58.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.467+0000 7f3fbeffd640 1 --2- 172.21.15.78:0/883603983 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3fac06c2b0 0x7f3fac06e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0001e70 tx=0x7f3fb0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.467+0000 7f3fbf7fe640 1 --2- 172.21.15.78:0/883603983 >> [v2:172.21.15.175:6816/1803357070,v1:172.21.15.175:6817/1803357070] conn(0x7f3fac075e50 0x7f3fac0782f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.468+0000 7f3fbf7fe640 1 --2- 172.21.15.78:0/883603983 >> [v2:172.21.15.175:6816/1803357070,v1:172.21.15.175:6817/1803357070] conn(0x7f3fac075e50 0x7f3fac0782f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.468+0000 7f3fa7fff640 1 -- 172.21.15.78:0/883603983 <== osd.4 v2:172.21.15.175:6816/1803357070 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3fb400af30 con 0x7f3fac075e50 2024-09-15T22:34:58.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.481+0000 7f3fc5896640 1 -- 172.21.15.78:0/883603983 --> [v2:172.21.15.175:6816/1803357070,v1:172.21.15.175:6817/1803357070] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3fc00a1030 con 0x7f3fac075e50 2024-09-15T22:34:58.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.481+0000 7f3fa7fff640 1 -- 172.21.15.78:0/883603983 <== osd.4 v2:172.21.15.175:6816/1803357070 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3fc00a1030 con 0x7f3fac075e50 2024-09-15T22:34:58.482 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-15T22:34:58.482 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:34:58.482 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-15T22:34:58.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.481+0000 7f3fc5896640 1 -- 172.21.15.78:0/883603983 >> [v2:172.21.15.175:6816/1803357070,v1:172.21.15.175:6817/1803357070] conn(0x7f3fac075e50 msgr2=0x7f3fac0782f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.481+0000 7f3fc5896640 1 --2- 172.21.15.78:0/883603983 >> [v2:172.21.15.175:6816/1803357070,v1:172.21.15.175:6817/1803357070] conn(0x7f3fac075e50 0x7f3fac0782f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.481+0000 7f3fc5896640 1 -- 172.21.15.78:0/883603983 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3fac06c2b0 msgr2=0x7f3fac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.481+0000 7f3fc5896640 1 --2- 172.21.15.78:0/883603983 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f3fac06c2b0 0x7f3fac06e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0001e70 tx=0x7f3fb0009040 comp rx=0 tx=0).stop 2024-09-15T22:34:58.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.481+0000 7f3fc5896640 1 -- 172.21.15.78:0/883603983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc0144cd0 msgr2=0x7f3fc00a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.481+0000 7f3fc5896640 1 --2- 172.21.15.78:0/883603983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc0144cd0 0x7f3fc00a16f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3fb402a220 tx=0x7f3fb40046c0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.481+0000 7f3fbf7fe640 1 -- 172.21.15.78:0/883603983 reap_dead start 2024-09-15T22:34:58.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.482+0000 7f3fc5896640 1 -- 172.21.15.78:0/883603983 shutdown_connections 2024-09-15T22:34:58.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.482+0000 7f3fc5896640 1 -- 172.21.15.78:0/883603983 >> 172.21.15.78:0/883603983 conn(0x7f3fc00bd8d0 msgr2=0x7f3fc0143dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.482+0000 7f3fc5896640 1 -- 172.21.15.78:0/883603983 shutdown_connections 2024-09-15T22:34:58.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.482+0000 7f3fc5896640 1 -- 172.21.15.78:0/883603983 wait complete. 2024-09-15T22:34:58.493 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-15T22:34:58.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.591+0000 7fbe96511640 1 Processor -- start 2024-09-15T22:34:58.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.591+0000 7fbe96511640 1 -- start start 2024-09-15T22:34:58.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.591+0000 7fbe96511640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe9009c290 0x7fbe9013e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.591+0000 7fbe96511640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbe900b41c0 0x7fbe900b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.591+0000 7fbe96511640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe9009d5a0 con 0x7fbe9009d1c0 2024-09-15T22:34:58.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.591+0000 7fbe96511640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fbe9009e220 con 0x7fbe900b41c0 2024-09-15T22:34:58.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.591+0000 7fbe96511640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbe90148c90 con 0x7fbe9009c290 2024-09-15T22:34:58.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.592+0000 7fbe94aae640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbe900b41c0 0x7fbe900b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.592+0000 7fbe8ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbe9009d1c0 0x7fbe90148200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60638/0 (socket says 172.21.15.78:60638) 2024-09-15T22:34:58.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.592+0000 7fbe8ffff640 1 -- 172.21.15.78:0/4141634504 learned_addr learned my addr 172.21.15.78:0/4141634504 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:34:58.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.592+0000 7fbe8f7fe640 1 --2- 172.21.15.78:0/4141634504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe9009c290 0x7fbe9013e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.592+0000 7fbe94aae640 1 -- 172.21.15.78:0/4141634504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe9009c290 msgr2=0x7fbe9013e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:58.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.592+0000 7fbe94aae640 1 --2- 172.21.15.78:0/4141634504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe9009c290 0x7fbe9013e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.592+0000 7fbe94aae640 1 -- 172.21.15.78:0/4141634504 >> v1:172.21.15.78:6789/0 conn(0x7fbe9009d1c0 legacy=0x7fbe90148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.592+0000 7fbe94aae640 1 -- 172.21.15.78:0/4141634504 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe901489b0 con 0x7fbe900b41c0 2024-09-15T22:34:58.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.592+0000 7fbe8effd640 1 -- 172.21.15.78:0/4141634504 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 241203821 0 0) 0x7fbe9009d5a0 con 0x7fbe9009d1c0 2024-09-15T22:34:58.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.593+0000 7fbe94aae640 1 --2- 172.21.15.78:0/4141634504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe900b41c0 0x7fbe900b4670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009d90 tx=0x7fbe8802a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cfb90267bb8b5f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.593+0000 7fbe8effd640 1 -- 172.21.15.78:0/4141634504 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88007740 con 0x7fbe900b41c0 2024-09-15T22:34:58.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.593+0000 7fbe8effd640 1 -- 172.21.15.78:0/4141634504 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe880078e0 con 0x7fbe900b41c0 2024-09-15T22:34:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.593+0000 7fbe8effd640 1 -- 172.21.15.78:0/4141634504 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88007cb0 con 0x7fbe900b41c0 2024-09-15T22:34:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.593+0000 7fbe96511640 1 -- 172.21.15.78:0/4141634504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe900b41c0 msgr2=0x7fbe900b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.593+0000 7fbe96511640 1 --2- 172.21.15.78:0/4141634504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe900b41c0 0x7fbe900b4670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009d90 tx=0x7fbe8802a530 comp rx=0 tx=0).stop 2024-09-15T22:34:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.593+0000 7fbe96511640 1 -- 172.21.15.78:0/4141634504 shutdown_connections 2024-09-15T22:34:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.593+0000 7fbe96511640 1 --2- 172.21.15.78:0/4141634504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe900b41c0 0x7fbe900b4670 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.593+0000 7fbe96511640 1 --2- 172.21.15.78:0/4141634504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe9009c290 0x7fbe9013e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.593+0000 7fbe96511640 1 -- 172.21.15.78:0/4141634504 >> 172.21.15.78:0/4141634504 conn(0x7fbe9006c270 msgr2=0x7fbe9006c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.593+0000 7fbe96511640 1 -- 172.21.15.78:0/4141634504 shutdown_connections 2024-09-15T22:34:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.593+0000 7fbe96511640 1 -- 172.21.15.78:0/4141634504 wait complete. 2024-09-15T22:34:58.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.594+0000 7fbe96511640 1 Processor -- start 2024-09-15T22:34:58.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.594+0000 7fbe96511640 1 -- start start 2024-09-15T22:34:58.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe96511640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe9009c290 0x7fbe900b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe96511640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe9009d1c0 0x7fbe901de460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe96511640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe900b41c0 0x7fbe901de9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe96511640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9013eef0 con 0x7fbe900b41c0 2024-09-15T22:34:58.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe96511640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9013ed70 con 0x7fbe9009d1c0 2024-09-15T22:34:58.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe96511640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9014f0b0 con 0x7fbe9009c290 2024-09-15T22:34:58.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe94aae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe900b41c0 0x7fbe901de9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe94aae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe900b41c0 0x7fbe901de9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54508/0 (socket says 172.21.15.78:54508) 2024-09-15T22:34:58.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe94aae640 1 -- 172.21.15.78:0/3154004951 learned_addr learned my addr 172.21.15.78:0/3154004951 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:58.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe8ffff640 1 --2- 172.21.15.78:0/3154004951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe9009c290 0x7fbe900b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe8f7fe640 1 --2- 172.21.15.78:0/3154004951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe9009d1c0 0x7fbe901de460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe94aae640 1 -- 172.21.15.78:0/3154004951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe9009c290 msgr2=0x7fbe900b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe94aae640 1 --2- 172.21.15.78:0/3154004951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe9009c290 0x7fbe900b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe94aae640 1 -- 172.21.15.78:0/3154004951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe9009d1c0 msgr2=0x7fbe901de460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe94aae640 1 --2- 172.21.15.78:0/3154004951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe9009d1c0 0x7fbe901de460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.595+0000 7fbe94aae640 1 -- 172.21.15.78:0/3154004951 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe90141150 con 0x7fbe900b41c0 2024-09-15T22:34:58.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.596+0000 7fbe94aae640 1 --2- 172.21.15.78:0/3154004951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe900b41c0 0x7fbe901de9a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009d90 tx=0x7fbe88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.596+0000 7fbe8cff9640 1 -- 172.21.15.78:0/3154004951 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88040070 con 0x7fbe900b41c0 2024-09-15T22:34:58.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.596+0000 7fbe8cff9640 1 -- 172.21.15.78:0/3154004951 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe88031bc0 con 0x7fbe900b41c0 2024-09-15T22:34:58.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.596+0000 7fbe96511640 1 -- 172.21.15.78:0/3154004951 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe90141430 con 0x7fbe900b41c0 2024-09-15T22:34:58.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.596+0000 7fbe8cff9640 1 -- 172.21.15.78:0/3154004951 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88009450 con 0x7fbe900b41c0 2024-09-15T22:34:58.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.596+0000 7fbe96511640 1 -- 172.21.15.78:0/3154004951 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe90142640 con 0x7fbe900b41c0 2024-09-15T22:34:58.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.597+0000 7fbe96511640 1 -- 172.21.15.78:0/3154004951 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe9013e830 con 0x7fbe900b41c0 2024-09-15T22:34:58.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.597+0000 7fbe8cff9640 1 -- 172.21.15.78:0/3154004951 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbe88039040 con 0x7fbe900b41c0 2024-09-15T22:34:58.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.597+0000 7fbe8cff9640 1 --2- 172.21.15.78:0/3154004951 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbe7c06c2b0 0x7fbe7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.598+0000 7fbe8ffff640 1 --2- 172.21.15.78:0/3154004951 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbe7c06c2b0 0x7fbe7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.598+0000 7fbe8cff9640 1 -- 172.21.15.78:0/3154004951 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7fbe880acb80 con 0x7fbe900b41c0 2024-09-15T22:34:58.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.598+0000 7fbe8ffff640 1 --2- 172.21.15.78:0/3154004951 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbe7c06c2b0 0x7fbe7c06e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbe80000f60 tx=0x7fbe80009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.602+0000 7fbe8cff9640 1 -- 172.21.15.78:0/3154004951 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe8807a8d0 con 0x7fbe900b41c0 2024-09-15T22:34:58.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.777+0000 7fbe96511640 1 -- 172.21.15.78:0/3154004951 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fbe90140fa0 con 0x7fbe7c06c2b0 2024-09-15T22:34:58.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.778+0000 7fbe8cff9640 1 -- 172.21.15.78:0/3154004951 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbe90140fa0 con 0x7fbe7c06c2b0 2024-09-15T22:34:58.779 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 4 to deep-scrub 2024-09-15T22:34:58.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.780+0000 7fbe96511640 1 -- 172.21.15.78:0/3154004951 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbe7c06c2b0 msgr2=0x7fbe7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.780+0000 7fbe96511640 1 --2- 172.21.15.78:0/3154004951 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbe7c06c2b0 0x7fbe7c06e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbe80000f60 tx=0x7fbe80009040 comp rx=0 tx=0).stop 2024-09-15T22:34:58.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.780+0000 7fbe96511640 1 -- 172.21.15.78:0/3154004951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe900b41c0 msgr2=0x7fbe901de9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.780+0000 7fbe96511640 1 --2- 172.21.15.78:0/3154004951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe900b41c0 0x7fbe901de9a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009d90 tx=0x7fbe88004a40 comp rx=0 tx=0).stop 2024-09-15T22:34:58.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.780+0000 7fbe96511640 1 -- 172.21.15.78:0/3154004951 shutdown_connections 2024-09-15T22:34:58.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.780+0000 7fbe96511640 1 --2- 172.21.15.78:0/3154004951 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fbe7c06c2b0 0x7fbe7c06e770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.780+0000 7fbe96511640 1 --2- 172.21.15.78:0/3154004951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe900b41c0 0x7fbe901de9a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.780+0000 7fbe96511640 1 --2- 172.21.15.78:0/3154004951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe9009d1c0 0x7fbe901de460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.780+0000 7fbe96511640 1 --2- 172.21.15.78:0/3154004951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe9009c290 0x7fbe900b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.780+0000 7fbe96511640 1 -- 172.21.15.78:0/3154004951 >> 172.21.15.78:0/3154004951 conn(0x7fbe9006c270 msgr2=0x7fbe9013dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.780+0000 7fbe96511640 1 -- 172.21.15.78:0/3154004951 shutdown_connections 2024-09-15T22:34:58.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.780+0000 7fbe96511640 1 -- 172.21.15.78:0/3154004951 wait complete. 2024-09-15T22:34:58.791 INFO:tasks.ceph:Scrubbing osd.5 2024-09-15T22:34:58.792 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:34:58.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.893+0000 7fd42ee7b640 1 Processor -- start 2024-09-15T22:34:58.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.893+0000 7fd42ee7b640 1 -- start start 2024-09-15T22:34:58.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd42ee7b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4280b6810 0x7fd4280b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd42ee7b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd42814bed0 0x7fd42806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd42ee7b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd42806efd0 con 0x7fd42806e6e0 2024-09-15T22:34:58.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd42ee7b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd42814b330 con 0x7fd42814bed0 2024-09-15T22:34:58.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd42ee7b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd42806f2b0 con 0x7fd4280b6810 2024-09-15T22:34:58.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd427fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd42806e6e0 0x7fd42814b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60652/0 (socket says 172.21.15.78:60652) 2024-09-15T22:34:58.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd427fff640 1 -- 172.21.15.78:0/2717055809 learned_addr learned my addr 172.21.15.78:0/2717055809 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:34:58.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd42d418640 1 --2- 172.21.15.78:0/2717055809 >> v2:172.21.15.175:3300/0 conn(0x7fd42814bed0 0x7fd42806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd42cc17640 1 --2- 172.21.15.78:0/2717055809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4280b6810 0x7fd4280b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd4277fe640 1 -- 172.21.15.78:0/2717055809 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2056565439 0 0) 0x7fd42806efd0 con 0x7fd42806e6e0 2024-09-15T22:34:58.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd4277fe640 1 -- 172.21.15.78:0/2717055809 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd410003520 con 0x7fd42806e6e0 2024-09-15T22:34:58.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd42cc17640 1 -- 172.21.15.78:0/2717055809 >> v2:172.21.15.175:3300/0 conn(0x7fd42814bed0 msgr2=0x7fd42806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:58.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd42cc17640 1 --2- 172.21.15.78:0/2717055809 >> v2:172.21.15.175:3300/0 conn(0x7fd42814bed0 0x7fd42806d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd42cc17640 1 -- 172.21.15.78:0/2717055809 >> v1:172.21.15.78:6789/0 conn(0x7fd42806e6e0 legacy=0x7fd42814b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd42cc17640 1 -- 172.21.15.78:0/2717055809 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42806eb00 con 0x7fd4280b6810 2024-09-15T22:34:58.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.894+0000 7fd42d418640 1 --2- 172.21.15.78:0/2717055809 >> v2:172.21.15.175:3300/0 conn(0x7fd42814bed0 0x7fd42806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:34:58.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.895+0000 7fd42cc17640 1 --2- 172.21.15.78:0/2717055809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4280b6810 0x7fd4280b6bf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd4180097a0 tx=0x7fd41802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3f6269f9aefedb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.895+0000 7fd4277fe640 1 -- 172.21.15.78:0/2717055809 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418037070 con 0x7fd4280b6810 2024-09-15T22:34:58.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.895+0000 7fd4277fe640 1 -- 172.21.15.78:0/2717055809 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd418032440 con 0x7fd4280b6810 2024-09-15T22:34:58.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.895+0000 7fd4277fe640 1 -- 172.21.15.78:0/2717055809 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4180327f0 con 0x7fd4280b6810 2024-09-15T22:34:58.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.896+0000 7fd42ee7b640 1 -- 172.21.15.78:0/2717055809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4280b6810 msgr2=0x7fd4280b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.896+0000 7fd42ee7b640 1 --2- 172.21.15.78:0/2717055809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4280b6810 0x7fd4280b6bf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd4180097a0 tx=0x7fd41802a180 comp rx=0 tx=0).stop 2024-09-15T22:34:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.896+0000 7fd42ee7b640 1 -- 172.21.15.78:0/2717055809 shutdown_connections 2024-09-15T22:34:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.896+0000 7fd42ee7b640 1 --2- 172.21.15.78:0/2717055809 >> v2:172.21.15.175:3300/0 conn(0x7fd42814bed0 0x7fd42806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.896+0000 7fd42ee7b640 1 --2- 172.21.15.78:0/2717055809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4280b6810 0x7fd4280b6bf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.896+0000 7fd42ee7b640 1 -- 172.21.15.78:0/2717055809 >> 172.21.15.78:0/2717055809 conn(0x7fd42809d310 msgr2=0x7fd42809d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.896+0000 7fd42ee7b640 1 -- 172.21.15.78:0/2717055809 shutdown_connections 2024-09-15T22:34:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.896+0000 7fd42ee7b640 1 -- 172.21.15.78:0/2717055809 wait complete. 2024-09-15T22:34:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.897+0000 7fd42ee7b640 1 Processor -- start 2024-09-15T22:34:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.897+0000 7fd42ee7b640 1 -- start start 2024-09-15T22:34:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42ee7b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd42806e6e0 0x7fd42809e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42ee7b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4280b6810 0x7fd4281d1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42ee7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd42814bed0 0x7fd428143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42ee7b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd42806db40 con 0x7fd42814bed0 2024-09-15T22:34:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42ee7b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd42806d9c0 con 0x7fd42806e6e0 2024-09-15T22:34:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42ee7b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd42806dcc0 con 0x7fd4280b6810 2024-09-15T22:34:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42d418640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd42814bed0 0x7fd428143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42d418640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd42814bed0 0x7fd428143d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54518/0 (socket says 172.21.15.78:54518) 2024-09-15T22:34:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42d418640 1 -- 172.21.15.78:0/1962945655 learned_addr learned my addr 172.21.15.78:0/1962945655 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42cc17640 1 --2- 172.21.15.78:0/1962945655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd42806e6e0 0x7fd42809e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd427fff640 1 --2- 172.21.15.78:0/1962945655 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4280b6810 0x7fd4281d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42d418640 1 -- 172.21.15.78:0/1962945655 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4280b6810 msgr2=0x7fd4281d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42d418640 1 --2- 172.21.15.78:0/1962945655 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4280b6810 0x7fd4281d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42d418640 1 -- 172.21.15.78:0/1962945655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd42806e6e0 msgr2=0x7fd42809e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42d418640 1 --2- 172.21.15.78:0/1962945655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd42806e6e0 0x7fd42809e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42d418640 1 -- 172.21.15.78:0/1962945655 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4281d26f0 con 0x7fd42814bed0 2024-09-15T22:34:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42cc17640 1 --2- 172.21.15.78:0/1962945655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd42806e6e0 0x7fd42809e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:34:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42d418640 1 --2- 172.21.15.78:0/1962945655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd42814bed0 0x7fd428143d20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd42000efc0 tx=0x7fd420009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd4257fa640 1 -- 172.21.15.78:0/1962945655 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420018030 con 0x7fd42814bed0 2024-09-15T22:34:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd4257fa640 1 -- 172.21.15.78:0/1962945655 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42000cde0 con 0x7fd42814bed0 2024-09-15T22:34:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42ee7b640 1 -- 172.21.15.78:0/1962945655 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4281d2c40 con 0x7fd42814bed0 2024-09-15T22:34:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd4257fa640 1 -- 172.21.15.78:0/1962945655 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420003bb0 con 0x7fd42814bed0 2024-09-15T22:34:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.898+0000 7fd42ee7b640 1 -- 172.21.15.78:0/1962945655 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4280a08b0 con 0x7fd42814bed0 2024-09-15T22:34:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.899+0000 7fd42ee7b640 1 -- 172.21.15.78:0/1962945655 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd42806efd0 con 0x7fd42814bed0 2024-09-15T22:34:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.900+0000 7fd4257fa640 1 -- 172.21.15.78:0/1962945655 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd420005d10 con 0x7fd42814bed0 2024-09-15T22:34:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.900+0000 7fd4257fa640 1 --2- 172.21.15.78:0/1962945655 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd41406c2e0 0x7fd41406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.900+0000 7fd4257fa640 1 -- 172.21.15.78:0/1962945655 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7fd42008c110 con 0x7fd42814bed0 2024-09-15T22:34:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.900+0000 7fd42cc17640 1 --2- 172.21.15.78:0/1962945655 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd41406c2e0 0x7fd41406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.900+0000 7fd4257fa640 1 --2- 172.21.15.78:0/1962945655 >> [v2:172.21.15.175:6824/2221415707,v1:172.21.15.175:6825/2221415707] conn(0x7fd414075e80 0x7fd414078320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.900+0000 7fd4257fa640 1 -- 172.21.15.78:0/1962945655 --> [v2:172.21.15.175:6824/2221415707,v1:172.21.15.175:6825/2221415707] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd42000be50 con 0x7fd414075e80 2024-09-15T22:34:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.900+0000 7fd4257fa640 1 -- 172.21.15.78:0/1962945655 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd420093050 con 0x7fd42814bed0 2024-09-15T22:34:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.901+0000 7fd42cc17640 1 --2- 172.21.15.78:0/1962945655 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd41406c2e0 0x7fd41406e7a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd418034000 tx=0x7fd41802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.901+0000 7fd427fff640 1 --2- 172.21.15.78:0/1962945655 >> [v2:172.21.15.175:6824/2221415707,v1:172.21.15.175:6825/2221415707] conn(0x7fd414075e80 0x7fd414078320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.901+0000 7fd427fff640 1 --2- 172.21.15.78:0/1962945655 >> [v2:172.21.15.175:6824/2221415707,v1:172.21.15.175:6825/2221415707] conn(0x7fd414075e80 0x7fd414078320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.902+0000 7fd4257fa640 1 -- 172.21.15.78:0/1962945655 <== osd.5 v2:172.21.15.175:6824/2221415707 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd42000be50 con 0x7fd414075e80 2024-09-15T22:34:58.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.914+0000 7fd42ee7b640 1 -- 172.21.15.78:0/1962945655 --> [v2:172.21.15.175:6824/2221415707,v1:172.21.15.175:6825/2221415707] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd428145510 con 0x7fd414075e80 2024-09-15T22:34:58.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.914+0000 7fd4257fa640 1 -- 172.21.15.78:0/1962945655 <== osd.5 v2:172.21.15.175:6824/2221415707 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd428145510 con 0x7fd414075e80 2024-09-15T22:34:58.915 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-15T22:34:58.915 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:34:58.916 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-15T22:34:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.915+0000 7fd42ee7b640 1 -- 172.21.15.78:0/1962945655 >> [v2:172.21.15.175:6824/2221415707,v1:172.21.15.175:6825/2221415707] conn(0x7fd414075e80 msgr2=0x7fd414078320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.915+0000 7fd42ee7b640 1 --2- 172.21.15.78:0/1962945655 >> [v2:172.21.15.175:6824/2221415707,v1:172.21.15.175:6825/2221415707] conn(0x7fd414075e80 0x7fd414078320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.915+0000 7fd42ee7b640 1 -- 172.21.15.78:0/1962945655 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd41406c2e0 msgr2=0x7fd41406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.915+0000 7fd42ee7b640 1 --2- 172.21.15.78:0/1962945655 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fd41406c2e0 0x7fd41406e7a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd418034000 tx=0x7fd41802e000 comp rx=0 tx=0).stop 2024-09-15T22:34:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.915+0000 7fd42ee7b640 1 -- 172.21.15.78:0/1962945655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd42814bed0 msgr2=0x7fd428143d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.915+0000 7fd42ee7b640 1 --2- 172.21.15.78:0/1962945655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd42814bed0 0x7fd428143d20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd42000efc0 tx=0x7fd420009f90 comp rx=0 tx=0).stop 2024-09-15T22:34:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.915+0000 7fd42d418640 1 -- 172.21.15.78:0/1962945655 reap_dead start 2024-09-15T22:34:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.915+0000 7fd42ee7b640 1 -- 172.21.15.78:0/1962945655 shutdown_connections 2024-09-15T22:34:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.915+0000 7fd42ee7b640 1 -- 172.21.15.78:0/1962945655 >> 172.21.15.78:0/1962945655 conn(0x7fd42809d310 msgr2=0x7fd4280b9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.915+0000 7fd42ee7b640 1 -- 172.21.15.78:0/1962945655 shutdown_connections 2024-09-15T22:34:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:58.915+0000 7fd42ee7b640 1 -- 172.21.15.78:0/1962945655 wait complete. 2024-09-15T22:34:58.926 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-15T22:34:59.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.040+0000 7f5c3580e640 1 Processor -- start 2024-09-15T22:34:59.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.040+0000 7f5c3580e640 1 -- start start 2024-09-15T22:34:59.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.041+0000 7f5c3580e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c301417f0 0x7f5c30141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.041+0000 7f5c3580e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c300b6c90 con 0x7f5c301502e0 2024-09-15T22:34:59.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.041+0000 7f5c3580e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c300b7a80 con 0x7f5c300ba270 2024-09-15T22:34:59.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.041+0000 7f5c3580e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5c300b6f00 con 0x7f5c301417f0 2024-09-15T22:34:59.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.041+0000 7f5c2f7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5c301502e0 0x7f5c301526d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60664/0 (socket says 172.21.15.78:60664) 2024-09-15T22:34:59.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.041+0000 7f5c2f7fe640 1 -- 172.21.15.78:0/478425932 learned_addr learned my addr 172.21.15.78:0/478425932 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:34:59.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.041+0000 7f5c2e7fc640 1 --2- 172.21.15.78:0/478425932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c301417f0 0x7f5c30141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.041+0000 7f5c2dffb640 1 -- 172.21.15.78:0/478425932 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2379141995 0 0) 0x7f5c300b6c90 con 0x7f5c301502e0 2024-09-15T22:34:59.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.041+0000 7f5c2dffb640 1 -- 172.21.15.78:0/478425932 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c18003520 con 0x7f5c301502e0 2024-09-15T22:34:59.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.041+0000 7f5c2dffb640 1 -- 172.21.15.78:0/478425932 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 498146644 0 0) 0x7f5c20001110 con 0x7f5c300ba270 2024-09-15T22:34:59.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.041+0000 7f5c2dffb640 1 -- 172.21.15.78:0/478425932 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c300b6c90 con 0x7f5c300ba270 2024-09-15T22:34:59.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.041+0000 7f5c2e7fc640 1 -- 172.21.15.78:0/478425932 >> v1:172.21.15.175:6789/0 conn(0x7f5c300ba270 legacy=0x7f5c300b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.041+0000 7f5c2e7fc640 1 -- 172.21.15.78:0/478425932 >> v1:172.21.15.78:6789/0 conn(0x7f5c301502e0 legacy=0x7f5c301526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.041+0000 7f5c2e7fc640 1 -- 172.21.15.78:0/478425932 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c300ba650 con 0x7f5c301417f0 2024-09-15T22:34:59.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.042+0000 7f5c2e7fc640 1 --2- 172.21.15.78:0/478425932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c301417f0 0x7f5c30141c30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5c240097d0 tx=0x7f5c2402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b15f35c57e0c5eb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.042+0000 7f5c2dffb640 1 -- 172.21.15.78:0/478425932 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c24037070 con 0x7f5c301417f0 2024-09-15T22:34:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.042+0000 7f5c2dffb640 1 -- 172.21.15.78:0/478425932 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c2402ae50 con 0x7f5c301417f0 2024-09-15T22:34:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.042+0000 7f5c2dffb640 1 -- 172.21.15.78:0/478425932 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c24032640 con 0x7f5c301417f0 2024-09-15T22:34:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.042+0000 7f5c3580e640 1 -- 172.21.15.78:0/478425932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c301417f0 msgr2=0x7f5c30141c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.042+0000 7f5c3580e640 1 --2- 172.21.15.78:0/478425932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c301417f0 0x7f5c30141c30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5c240097d0 tx=0x7f5c2402a100 comp rx=0 tx=0).stop 2024-09-15T22:34:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.043+0000 7f5c3580e640 1 -- 172.21.15.78:0/478425932 shutdown_connections 2024-09-15T22:34:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.043+0000 7f5c3580e640 1 --2- 172.21.15.78:0/478425932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c301417f0 0x7f5c30141c30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.043+0000 7f5c3580e640 1 -- 172.21.15.78:0/478425932 >> 172.21.15.78:0/478425932 conn(0x7f5c30074ba0 msgr2=0x7f5c30074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.043+0000 7f5c3580e640 1 -- 172.21.15.78:0/478425932 shutdown_connections 2024-09-15T22:34:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.043+0000 7f5c3580e640 1 -- 172.21.15.78:0/478425932 wait complete. 2024-09-15T22:34:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.044+0000 7f5c3580e640 1 Processor -- start 2024-09-15T22:34:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.044+0000 7f5c3580e640 1 -- start start 2024-09-15T22:34:59.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.044+0000 7f5c3580e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c300ba270 0x7f5c3014db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.044+0000 7f5c3580e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c301417f0 0x7f5c3014d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.044+0000 7f5c3580e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c301502e0 0x7f5c301e0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.044+0000 7f5c3580e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5c300b77a0 con 0x7f5c301502e0 2024-09-15T22:34:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.044+0000 7f5c3580e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5c300b74c0 con 0x7f5c300ba270 2024-09-15T22:34:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.044+0000 7f5c3580e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5c300b4a70 con 0x7f5c301417f0 2024-09-15T22:34:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.044+0000 7f5c2f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c301502e0 0x7f5c301e0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.044+0000 7f5c2f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c301502e0 0x7f5c301e0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54534/0 (socket says 172.21.15.78:54534) 2024-09-15T22:34:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.045+0000 7f5c2f7fe640 1 -- 172.21.15.78:0/2065207375 learned_addr learned my addr 172.21.15.78:0/2065207375 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.045+0000 7f5c2effd640 1 --2- 172.21.15.78:0/2065207375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c300ba270 0x7f5c3014db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.045+0000 7f5c2e7fc640 1 --2- 172.21.15.78:0/2065207375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c301417f0 0x7f5c3014d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.045+0000 7f5c2f7fe640 1 -- 172.21.15.78:0/2065207375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c301417f0 msgr2=0x7f5c3014d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.045+0000 7f5c2f7fe640 1 --2- 172.21.15.78:0/2065207375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c301417f0 0x7f5c3014d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.045+0000 7f5c2f7fe640 1 -- 172.21.15.78:0/2065207375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c300ba270 msgr2=0x7f5c3014db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.045+0000 7f5c2f7fe640 1 --2- 172.21.15.78:0/2065207375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c300ba270 0x7f5c3014db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.045+0000 7f5c2f7fe640 1 -- 172.21.15.78:0/2065207375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3014fb10 con 0x7f5c301502e0 2024-09-15T22:34:59.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.045+0000 7f5c2f7fe640 1 --2- 172.21.15.78:0/2065207375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c301502e0 0x7f5c301e0e90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5c2800caf0 tx=0x7f5c2800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.045+0000 7f5c17fff640 1 -- 172.21.15.78:0/2065207375 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c28017070 con 0x7f5c301502e0 2024-09-15T22:34:59.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.045+0000 7f5c17fff640 1 -- 172.21.15.78:0/2065207375 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c2800ac40 con 0x7f5c301502e0 2024-09-15T22:34:59.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.045+0000 7f5c17fff640 1 -- 172.21.15.78:0/2065207375 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c28012400 con 0x7f5c301502e0 2024-09-15T22:34:59.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.045+0000 7f5c3580e640 1 -- 172.21.15.78:0/2065207375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c301dd920 con 0x7f5c301502e0 2024-09-15T22:34:59.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.045+0000 7f5c3580e640 1 -- 172.21.15.78:0/2065207375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c301dde80 con 0x7f5c301502e0 2024-09-15T22:34:59.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.046+0000 7f5c3580e640 1 -- 172.21.15.78:0/2065207375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c301de360 con 0x7f5c301502e0 2024-09-15T22:34:59.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.047+0000 7f5c17fff640 1 -- 172.21.15.78:0/2065207375 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5c2801a070 con 0x7f5c301502e0 2024-09-15T22:34:59.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.047+0000 7f5c17fff640 1 --2- 172.21.15.78:0/2065207375 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5c1c06c2b0 0x7f5c1c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.047+0000 7f5c2effd640 1 --2- 172.21.15.78:0/2065207375 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5c1c06c2b0 0x7f5c1c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.047+0000 7f5c17fff640 1 -- 172.21.15.78:0/2065207375 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7f5c2808b470 con 0x7f5c301502e0 2024-09-15T22:34:59.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.048+0000 7f5c2effd640 1 --2- 172.21.15.78:0/2065207375 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5c1c06c2b0 0x7f5c1c06e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5c20007fd0 tx=0x7f5c20009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.052+0000 7f5c17fff640 1 -- 172.21.15.78:0/2065207375 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c301de360 con 0x7f5c301502e0 2024-09-15T22:34:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.218+0000 7f5c3580e640 1 -- 172.21.15.78:0/2065207375 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f5c30145390 con 0x7f5c1c06c2b0 2024-09-15T22:34:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.218+0000 7f5c17fff640 1 -- 172.21.15.78:0/2065207375 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5c30145390 con 0x7f5c1c06c2b0 2024-09-15T22:34:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 5 to deep-scrub 2024-09-15T22:34:59.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.220+0000 7f5c3580e640 1 -- 172.21.15.78:0/2065207375 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5c1c06c2b0 msgr2=0x7f5c1c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.220+0000 7f5c3580e640 1 --2- 172.21.15.78:0/2065207375 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5c1c06c2b0 0x7f5c1c06e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5c20007fd0 tx=0x7f5c20009040 comp rx=0 tx=0).stop 2024-09-15T22:34:59.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.220+0000 7f5c3580e640 1 -- 172.21.15.78:0/2065207375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c301502e0 msgr2=0x7f5c301e0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.220+0000 7f5c3580e640 1 --2- 172.21.15.78:0/2065207375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c301502e0 0x7f5c301e0e90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5c2800caf0 tx=0x7f5c2800a060 comp rx=0 tx=0).stop 2024-09-15T22:34:59.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.220+0000 7f5c3580e640 1 -- 172.21.15.78:0/2065207375 shutdown_connections 2024-09-15T22:34:59.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.220+0000 7f5c3580e640 1 --2- 172.21.15.78:0/2065207375 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f5c1c06c2b0 0x7f5c1c06e770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.220+0000 7f5c3580e640 1 --2- 172.21.15.78:0/2065207375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c301502e0 0x7f5c301e0e90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.220+0000 7f5c3580e640 1 --2- 172.21.15.78:0/2065207375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c301417f0 0x7f5c3014d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.220+0000 7f5c3580e640 1 --2- 172.21.15.78:0/2065207375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c300ba270 0x7f5c3014db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.220+0000 7f5c3580e640 1 -- 172.21.15.78:0/2065207375 >> 172.21.15.78:0/2065207375 conn(0x7f5c30074ba0 msgr2=0x7f5c30146420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.220+0000 7f5c3580e640 1 -- 172.21.15.78:0/2065207375 shutdown_connections 2024-09-15T22:34:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.220+0000 7f5c3580e640 1 -- 172.21.15.78:0/2065207375 wait complete. 2024-09-15T22:34:59.232 INFO:tasks.ceph:Scrubbing osd.6 2024-09-15T22:34:59.232 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:34:59.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.333+0000 7fc7100f1640 1 Processor -- start 2024-09-15T22:34:59.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.333+0000 7fc7100f1640 1 -- start start 2024-09-15T22:34:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.334+0000 7fc7100f1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc7080b8ba0 0x7fc7080b8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.334+0000 7fc7100f1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc708145330 0x7fc7080b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.334+0000 7fc7100f1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc708144870 con 0x7fc7080b6b10 2024-09-15T22:34:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.334+0000 7fc7100f1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fc7081457c0 con 0x7fc708145330 2024-09-15T22:34:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.334+0000 7fc7100f1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc708144ea0 con 0x7fc7080b8ba0 2024-09-15T22:34:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.334+0000 7fc70e68e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc708145330 0x7fc7080b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.334+0000 7fc70e68e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc708145330 0x7fc7080b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54540/0 (socket says 172.21.15.78:54540) 2024-09-15T22:34:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.334+0000 7fc70e68e640 1 -- 172.21.15.78:0/4121088701 learned_addr learned my addr 172.21.15.78:0/4121088701 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.334+0000 7fc70de8d640 1 --2- 172.21.15.78:0/4121088701 >> v2:172.21.15.175:3300/0 conn(0x7fc7080b8ba0 0x7fc7080b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.335+0000 7fc70e68e640 1 -- 172.21.15.78:0/4121088701 >> v2:172.21.15.175:3300/0 conn(0x7fc7080b8ba0 msgr2=0x7fc7080b8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.335+0000 7fc70e68e640 1 --2- 172.21.15.78:0/4121088701 >> v2:172.21.15.175:3300/0 conn(0x7fc7080b8ba0 0x7fc7080b8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.335+0000 7fc70e68e640 1 -- 172.21.15.78:0/4121088701 >> v1:172.21.15.175:6789/0 conn(0x7fc7080b6b10 legacy=0x7fc7080b9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.335+0000 7fc70e68e640 1 -- 172.21.15.78:0/4121088701 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc708144b30 con 0x7fc708145330 2024-09-15T22:34:59.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.335+0000 7fc70e68e640 1 --2- 172.21.15.78:0/4121088701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc708145330 0x7fc7080b61d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc70809d2b0 tx=0x7fc70002c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1dd92db4c358996 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.336+0000 7fc70ce8b640 1 -- 172.21.15.78:0/4121088701 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700036020 con 0x7fc708145330 2024-09-15T22:34:59.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.336+0000 7fc70ce8b640 1 -- 172.21.15.78:0/4121088701 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc700032640 con 0x7fc708145330 2024-09-15T22:34:59.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.336+0000 7fc70ce8b640 1 -- 172.21.15.78:0/4121088701 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700032a10 con 0x7fc708145330 2024-09-15T22:34:59.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.336+0000 7fc7100f1640 1 -- 172.21.15.78:0/4121088701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc708145330 msgr2=0x7fc7080b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.336+0000 7fc7100f1640 1 --2- 172.21.15.78:0/4121088701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc708145330 0x7fc7080b61d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc70809d2b0 tx=0x7fc70002c940 comp rx=0 tx=0).stop 2024-09-15T22:34:59.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.336+0000 7fc7100f1640 1 -- 172.21.15.78:0/4121088701 shutdown_connections 2024-09-15T22:34:59.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.336+0000 7fc7100f1640 1 --2- 172.21.15.78:0/4121088701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc708145330 0x7fc7080b61d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.336+0000 7fc7100f1640 1 --2- 172.21.15.78:0/4121088701 >> v2:172.21.15.175:3300/0 conn(0x7fc7080b8ba0 0x7fc7080b8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.336+0000 7fc7100f1640 1 -- 172.21.15.78:0/4121088701 >> 172.21.15.78:0/4121088701 conn(0x7fc70809c1f0 msgr2=0x7fc70809c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:59.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.336+0000 7fc7100f1640 1 -- 172.21.15.78:0/4121088701 shutdown_connections 2024-09-15T22:34:59.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.336+0000 7fc7100f1640 1 -- 172.21.15.78:0/4121088701 wait complete. 2024-09-15T22:34:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.337+0000 7fc7100f1640 1 Processor -- start 2024-09-15T22:34:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.337+0000 7fc7100f1640 1 -- start start 2024-09-15T22:34:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc7100f1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7080b6b10 0x7fc7080b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc7100f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7080b8ba0 0x7fc70809a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc7100f1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc708145330 0x7fc70809abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc7100f1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc7080b9100 con 0x7fc7080b8ba0 2024-09-15T22:34:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc7100f1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc7080b8f80 con 0x7fc7080b6b10 2024-09-15T22:34:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc7100f1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc708074ba0 con 0x7fc708145330 2024-09-15T22:34:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc70d68c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7080b8ba0 0x7fc70809a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc70d68c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7080b8ba0 0x7fc70809a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54546/0 (socket says 172.21.15.78:54546) 2024-09-15T22:34:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc70d68c640 1 -- 172.21.15.78:0/1483899751 learned_addr learned my addr 172.21.15.78:0/1483899751 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc70de8d640 1 --2- 172.21.15.78:0/1483899751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7080b6b10 0x7fc7080b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc70e68e640 1 --2- 172.21.15.78:0/1483899751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc708145330 0x7fc70809abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc70d68c640 1 -- 172.21.15.78:0/1483899751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc708145330 msgr2=0x7fc70809abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc70d68c640 1 --2- 172.21.15.78:0/1483899751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc708145330 0x7fc70809abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc70d68c640 1 -- 172.21.15.78:0/1483899751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7080b6b10 msgr2=0x7fc7080b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc70d68c640 1 --2- 172.21.15.78:0/1483899751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7080b6b10 0x7fc7080b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc70d68c640 1 -- 172.21.15.78:0/1483899751 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7080b2530 con 0x7fc7080b8ba0 2024-09-15T22:34:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.338+0000 7fc70d68c640 1 --2- 172.21.15.78:0/1483899751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7080b8ba0 0x7fc70809a670 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00c400 tx=0x7fc6fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.339+0000 7fc7067fc640 1 -- 172.21.15.78:0/1483899751 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0052d0 con 0x7fc7080b8ba0 2024-09-15T22:34:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.339+0000 7fc7067fc640 1 -- 172.21.15.78:0/1483899751 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6fc005490 con 0x7fc7080b8ba0 2024-09-15T22:34:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.339+0000 7fc7067fc640 1 -- 172.21.15.78:0/1483899751 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc007260 con 0x7fc7080b8ba0 2024-09-15T22:34:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.339+0000 7fc7100f1640 1 -- 172.21.15.78:0/1483899751 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7080b3ee0 con 0x7fc7080b8ba0 2024-09-15T22:34:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.339+0000 7fc7100f1640 1 -- 172.21.15.78:0/1483899751 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7081ce570 con 0x7fc7080b8ba0 2024-09-15T22:34:59.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.339+0000 7fc7100f1640 1 -- 172.21.15.78:0/1483899751 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc7080b8240 con 0x7fc7080b8ba0 2024-09-15T22:34:59.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.340+0000 7fc7067fc640 1 -- 172.21.15.78:0/1483899751 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc6fc007400 con 0x7fc7080b8ba0 2024-09-15T22:34:59.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.340+0000 7fc7067fc640 1 --2- 172.21.15.78:0/1483899751 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc6f406c2b0 0x7fc6f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.341+0000 7fc7067fc640 1 -- 172.21.15.78:0/1483899751 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7fc6fc08ac90 con 0x7fc7080b8ba0 2024-09-15T22:34:59.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.341+0000 7fc70de8d640 1 --2- 172.21.15.78:0/1483899751 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc6f406c2b0 0x7fc6f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.341+0000 7fc7067fc640 1 --2- 172.21.15.78:0/1483899751 >> [v2:172.21.15.175:6800/1974018373,v1:172.21.15.175:6801/1974018373] conn(0x7fc6f4075e40 0x7fc6f40782e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.341+0000 7fc7067fc640 1 -- 172.21.15.78:0/1483899751 --> [v2:172.21.15.175:6800/1974018373,v1:172.21.15.175:6801/1974018373] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6fc009e50 con 0x7fc6f4075e40 2024-09-15T22:34:59.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.341+0000 7fc7067fc640 1 -- 172.21.15.78:0/1483899751 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc6fc08d390 con 0x7fc7080b8ba0 2024-09-15T22:34:59.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.341+0000 7fc70de8d640 1 --2- 172.21.15.78:0/1483899751 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc6f406c2b0 0x7fc6f406e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc7080b2c20 tx=0x7fc6f800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.341+0000 7fc70e68e640 1 --2- 172.21.15.78:0/1483899751 >> [v2:172.21.15.175:6800/1974018373,v1:172.21.15.175:6801/1974018373] conn(0x7fc6f4075e40 0x7fc6f40782e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.341+0000 7fc70e68e640 1 --2- 172.21.15.78:0/1483899751 >> [v2:172.21.15.175:6800/1974018373,v1:172.21.15.175:6801/1974018373] conn(0x7fc6f4075e40 0x7fc6f40782e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.342+0000 7fc7067fc640 1 -- 172.21.15.78:0/1483899751 <== osd.6 v2:172.21.15.175:6800/1974018373 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc6fc009e50 con 0x7fc6f4075e40 2024-09-15T22:34:59.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.354+0000 7fc7100f1640 1 -- 172.21.15.78:0/1483899751 --> [v2:172.21.15.175:6800/1974018373,v1:172.21.15.175:6801/1974018373] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc70809b100 con 0x7fc6f4075e40 2024-09-15T22:34:59.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.355+0000 7fc7067fc640 1 -- 172.21.15.78:0/1483899751 <== osd.6 v2:172.21.15.175:6800/1974018373 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc70809b100 con 0x7fc6f4075e40 2024-09-15T22:34:59.356 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-15T22:34:59.356 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:34:59.356 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-15T22:34:59.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.355+0000 7fc7100f1640 1 -- 172.21.15.78:0/1483899751 >> [v2:172.21.15.175:6800/1974018373,v1:172.21.15.175:6801/1974018373] conn(0x7fc6f4075e40 msgr2=0x7fc6f40782e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.355+0000 7fc7100f1640 1 --2- 172.21.15.78:0/1483899751 >> [v2:172.21.15.175:6800/1974018373,v1:172.21.15.175:6801/1974018373] conn(0x7fc6f4075e40 0x7fc6f40782e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.355+0000 7fc7100f1640 1 -- 172.21.15.78:0/1483899751 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc6f406c2b0 msgr2=0x7fc6f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.355+0000 7fc7100f1640 1 --2- 172.21.15.78:0/1483899751 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fc6f406c2b0 0x7fc6f406e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc7080b2c20 tx=0x7fc6f800b040 comp rx=0 tx=0).stop 2024-09-15T22:34:59.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.355+0000 7fc7100f1640 1 -- 172.21.15.78:0/1483899751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7080b8ba0 msgr2=0x7fc70809a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.355+0000 7fc7100f1640 1 --2- 172.21.15.78:0/1483899751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7080b8ba0 0x7fc70809a670 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00c400 tx=0x7fc6fc00c8c0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.355+0000 7fc70e68e640 1 -- 172.21.15.78:0/1483899751 reap_dead start 2024-09-15T22:34:59.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.355+0000 7fc7100f1640 1 -- 172.21.15.78:0/1483899751 shutdown_connections 2024-09-15T22:34:59.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.355+0000 7fc7100f1640 1 -- 172.21.15.78:0/1483899751 >> 172.21.15.78:0/1483899751 conn(0x7fc70809c1f0 msgr2=0x7fc7080af990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:59.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.355+0000 7fc7100f1640 1 -- 172.21.15.78:0/1483899751 shutdown_connections 2024-09-15T22:34:59.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.355+0000 7fc7100f1640 1 -- 172.21.15.78:0/1483899751 wait complete. 2024-09-15T22:34:59.366 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-15T22:34:59.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.464+0000 7fa455a6e640 1 Processor -- start 2024-09-15T22:34:59.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.464+0000 7fa455a6e640 1 -- start start 2024-09-15T22:34:59.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.464+0000 7fa455a6e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa4500b2af0 0x7fa4500b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.464+0000 7fa455a6e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa45013f5b0 0x7fa45013fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.464+0000 7fa455a6e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4500b4aa0 con 0x7fa450075950 2024-09-15T22:34:59.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.464+0000 7fa455a6e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fa4500b3be0 con 0x7fa4500b2af0 2024-09-15T22:34:59.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.464+0000 7fa455a6e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa45013ff50 con 0x7fa45013f5b0 2024-09-15T22:34:59.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.465+0000 7fa44f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa4500b2af0 0x7fa4500b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.465+0000 7fa44f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa4500b2af0 0x7fa4500b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54560/0 (socket says 172.21.15.78:54560) 2024-09-15T22:34:59.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.465+0000 7fa44f7fe640 1 -- 172.21.15.78:0/3950202997 learned_addr learned my addr 172.21.15.78:0/3950202997 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:59.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.465+0000 7fa44ffff640 1 --2- 172.21.15.78:0/3950202997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa45013f5b0 0x7fa45013fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.465+0000 7fa44f7fe640 1 -- 172.21.15.78:0/3950202997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa45013f5b0 msgr2=0x7fa45013fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:59.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.465+0000 7fa44f7fe640 1 --2- 172.21.15.78:0/3950202997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa45013f5b0 0x7fa45013fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.465+0000 7fa44f7fe640 1 -- 172.21.15.78:0/3950202997 >> v1:172.21.15.175:6789/0 conn(0x7fa450075950 legacy=0x7fa450145770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.465+0000 7fa44f7fe640 1 -- 172.21.15.78:0/3950202997 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4500b2ed0 con 0x7fa4500b2af0 2024-09-15T22:34:59.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.466+0000 7fa44f7fe640 1 --2- 172.21.15.78:0/3950202997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4500b2af0 0x7fa4500b4560 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa440009870 tx=0x7fa44002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bb375c15758051 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.466+0000 7fa44effd640 1 -- 172.21.15.78:0/3950202997 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa440037070 con 0x7fa4500b2af0 2024-09-15T22:34:59.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.466+0000 7fa44effd640 1 -- 172.21.15.78:0/3950202997 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa440032440 con 0x7fa4500b2af0 2024-09-15T22:34:59.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.466+0000 7fa44effd640 1 -- 172.21.15.78:0/3950202997 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa440032810 con 0x7fa4500b2af0 2024-09-15T22:34:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.466+0000 7fa455a6e640 1 -- 172.21.15.78:0/3950202997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4500b2af0 msgr2=0x7fa4500b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.466+0000 7fa455a6e640 1 --2- 172.21.15.78:0/3950202997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4500b2af0 0x7fa4500b4560 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa440009870 tx=0x7fa44002a1c0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.466+0000 7fa455a6e640 1 -- 172.21.15.78:0/3950202997 shutdown_connections 2024-09-15T22:34:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.466+0000 7fa455a6e640 1 --2- 172.21.15.78:0/3950202997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa45013f5b0 0x7fa45013fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.466+0000 7fa455a6e640 1 --2- 172.21.15.78:0/3950202997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4500b2af0 0x7fa4500b4560 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.466+0000 7fa455a6e640 1 -- 172.21.15.78:0/3950202997 >> 172.21.15.78:0/3950202997 conn(0x7fa45006c270 msgr2=0x7fa45006c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.466+0000 7fa455a6e640 1 -- 172.21.15.78:0/3950202997 shutdown_connections 2024-09-15T22:34:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.466+0000 7fa455a6e640 1 -- 172.21.15.78:0/3950202997 wait complete. 2024-09-15T22:34:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.467+0000 7fa455a6e640 1 Processor -- start 2024-09-15T22:34:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.467+0000 7fa455a6e640 1 -- start start 2024-09-15T22:34:59.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa455a6e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa450075950 0x7fa4500b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa455a6e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4500b2af0 0x7fa4501411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa455a6e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa45013f5b0 0x7fa4501416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa455a6e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa450075430 con 0x7fa45013f5b0 2024-09-15T22:34:59.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa455a6e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa450075150 con 0x7fa450075950 2024-09-15T22:34:59.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa455a6e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa45009c290 con 0x7fa4500b2af0 2024-09-15T22:34:59.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa44ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa45013f5b0 0x7fa4501416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa44ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa45013f5b0 0x7fa4501416e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54572/0 (socket says 172.21.15.78:54572) 2024-09-15T22:34:59.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa44ffff640 1 -- 172.21.15.78:0/3508699617 learned_addr learned my addr 172.21.15.78:0/3508699617 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:59.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa44f7fe640 1 --2- 172.21.15.78:0/3508699617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa450075950 0x7fa4500b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa447fff640 1 --2- 172.21.15.78:0/3508699617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4500b2af0 0x7fa4501411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa44ffff640 1 -- 172.21.15.78:0/3508699617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4500b2af0 msgr2=0x7fa4501411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa44ffff640 1 --2- 172.21.15.78:0/3508699617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4500b2af0 0x7fa4501411a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa44ffff640 1 -- 172.21.15.78:0/3508699617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa450075950 msgr2=0x7fa4500b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa44ffff640 1 --2- 172.21.15.78:0/3508699617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa450075950 0x7fa4500b8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.468+0000 7fa44ffff640 1 -- 172.21.15.78:0/3508699617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa450142610 con 0x7fa45013f5b0 2024-09-15T22:34:59.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.469+0000 7fa44ffff640 1 --2- 172.21.15.78:0/3508699617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa45013f5b0 0x7fa4501416e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa44800efc0 tx=0x7fa44800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.469+0000 7fa44cff9640 1 -- 172.21.15.78:0/3508699617 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448018020 con 0x7fa45013f5b0 2024-09-15T22:34:59.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.469+0000 7fa44cff9640 1 -- 172.21.15.78:0/3508699617 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa448014480 con 0x7fa45013f5b0 2024-09-15T22:34:59.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.469+0000 7fa455a6e640 1 -- 172.21.15.78:0/3508699617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa450142b60 con 0x7fa45013f5b0 2024-09-15T22:34:59.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.469+0000 7fa44cff9640 1 -- 172.21.15.78:0/3508699617 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448014870 con 0x7fa45013f5b0 2024-09-15T22:34:59.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.469+0000 7fa455a6e640 1 -- 172.21.15.78:0/3508699617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa450140560 con 0x7fa45013f5b0 2024-09-15T22:34:59.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.470+0000 7fa455a6e640 1 -- 172.21.15.78:0/3508699617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4500b4560 con 0x7fa45013f5b0 2024-09-15T22:34:59.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.470+0000 7fa44cff9640 1 -- 172.21.15.78:0/3508699617 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa448005d10 con 0x7fa45013f5b0 2024-09-15T22:34:59.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.471+0000 7fa44cff9640 1 --2- 172.21.15.78:0/3508699617 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa43006c2b0 0x7fa43006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.471+0000 7fa44f7fe640 1 --2- 172.21.15.78:0/3508699617 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa43006c2b0 0x7fa43006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.471+0000 7fa44cff9640 1 -- 172.21.15.78:0/3508699617 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7fa44808c100 con 0x7fa45013f5b0 2024-09-15T22:34:59.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.471+0000 7fa44f7fe640 1 --2- 172.21.15.78:0/3508699617 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa43006c2b0 0x7fa43006e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa440034000 tx=0x7fa44002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.475+0000 7fa44cff9640 1 -- 172.21.15.78:0/3508699617 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa448022070 con 0x7fa45013f5b0 2024-09-15T22:34:59.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.641+0000 7fa455a6e640 1 -- 172.21.15.78:0/3508699617 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fa45009c670 con 0x7fa43006c2b0 2024-09-15T22:34:59.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.641+0000 7fa44cff9640 1 -- 172.21.15.78:0/3508699617 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa45009c670 con 0x7fa43006c2b0 2024-09-15T22:34:59.642 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 6 to deep-scrub 2024-09-15T22:34:59.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.644+0000 7fa455a6e640 1 -- 172.21.15.78:0/3508699617 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa43006c2b0 msgr2=0x7fa43006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.644+0000 7fa455a6e640 1 --2- 172.21.15.78:0/3508699617 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa43006c2b0 0x7fa43006e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa440034000 tx=0x7fa44002e000 comp rx=0 tx=0).stop 2024-09-15T22:34:59.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.644+0000 7fa455a6e640 1 -- 172.21.15.78:0/3508699617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa45013f5b0 msgr2=0x7fa4501416e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.644+0000 7fa455a6e640 1 --2- 172.21.15.78:0/3508699617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa45013f5b0 0x7fa4501416e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa44800efc0 tx=0x7fa44800c490 comp rx=0 tx=0).stop 2024-09-15T22:34:59.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.644+0000 7fa455a6e640 1 -- 172.21.15.78:0/3508699617 shutdown_connections 2024-09-15T22:34:59.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.644+0000 7fa455a6e640 1 --2- 172.21.15.78:0/3508699617 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa43006c2b0 0x7fa43006e770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.644+0000 7fa455a6e640 1 --2- 172.21.15.78:0/3508699617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa45013f5b0 0x7fa4501416e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.644+0000 7fa455a6e640 1 --2- 172.21.15.78:0/3508699617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4500b2af0 0x7fa4501411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.644+0000 7fa455a6e640 1 --2- 172.21.15.78:0/3508699617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa450075950 0x7fa4500b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.644+0000 7fa455a6e640 1 -- 172.21.15.78:0/3508699617 >> 172.21.15.78:0/3508699617 conn(0x7fa45006c270 msgr2=0x7fa45013e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:59.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.644+0000 7fa455a6e640 1 -- 172.21.15.78:0/3508699617 shutdown_connections 2024-09-15T22:34:59.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.644+0000 7fa455a6e640 1 -- 172.21.15.78:0/3508699617 wait complete. 2024-09-15T22:34:59.656 INFO:tasks.ceph:Scrubbing osd.7 2024-09-15T22:34:59.656 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:34:59.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.758+0000 7fad22a9b640 1 Processor -- start 2024-09-15T22:34:59.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.758+0000 7fad22a9b640 1 -- start start 2024-09-15T22:34:59.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.759+0000 7fad22a9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fad1c0b4b50 0x7fad1c144a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.759+0000 7fad22a9b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fad1c144f60 0x7fad1c1453f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.759+0000 7fad22a9b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad1c0b5d00 con 0x7fad1c0b40a0 2024-09-15T22:34:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.759+0000 7fad22a9b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fad1c0b92b0 con 0x7fad1c0b4b50 2024-09-15T22:34:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.759+0000 7fad22a9b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fad1c0b7940 con 0x7fad1c144f60 2024-09-15T22:34:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.759+0000 7fad1bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fad1c0b4b50 0x7fad1c144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.759+0000 7fad1bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fad1c0b4b50 0x7fad1c144a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54586/0 (socket says 172.21.15.78:54586) 2024-09-15T22:34:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.759+0000 7fad1bfff640 1 -- 172.21.15.78:0/3723038822 learned_addr learned my addr 172.21.15.78:0/3723038822 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.759+0000 7fad21038640 1 --2- 172.21.15.78:0/3723038822 >> v2:172.21.15.175:3300/0 conn(0x7fad1c144f60 0x7fad1c1453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.759+0000 7fad1bfff640 1 -- 172.21.15.78:0/3723038822 >> v2:172.21.15.175:3300/0 conn(0x7fad1c144f60 msgr2=0x7fad1c1453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.759+0000 7fad1bfff640 1 --2- 172.21.15.78:0/3723038822 >> v2:172.21.15.175:3300/0 conn(0x7fad1c144f60 0x7fad1c1453f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.759+0000 7fad1bfff640 1 -- 172.21.15.78:0/3723038822 >> v1:172.21.15.175:6789/0 conn(0x7fad1c0b40a0 legacy=0x7fad1c0b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.759+0000 7fad1b7fe640 1 -- 172.21.15.78:0/3723038822 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 481274607 0 0) 0x7fad1c0b5d00 con 0x7fad1c0b40a0 2024-09-15T22:34:59.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.759+0000 7fad1bfff640 1 -- 172.21.15.78:0/3723038822 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c0b4480 con 0x7fad1c0b4b50 2024-09-15T22:34:59.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.760+0000 7fad1bfff640 1 --2- 172.21.15.78:0/3723038822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad1c0b4b50 0x7fad1c144a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fad0800bb10 tx=0x7fad0802c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc198b53f1b21702 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.760+0000 7fad1b7fe640 1 -- 172.21.15.78:0/3723038822 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08032790 con 0x7fad1c0b4b50 2024-09-15T22:34:59.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.760+0000 7fad1b7fe640 1 -- 172.21.15.78:0/3723038822 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad08038070 con 0x7fad1c0b4b50 2024-09-15T22:34:59.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.760+0000 7fad1b7fe640 1 -- 172.21.15.78:0/3723038822 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08032b50 con 0x7fad1c0b4b50 2024-09-15T22:34:59.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.761+0000 7fad22a9b640 1 -- 172.21.15.78:0/3723038822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad1c0b4b50 msgr2=0x7fad1c144a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.761+0000 7fad22a9b640 1 --2- 172.21.15.78:0/3723038822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad1c0b4b50 0x7fad1c144a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fad0800bb10 tx=0x7fad0802c8d0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.761+0000 7fad22a9b640 1 -- 172.21.15.78:0/3723038822 shutdown_connections 2024-09-15T22:34:59.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.761+0000 7fad22a9b640 1 --2- 172.21.15.78:0/3723038822 >> v2:172.21.15.175:3300/0 conn(0x7fad1c144f60 0x7fad1c1453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.761+0000 7fad22a9b640 1 --2- 172.21.15.78:0/3723038822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad1c0b4b50 0x7fad1c144a20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.761+0000 7fad22a9b640 1 -- 172.21.15.78:0/3723038822 >> 172.21.15.78:0/3723038822 conn(0x7fad1c0b9430 msgr2=0x7fad1c0b9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:59.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.761+0000 7fad22a9b640 1 -- 172.21.15.78:0/3723038822 shutdown_connections 2024-09-15T22:34:59.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.761+0000 7fad22a9b640 1 -- 172.21.15.78:0/3723038822 wait complete. 2024-09-15T22:34:59.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.762+0000 7fad22a9b640 1 Processor -- start 2024-09-15T22:34:59.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.762+0000 7fad22a9b640 1 -- start start 2024-09-15T22:34:59.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.762+0000 7fad22a9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad1c0b40a0 0x7fad1c1d9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.762+0000 7fad22a9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad1c0b4b50 0x7fad1c0b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.762+0000 7fad22a9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad1c144f60 0x7fad1c0b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.762+0000 7fad22a9b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c0b9060 con 0x7fad1c0b4b50 2024-09-15T22:34:59.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.762+0000 7fad22a9b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c0b5fa0 con 0x7fad1c144f60 2024-09-15T22:34:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.762+0000 7fad22a9b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c0b8bb0 con 0x7fad1c0b40a0 2024-09-15T22:34:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad1bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad1c0b4b50 0x7fad1c0b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad1bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad1c0b4b50 0x7fad1c0b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54594/0 (socket says 172.21.15.78:54594) 2024-09-15T22:34:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad21038640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad1c144f60 0x7fad1c0b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad1bfff640 1 -- 172.21.15.78:0/527907675 learned_addr learned my addr 172.21.15.78:0/527907675 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad20837640 1 --2- 172.21.15.78:0/527907675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad1c0b40a0 0x7fad1c1d9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad1bfff640 1 -- 172.21.15.78:0/527907675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad1c0b40a0 msgr2=0x7fad1c1d9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad1bfff640 1 --2- 172.21.15.78:0/527907675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad1c0b40a0 0x7fad1c1d9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad1bfff640 1 -- 172.21.15.78:0/527907675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad1c144f60 msgr2=0x7fad1c0b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad1bfff640 1 --2- 172.21.15.78:0/527907675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad1c144f60 0x7fad1c0b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad1bfff640 1 -- 172.21.15.78:0/527907675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c06f890 con 0x7fad1c0b4b50 2024-09-15T22:34:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad1bfff640 1 --2- 172.21.15.78:0/527907675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad1c0b4b50 0x7fad1c0b1b30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fad08000c00 tx=0x7fad080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad197fa640 1 -- 172.21.15.78:0/527907675 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08033620 con 0x7fad1c0b4b50 2024-09-15T22:34:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad197fa640 1 -- 172.21.15.78:0/527907675 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad08033800 con 0x7fad1c0b4b50 2024-09-15T22:34:59.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad22a9b640 1 -- 172.21.15.78:0/527907675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1c148790 con 0x7fad1c0b4b50 2024-09-15T22:34:59.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad197fa640 1 -- 172.21.15.78:0/527907675 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08033bf0 con 0x7fad1c0b4b50 2024-09-15T22:34:59.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.763+0000 7fad22a9b640 1 -- 172.21.15.78:0/527907675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1c140aa0 con 0x7fad1c0b4b50 2024-09-15T22:34:59.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.764+0000 7fad22a9b640 1 -- 172.21.15.78:0/527907675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad1c0b3b20 con 0x7fad1c0b4b50 2024-09-15T22:34:59.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.765+0000 7fad197fa640 1 -- 172.21.15.78:0/527907675 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fad0804d060 con 0x7fad1c0b4b50 2024-09-15T22:34:59.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.765+0000 7fad197fa640 1 --2- 172.21.15.78:0/527907675 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fad0006c2e0 0x7fad0006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.765+0000 7fad197fa640 1 -- 172.21.15.78:0/527907675 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7fad080ae190 con 0x7fad1c0b4b50 2024-09-15T22:34:59.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.765+0000 7fad20837640 1 --2- 172.21.15.78:0/527907675 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fad0006c2e0 0x7fad0006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.765+0000 7fad197fa640 1 --2- 172.21.15.78:0/527907675 >> [v2:172.21.15.175:6808/2386415083,v1:172.21.15.175:6809/2386415083] conn(0x7fad00075e70 0x7fad00078310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.765+0000 7fad197fa640 1 -- 172.21.15.78:0/527907675 --> [v2:172.21.15.175:6808/2386415083,v1:172.21.15.175:6809/2386415083] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad080067f0 con 0x7fad00075e70 2024-09-15T22:34:59.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.765+0000 7fad197fa640 1 -- 172.21.15.78:0/527907675 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fad080b5050 con 0x7fad1c0b4b50 2024-09-15T22:34:59.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.766+0000 7fad21038640 1 --2- 172.21.15.78:0/527907675 >> [v2:172.21.15.175:6808/2386415083,v1:172.21.15.175:6809/2386415083] conn(0x7fad00075e70 0x7fad00078310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.766+0000 7fad20837640 1 --2- 172.21.15.78:0/527907675 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fad0006c2e0 0x7fad0006e7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fad10000f60 tx=0x7fad10009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.766+0000 7fad21038640 1 --2- 172.21.15.78:0/527907675 >> [v2:172.21.15.175:6808/2386415083,v1:172.21.15.175:6809/2386415083] conn(0x7fad00075e70 0x7fad00078310 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.767+0000 7fad197fa640 1 -- 172.21.15.78:0/527907675 <== osd.7 v2:172.21.15.175:6808/2386415083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad080067f0 con 0x7fad00075e70 2024-09-15T22:34:59.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.780+0000 7fad22a9b640 1 -- 172.21.15.78:0/527907675 --> [v2:172.21.15.175:6808/2386415083,v1:172.21.15.175:6809/2386415083] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fad1c143d70 con 0x7fad00075e70 2024-09-15T22:34:59.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.781+0000 7fad197fa640 1 -- 172.21.15.78:0/527907675 <== osd.7 v2:172.21.15.175:6808/2386415083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fad1c143d70 con 0x7fad00075e70 2024-09-15T22:34:59.782 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-15T22:34:59.782 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:34:59.782 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-15T22:34:59.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.781+0000 7fad22a9b640 1 -- 172.21.15.78:0/527907675 >> [v2:172.21.15.175:6808/2386415083,v1:172.21.15.175:6809/2386415083] conn(0x7fad00075e70 msgr2=0x7fad00078310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.781+0000 7fad22a9b640 1 --2- 172.21.15.78:0/527907675 >> [v2:172.21.15.175:6808/2386415083,v1:172.21.15.175:6809/2386415083] conn(0x7fad00075e70 0x7fad00078310 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.781+0000 7fad22a9b640 1 -- 172.21.15.78:0/527907675 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fad0006c2e0 msgr2=0x7fad0006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.781+0000 7fad22a9b640 1 --2- 172.21.15.78:0/527907675 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fad0006c2e0 0x7fad0006e7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fad10000f60 tx=0x7fad10009040 comp rx=0 tx=0).stop 2024-09-15T22:34:59.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.781+0000 7fad22a9b640 1 -- 172.21.15.78:0/527907675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad1c0b4b50 msgr2=0x7fad1c0b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.781+0000 7fad22a9b640 1 --2- 172.21.15.78:0/527907675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad1c0b4b50 0x7fad1c0b1b30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fad08000c00 tx=0x7fad080046c0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.781+0000 7fad21038640 1 -- 172.21.15.78:0/527907675 reap_dead start 2024-09-15T22:34:59.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.781+0000 7fad22a9b640 1 -- 172.21.15.78:0/527907675 shutdown_connections 2024-09-15T22:34:59.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.781+0000 7fad22a9b640 1 -- 172.21.15.78:0/527907675 >> 172.21.15.78:0/527907675 conn(0x7fad1c0b9430 msgr2=0x7fad1c143300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:59.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.782+0000 7fad22a9b640 1 -- 172.21.15.78:0/527907675 shutdown_connections 2024-09-15T22:34:59.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.782+0000 7fad22a9b640 1 -- 172.21.15.78:0/527907675 wait complete. 2024-09-15T22:34:59.793 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-15T22:34:59.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.891+0000 7fa090166640 1 Processor -- start 2024-09-15T22:34:59.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.891+0000 7fa090166640 1 -- start start 2024-09-15T22:34:59.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.891+0000 7fa090166640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa08806ce90 0x7fa088143f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.892+0000 7fa090166640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0880b3b60 0x7fa088072d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.892+0000 7fa090166640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0880b3460 con 0x7fa0880b2270 2024-09-15T22:34:59.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.892+0000 7fa090166640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fa088144490 con 0x7fa08806ce90 2024-09-15T22:34:59.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.892+0000 7fa090166640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa08806d270 con 0x7fa0880b3b60 2024-09-15T22:34:59.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.892+0000 7fa08df02640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa08806ce90 0x7fa088143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.892+0000 7fa08e703640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa0880b2270 0x7fa0881474c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60674/0 (socket says 172.21.15.78:60674) 2024-09-15T22:34:59.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.892+0000 7fa08e703640 1 -- 172.21.15.78:0/2203428617 learned_addr learned my addr 172.21.15.78:0/2203428617 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:34:59.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.892+0000 7fa08d701640 1 --2- 172.21.15.78:0/2203428617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0880b3b60 0x7fa088072d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.892+0000 7fa08df02640 1 -- 172.21.15.78:0/2203428617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0880b3b60 msgr2=0x7fa088072d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:59.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.892+0000 7fa08df02640 1 --2- 172.21.15.78:0/2203428617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0880b3b60 0x7fa088072d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.892+0000 7fa08df02640 1 -- 172.21.15.78:0/2203428617 >> v1:172.21.15.78:6789/0 conn(0x7fa0880b2270 legacy=0x7fa0881474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.892+0000 7fa08df02640 1 -- 172.21.15.78:0/2203428617 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0880b1760 con 0x7fa08806ce90 2024-09-15T22:34:59.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.892+0000 7fa08cf00640 1 -- 172.21.15.78:0/2203428617 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908565885 0 0) 0x7fa0880b3460 con 0x7fa0880b2270 2024-09-15T22:34:59.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.893+0000 7fa08df02640 1 --2- 172.21.15.78:0/2203428617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08806ce90 0x7fa088143f50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa08400a940 tx=0x7fa08402b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd949dd659be39c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.893+0000 7fa08cf00640 1 -- 172.21.15.78:0/2203428617 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08400b040 con 0x7fa08806ce90 2024-09-15T22:34:59.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.893+0000 7fa08cf00640 1 -- 172.21.15.78:0/2203428617 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa084030710 con 0x7fa08806ce90 2024-09-15T22:34:59.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.893+0000 7fa08cf00640 1 -- 172.21.15.78:0/2203428617 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084030ae0 con 0x7fa08806ce90 2024-09-15T22:34:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.893+0000 7fa090166640 1 -- 172.21.15.78:0/2203428617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08806ce90 msgr2=0x7fa088143f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.893+0000 7fa090166640 1 --2- 172.21.15.78:0/2203428617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08806ce90 0x7fa088143f50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa08400a940 tx=0x7fa08402b4c0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.893+0000 7fa090166640 1 -- 172.21.15.78:0/2203428617 shutdown_connections 2024-09-15T22:34:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.893+0000 7fa090166640 1 --2- 172.21.15.78:0/2203428617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0880b3b60 0x7fa088072d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.893+0000 7fa090166640 1 --2- 172.21.15.78:0/2203428617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08806ce90 0x7fa088143f50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.893+0000 7fa090166640 1 -- 172.21.15.78:0/2203428617 >> 172.21.15.78:0/2203428617 conn(0x7fa0880b6470 msgr2=0x7fa0880b6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.894+0000 7fa090166640 1 -- 172.21.15.78:0/2203428617 shutdown_connections 2024-09-15T22:34:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.894+0000 7fa090166640 1 -- 172.21.15.78:0/2203428617 wait complete. 2024-09-15T22:34:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.894+0000 7fa090166640 1 Processor -- start 2024-09-15T22:34:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa090166640 1 -- start start 2024-09-15T22:34:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa090166640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08806ce90 0x7fa088140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa090166640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0880b2270 0x7fa0880716d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa090166640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0880b3b60 0x7fa0881deb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa090166640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa0880b6130 con 0x7fa08806ce90 2024-09-15T22:34:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa090166640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0880b1d50 con 0x7fa0880b2270 2024-09-15T22:34:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa090166640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa0880b1330 con 0x7fa0880b3b60 2024-09-15T22:34:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa08df02640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08806ce90 0x7fa088140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa08df02640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08806ce90 0x7fa088140d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54618/0 (socket says 172.21.15.78:54618) 2024-09-15T22:34:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa08df02640 1 -- 172.21.15.78:0/1654384741 learned_addr learned my addr 172.21.15.78:0/1654384741 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:34:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa08e703640 1 --2- 172.21.15.78:0/1654384741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0880b3b60 0x7fa0881deb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa08d701640 1 --2- 172.21.15.78:0/1654384741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0880b2270 0x7fa0880716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa08df02640 1 -- 172.21.15.78:0/1654384741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0880b3b60 msgr2=0x7fa0881deb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa08df02640 1 --2- 172.21.15.78:0/1654384741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0880b3b60 0x7fa0881deb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa08df02640 1 -- 172.21.15.78:0/1654384741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0880b2270 msgr2=0x7fa0880716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa08df02640 1 --2- 172.21.15.78:0/1654384741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0880b2270 0x7fa0880716d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.895+0000 7fa08df02640 1 -- 172.21.15.78:0/1654384741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa088071c10 con 0x7fa08806ce90 2024-09-15T22:34:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.896+0000 7fa08df02640 1 --2- 172.21.15.78:0/1654384741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08806ce90 0x7fa088140d70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa084000c00 tx=0x7fa0840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.896+0000 7fa07a7fc640 1 -- 172.21.15.78:0/1654384741 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084040070 con 0x7fa08806ce90 2024-09-15T22:34:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.896+0000 7fa07a7fc640 1 -- 172.21.15.78:0/1654384741 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa084033a50 con 0x7fa08806ce90 2024-09-15T22:34:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.896+0000 7fa090166640 1 -- 172.21.15.78:0/1654384741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0881417f0 con 0x7fa08806ce90 2024-09-15T22:34:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.896+0000 7fa07a7fc640 1 -- 172.21.15.78:0/1654384741 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084033e40 con 0x7fa08806ce90 2024-09-15T22:34:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.896+0000 7fa090166640 1 -- 172.21.15.78:0/1654384741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08806fc00 con 0x7fa08806ce90 2024-09-15T22:34:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.897+0000 7fa090166640 1 -- 172.21.15.78:0/1654384741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa088143f50 con 0x7fa08806ce90 2024-09-15T22:34:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.897+0000 7fa07a7fc640 1 -- 172.21.15.78:0/1654384741 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa084043070 con 0x7fa08806ce90 2024-09-15T22:34:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.898+0000 7fa07a7fc640 1 --2- 172.21.15.78:0/1654384741 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa06c06c2b0 0x7fa06c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.898+0000 7fa07a7fc640 1 -- 172.21.15.78:0/1654384741 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7fa0840ac1d0 con 0x7fa08806ce90 2024-09-15T22:34:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.898+0000 7fa08d701640 1 --2- 172.21.15.78:0/1654384741 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa06c06c2b0 0x7fa06c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.898+0000 7fa08d701640 1 --2- 172.21.15.78:0/1654384741 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa06c06c2b0 0x7fa06c06e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa0880731a0 tx=0x7fa07c009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:59.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:34:59.902+0000 7fa07a7fc640 1 -- 172.21.15.78:0/1654384741 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa088071c10 con 0x7fa08806ce90 2024-09-15T22:35:00.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.080+0000 7fa090166640 1 -- 172.21.15.78:0/1654384741 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fa0880691d0 con 0x7fa06c06c2b0 2024-09-15T22:35:00.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.081+0000 7fa07a7fc640 1 -- 172.21.15.78:0/1654384741 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa07c011a00 con 0x7fa06c06c2b0 2024-09-15T22:35:00.082 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 7 to deep-scrub 2024-09-15T22:35:00.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.083+0000 7fa090166640 1 -- 172.21.15.78:0/1654384741 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa06c06c2b0 msgr2=0x7fa06c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:00.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.083+0000 7fa090166640 1 --2- 172.21.15.78:0/1654384741 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa06c06c2b0 0x7fa06c06e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa0880731a0 tx=0x7fa07c009110 comp rx=0 tx=0).stop 2024-09-15T22:35:00.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.083+0000 7fa090166640 1 -- 172.21.15.78:0/1654384741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08806ce90 msgr2=0x7fa088140d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:00.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.083+0000 7fa090166640 1 --2- 172.21.15.78:0/1654384741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08806ce90 0x7fa088140d70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa084000c00 tx=0x7fa0840046c0 comp rx=0 tx=0).stop 2024-09-15T22:35:00.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.083+0000 7fa090166640 1 -- 172.21.15.78:0/1654384741 shutdown_connections 2024-09-15T22:35:00.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.083+0000 7fa090166640 1 --2- 172.21.15.78:0/1654384741 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa06c06c2b0 0x7fa06c06e770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:00.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.083+0000 7fa090166640 1 --2- 172.21.15.78:0/1654384741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0880b3b60 0x7fa0881deb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:00.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.083+0000 7fa090166640 1 --2- 172.21.15.78:0/1654384741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0880b2270 0x7fa0880716d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:00.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.083+0000 7fa090166640 1 --2- 172.21.15.78:0/1654384741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08806ce90 0x7fa088140d70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:00.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.083+0000 7fa090166640 1 -- 172.21.15.78:0/1654384741 >> 172.21.15.78:0/1654384741 conn(0x7fa0880b6470 msgr2=0x7fa0880b6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:00.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.083+0000 7fa090166640 1 -- 172.21.15.78:0/1654384741 shutdown_connections 2024-09-15T22:35:00.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.083+0000 7fa090166640 1 -- 172.21.15.78:0/1654384741 wait complete. 2024-09-15T22:35:00.095 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:35:00.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.193+0000 7f0f57318640 1 Processor -- start 2024-09-15T22:35:00.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.193+0000 7f0f57318640 1 -- start start 2024-09-15T22:35:00.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.193+0000 7f0f57318640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0f50147e90 0x7f0f50153320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:00.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.193+0000 7f0f57318640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f50074230 con 0x7f0f50147a70 2024-09-15T22:35:00.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.193+0000 7f0f57318640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f50073a30 con 0x7f0f5006d560 2024-09-15T22:35:00.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.193+0000 7f0f57318640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f0f500722e0 con 0x7f0f50147e90 2024-09-15T22:35:00.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.194+0000 7f0f558b5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0f50147e90 0x7f0f50153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:00.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.194+0000 7f0f548b3640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0f50147a70 0x7f0f50072a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58804/0 (socket says 172.21.15.78:58804) 2024-09-15T22:35:00.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.194+0000 7f0f548b3640 1 -- 172.21.15.78:0/3531641292 learned_addr learned my addr 172.21.15.78:0/3531641292 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:35:00.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.194+0000 7f0f558b5640 1 -- 172.21.15.78:0/3531641292 >> v1:172.21.15.175:6789/0 conn(0x7f0f5006d560 legacy=0x7f0f500b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:00.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.194+0000 7f0f558b5640 1 -- 172.21.15.78:0/3531641292 >> v1:172.21.15.78:6789/0 conn(0x7f0f50147a70 legacy=0x7f0f50072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:00.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.194+0000 7f0f4ffff640 1 -- 172.21.15.78:0/3531641292 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 293688606 0 0) 0x7f0f50074230 con 0x7f0f50147a70 2024-09-15T22:35:00.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.194+0000 7f0f558b5640 1 -- 172.21.15.78:0/3531641292 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f500b1fc0 con 0x7f0f50147e90 2024-09-15T22:35:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.195+0000 7f0f558b5640 1 --2- 172.21.15.78:0/3531641292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f50147e90 0x7f0f50153320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0f400097a0 tx=0x7f0f4002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b9d78f830712d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.195+0000 7f0f4ffff640 1 -- 172.21.15.78:0/3531641292 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40037070 con 0x7f0f50147e90 2024-09-15T22:35:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.195+0000 7f0f4ffff640 1 -- 172.21.15.78:0/3531641292 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f40032440 con 0x7f0f50147e90 2024-09-15T22:35:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.195+0000 7f0f4ffff640 1 -- 172.21.15.78:0/3531641292 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40032810 con 0x7f0f50147e90 2024-09-15T22:35:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.195+0000 7f0f57318640 1 -- 172.21.15.78:0/3531641292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f50147e90 msgr2=0x7f0f50153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.195+0000 7f0f57318640 1 --2- 172.21.15.78:0/3531641292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f50147e90 0x7f0f50153320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0f400097a0 tx=0x7f0f4002a230 comp rx=0 tx=0).stop 2024-09-15T22:35:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.195+0000 7f0f57318640 1 -- 172.21.15.78:0/3531641292 shutdown_connections 2024-09-15T22:35:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.195+0000 7f0f57318640 1 --2- 172.21.15.78:0/3531641292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f50147e90 0x7f0f50153320 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.195+0000 7f0f57318640 1 -- 172.21.15.78:0/3531641292 >> 172.21.15.78:0/3531641292 conn(0x7f0f50074ba0 msgr2=0x7f0f50074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.195+0000 7f0f57318640 1 -- 172.21.15.78:0/3531641292 shutdown_connections 2024-09-15T22:35:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.195+0000 7f0f57318640 1 -- 172.21.15.78:0/3531641292 wait complete. 2024-09-15T22:35:00.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.196+0000 7f0f57318640 1 Processor -- start 2024-09-15T22:35:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.196+0000 7f0f57318640 1 -- start start 2024-09-15T22:35:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f57318640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f5006d560 0x7f0f500b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f57318640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f50147a70 0x7f0f500aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f57318640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f50147e90 0x7f0f500af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f57318640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0f500732e0 con 0x7f0f50147a70 2024-09-15T22:35:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f57318640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f50073160 con 0x7f0f5006d560 2024-09-15T22:35:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f57318640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0f50153860 con 0x7f0f50147e90 2024-09-15T22:35:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f548b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f50147a70 0x7f0f500aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f548b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f50147a70 0x7f0f500aefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47186/0 (socket says 172.21.15.78:47186) 2024-09-15T22:35:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f548b3640 1 -- 172.21.15.78:0/1015718156 learned_addr learned my addr 172.21.15.78:0/1015718156 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:35:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f550b4640 1 --2- 172.21.15.78:0/1015718156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f5006d560 0x7f0f500b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f558b5640 1 --2- 172.21.15.78:0/1015718156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f50147e90 0x7f0f500af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f548b3640 1 -- 172.21.15.78:0/1015718156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f50147e90 msgr2=0x7f0f500af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f548b3640 1 --2- 172.21.15.78:0/1015718156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f50147e90 0x7f0f500af4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f548b3640 1 -- 172.21.15.78:0/1015718156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f5006d560 msgr2=0x7f0f500b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f548b3640 1 --2- 172.21.15.78:0/1015718156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f5006d560 0x7f0f500b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f548b3640 1 -- 172.21.15.78:0/1015718156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f500b5500 con 0x7f0f50147a70 2024-09-15T22:35:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f558b5640 1 --2- 172.21.15.78:0/1015718156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f50147e90 0x7f0f500af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:35:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.197+0000 7f0f548b3640 1 --2- 172.21.15.78:0/1015718156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f50147a70 0x7f0f500aefb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c4a0 tx=0x7f0f4400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.198+0000 7f0f4dffb640 1 -- 172.21.15.78:0/1015718156 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44018070 con 0x7f0f50147a70 2024-09-15T22:35:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.198+0000 7f0f4dffb640 1 -- 172.21.15.78:0/1015718156 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f440074e0 con 0x7f0f50147a70 2024-09-15T22:35:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.198+0000 7f0f57318640 1 -- 172.21.15.78:0/1015718156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5013bb00 con 0x7f0f50147a70 2024-09-15T22:35:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.198+0000 7f0f4dffb640 1 -- 172.21.15.78:0/1015718156 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44004a20 con 0x7f0f50147a70 2024-09-15T22:35:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.198+0000 7f0f57318640 1 -- 172.21.15.78:0/1015718156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f500b2bc0 con 0x7f0f50147a70 2024-09-15T22:35:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.199+0000 7f0f57318640 1 -- 172.21.15.78:0/1015718156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f500b18b0 con 0x7f0f50147a70 2024-09-15T22:35:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.199+0000 7f0f4dffb640 1 -- 172.21.15.78:0/1015718156 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0f4401b070 con 0x7f0f50147a70 2024-09-15T22:35:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.200+0000 7f0f4dffb640 1 --2- 172.21.15.78:0/1015718156 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f0f3c06c2e0 0x7f0f3c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.200+0000 7f0f550b4640 1 --2- 172.21.15.78:0/1015718156 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f0f3c06c2e0 0x7f0f3c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.200+0000 7f0f4dffb640 1 -- 172.21.15.78:0/1015718156 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7f0f4408aad0 con 0x7f0f50147a70 2024-09-15T22:35:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.200+0000 7f0f550b4640 1 --2- 172.21.15.78:0/1015718156 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f0f3c06c2e0 0x7f0f3c06e7a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f48001e80 tx=0x7f0f48009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:00.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.204+0000 7f0f4dffb640 1 -- 172.21.15.78:0/1015718156 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f44058790 con 0x7f0f50147a70 2024-09-15T22:35:00.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.368+0000 7f0f57318640 1 -- 172.21.15.78:0/1015718156 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f50072000 con 0x7f0f3c06c2e0 2024-09-15T22:35:00.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.375+0000 7f0f4dffb640 1 -- 172.21.15.78:0/1015718156 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+330996 (secure 0 0 0) 0x7f0f50072000 con 0x7f0f3c06c2e0 2024-09-15T22:35:00.379 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:35:00.381 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-15T22:35:00.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.378+0000 7f0f57318640 1 -- 172.21.15.78:0/1015718156 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f0f3c06c2e0 msgr2=0x7f0f3c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:00.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.378+0000 7f0f57318640 1 --2- 172.21.15.78:0/1015718156 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f0f3c06c2e0 0x7f0f3c06e7a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f48001e80 tx=0x7f0f48009040 comp rx=0 tx=0).stop 2024-09-15T22:35:00.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.378+0000 7f0f57318640 1 -- 172.21.15.78:0/1015718156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f50147a70 msgr2=0x7f0f500aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:00.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.378+0000 7f0f57318640 1 --2- 172.21.15.78:0/1015718156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f50147a70 0x7f0f500aefb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c4a0 tx=0x7f0f4400c960 comp rx=0 tx=0).stop 2024-09-15T22:35:00.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.379+0000 7f0f57318640 1 -- 172.21.15.78:0/1015718156 shutdown_connections 2024-09-15T22:35:00.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.379+0000 7f0f57318640 1 --2- 172.21.15.78:0/1015718156 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f0f3c06c2e0 0x7f0f3c06e7a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:00.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.379+0000 7f0f57318640 1 --2- 172.21.15.78:0/1015718156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f50147e90 0x7f0f500af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:00.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.379+0000 7f0f57318640 1 --2- 172.21.15.78:0/1015718156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f50147a70 0x7f0f500aefb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:00.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.379+0000 7f0f57318640 1 --2- 172.21.15.78:0/1015718156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f5006d560 0x7f0f500b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:00.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.379+0000 7f0f57318640 1 -- 172.21.15.78:0/1015718156 >> 172.21.15.78:0/1015718156 conn(0x7f0f50074ba0 msgr2=0x7f0f500b7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:00.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.379+0000 7f0f57318640 1 -- 172.21.15.78:0/1015718156 shutdown_connections 2024-09-15T22:35:00.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:00.379+0000 7f0f57318640 1 -- 172.21.15.78:0/1015718156 wait complete. 2024-09-15T22:35:00.390 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":798,"stamp":"2024-09-15T22:35:00.302094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":249454935,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":3046,"num_read_kb":8096,"num_write":191655,"num_write_kb":4329962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273682,"ondisk_log_size":273682,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4119296,"kb_used_data":322112,"kb_used_omap":12,"kb_used_meta":3797043,"kb_avail":750855424,"statfs":{"total":773094113280,"available":768875954176,"internally_reserved":0,"allocated":329842688,"data_stored":499850326,"data_compressed":51516962,"data_compressed_allocated":79265792,"data_compressed_original":250691584,"omap_allocated":12747,"internal_metadata":3888172597},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-219387119,"num_objects":-1374,"num_object_clones":0,"num_object_copies":-4150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1374,"num_whiteouts":0,"num_read":9,"num_read_kb":91,"num_write":1438,"num_write_kb":1818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-113,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003027"},"pg_stats":[{"pgid":"2.1f","version":"27'1786","reported_seq":1833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.694756+0000","last_change":"2024-09-15T22:34:59.694801+0000","last_active":"2024-09-15T22:34:59.694756+0000","last_peered":"2024-09-15T22:34:59.694756+0000","last_clean":"2024-09-15T22:34:59.694756+0000","last_became_active":"2024-09-15T22:09:16.402725+0000","last_became_peered":"2024-09-15T22:09:16.402725+0000","last_unstale":"2024-09-15T22:34:59.694756+0000","last_undegraded":"2024-09-15T22:34:59.694756+0000","last_fullsized":"2024-09-15T22:34:59.694756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1786","last_scrub_stamp":"2024-09-15T22:34:59.694667+0000","last_deep_scrub":"27'1786","last_deep_scrub_stamp":"2024-09-15T22:34:59.694667+0000","last_clean_scrub_stamp":"2024-09-15T22:34:59.694667+0000","objects_scrubbed":3,"log_size":1786,"log_dups_size":0,"ondisk_log_size":1786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:47.714864+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1792,"num_write_kb":13194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'869","reported_seq":906,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.166729+0000","last_change":"2024-09-15T22:09:17.400698+0000","last_active":"2024-09-15T22:34:48.166729+0000","last_peered":"2024-09-15T22:34:48.166729+0000","last_clean":"2024-09-15T22:34:48.166729+0000","last_became_active":"2024-09-15T22:09:17.400428+0000","last_became_peered":"2024-09-15T22:09:17.400428+0000","last_unstale":"2024-09-15T22:34:48.166729+0000","last_undegraded":"2024-09-15T22:34:48.166729+0000","last_fullsized":"2024-09-15T22:34:48.166729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4221","reported_seq":4250,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.682808+0000","last_change":"2024-09-15T22:09:21.449737+0000","last_active":"2024-09-15T22:34:47.682808+0000","last_peered":"2024-09-15T22:34:47.682808+0000","last_clean":"2024-09-15T22:34:47.682808+0000","last_became_active":"2024-09-15T22:09:21.449376+0000","last_became_peered":"2024-09-15T22:09:21.449376+0000","last_unstale":"2024-09-15T22:34:47.682808+0000","last_undegraded":"2024-09-15T22:34:47.682808+0000","last_fullsized":"2024-09-15T22:34:47.682808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4221,"log_dups_size":0,"ondisk_log_size":4221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3323,"num_write_kb":95202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3536","reported_seq":3575,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.140441+0000","last_change":"2024-09-15T22:09:16.407728+0000","last_active":"2024-09-15T22:34:48.140441+0000","last_peered":"2024-09-15T22:34:48.140441+0000","last_clean":"2024-09-15T22:34:48.140441+0000","last_became_active":"2024-09-15T22:09:16.407458+0000","last_became_peered":"2024-09-15T22:09:16.407458+0000","last_unstale":"2024-09-15T22:34:48.140441+0000","last_undegraded":"2024-09-15T22:34:48.140441+0000","last_fullsized":"2024-09-15T22:34:48.140441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3536,"log_dups_size":0,"ondisk_log_size":3536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":30404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'865","reported_seq":910,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:57.645513+0000","last_change":"2024-09-15T22:34:57.645536+0000","last_active":"2024-09-15T22:34:57.645513+0000","last_peered":"2024-09-15T22:34:57.645513+0000","last_clean":"2024-09-15T22:34:57.645513+0000","last_became_active":"2024-09-15T22:09:17.414966+0000","last_became_peered":"2024-09-15T22:09:17.414966+0000","last_unstale":"2024-09-15T22:34:57.645513+0000","last_undegraded":"2024-09-15T22:34:57.645513+0000","last_fullsized":"2024-09-15T22:34:57.645513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'865","last_scrub_stamp":"2024-09-15T22:34:57.645445+0000","last_deep_scrub":"27'865","last_deep_scrub_stamp":"2024-09-15T22:34:57.645445+0000","last_clean_scrub_stamp":"2024-09-15T22:34:57.645445+0000","objects_scrubbed":0,"log_size":865,"log_dups_size":0,"ondisk_log_size":865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:53.811425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'3714","reported_seq":3743,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.707678+0000","last_change":"2024-09-15T22:09:21.454087+0000","last_active":"2024-09-15T22:34:47.707678+0000","last_peered":"2024-09-15T22:34:47.707678+0000","last_clean":"2024-09-15T22:34:47.707678+0000","last_became_active":"2024-09-15T22:09:21.453701+0000","last_became_peered":"2024-09-15T22:09:21.453701+0000","last_unstale":"2024-09-15T22:34:47.707678+0000","last_undegraded":"2024-09-15T22:34:47.707678+0000","last_fullsized":"2024-09-15T22:34:47.707678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3714,"log_dups_size":0,"ondisk_log_size":3714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2789,"num_write_kb":63634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'4509","reported_seq":4546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.134729+0000","last_change":"2024-09-15T22:09:16.405902+0000","last_active":"2024-09-15T22:34:48.134729+0000","last_peered":"2024-09-15T22:34:48.134729+0000","last_clean":"2024-09-15T22:34:48.134729+0000","last_became_active":"2024-09-15T22:09:16.405626+0000","last_became_peered":"2024-09-15T22:09:16.405626+0000","last_unstale":"2024-09-15T22:34:48.134729+0000","last_undegraded":"2024-09-15T22:34:48.134729+0000","last_fullsized":"2024-09-15T22:34:48.134729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4509,"log_dups_size":0,"ondisk_log_size":4509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4510,"num_write_kb":35033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'918","reported_seq":958,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.003534+0000","last_change":"2024-09-15T22:09:59.805432+0000","last_active":"2024-09-15T22:34:48.003534+0000","last_peered":"2024-09-15T22:34:48.003534+0000","last_clean":"2024-09-15T22:34:48.003534+0000","last_became_active":"2024-09-15T22:09:59.804970+0000","last_became_peered":"2024-09-15T22:09:59.804970+0000","last_unstale":"2024-09-15T22:34:48.003534+0000","last_undegraded":"2024-09-15T22:34:48.003534+0000","last_fullsized":"2024-09-15T22:34:48.003534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3619","reported_seq":3648,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.174006+0000","last_change":"2024-09-15T22:09:21.455260+0000","last_active":"2024-09-15T22:34:48.174006+0000","last_peered":"2024-09-15T22:34:48.174006+0000","last_clean":"2024-09-15T22:34:48.174006+0000","last_became_active":"2024-09-15T22:09:21.454850+0000","last_became_peered":"2024-09-15T22:09:21.454850+0000","last_unstale":"2024-09-15T22:34:48.174006+0000","last_undegraded":"2024-09-15T22:34:48.174006+0000","last_fullsized":"2024-09-15T22:34:48.174006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3619,"log_dups_size":0,"ondisk_log_size":3619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2687,"num_write_kb":123513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'2007","reported_seq":2044,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.139179+0000","last_change":"2024-09-15T22:09:16.407670+0000","last_active":"2024-09-15T22:34:48.139179+0000","last_peered":"2024-09-15T22:34:48.139179+0000","last_clean":"2024-09-15T22:34:48.139179+0000","last_became_active":"2024-09-15T22:09:16.407364+0000","last_became_peered":"2024-09-15T22:09:16.407364+0000","last_unstale":"2024-09-15T22:34:48.139179+0000","last_undegraded":"2024-09-15T22:34:48.139179+0000","last_fullsized":"2024-09-15T22:34:48.139179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2007,"log_dups_size":0,"ondisk_log_size":2007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2007,"num_write_kb":17393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'890","reported_seq":925,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.161937+0000","last_change":"2024-09-15T22:09:17.408224+0000","last_active":"2024-09-15T22:34:48.161937+0000","last_peered":"2024-09-15T22:34:48.161937+0000","last_clean":"2024-09-15T22:34:48.161937+0000","last_became_active":"2024-09-15T22:09:17.407881+0000","last_became_peered":"2024-09-15T22:09:17.407881+0000","last_unstale":"2024-09-15T22:34:48.161937+0000","last_undegraded":"2024-09-15T22:34:48.161937+0000","last_fullsized":"2024-09-15T22:34:48.161937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":890,"log_dups_size":0,"ondisk_log_size":890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'3863","reported_seq":3892,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.171472+0000","last_change":"2024-09-15T22:09:21.450705+0000","last_active":"2024-09-15T22:34:48.171472+0000","last_peered":"2024-09-15T22:34:48.171472+0000","last_clean":"2024-09-15T22:34:48.171472+0000","last_became_active":"2024-09-15T22:09:21.450265+0000","last_became_peered":"2024-09-15T22:09:21.450265+0000","last_unstale":"2024-09-15T22:34:48.171472+0000","last_undegraded":"2024-09-15T22:34:48.171472+0000","last_fullsized":"2024-09-15T22:34:48.171472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3863,"log_dups_size":0,"ondisk_log_size":3863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3014,"num_write_kb":86107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'883","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.970813+0000","last_change":"2024-09-15T22:09:17.410686+0000","last_active":"2024-09-15T22:34:47.970813+0000","last_peered":"2024-09-15T22:34:47.970813+0000","last_clean":"2024-09-15T22:34:47.970813+0000","last_became_active":"2024-09-15T22:09:17.410383+0000","last_became_peered":"2024-09-15T22:09:17.410383+0000","last_unstale":"2024-09-15T22:34:47.970813+0000","last_undegraded":"2024-09-15T22:34:47.970813+0000","last_fullsized":"2024-09-15T22:34:47.970813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'3968","reported_seq":4006,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.168524+0000","last_change":"2024-09-15T22:09:16.405335+0000","last_active":"2024-09-15T22:34:48.168524+0000","last_peered":"2024-09-15T22:34:48.168524+0000","last_clean":"2024-09-15T22:34:48.168524+0000","last_became_active":"2024-09-15T22:09:16.405010+0000","last_became_peered":"2024-09-15T22:09:16.405010+0000","last_unstale":"2024-09-15T22:34:48.168524+0000","last_undegraded":"2024-09-15T22:34:48.168524+0000","last_fullsized":"2024-09-15T22:34:48.168524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3968,"log_dups_size":0,"ondisk_log_size":3968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3969,"num_write_kb":30662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'3504","reported_seq":3541,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.495884+0000","last_change":"2024-09-15T22:09:59.534148+0000","last_active":"2024-09-15T22:34:47.495884+0000","last_peered":"2024-09-15T22:34:47.495884+0000","last_clean":"2024-09-15T22:34:47.495884+0000","last_became_active":"2024-09-15T22:09:59.533675+0000","last_became_peered":"2024-09-15T22:09:59.533675+0000","last_unstale":"2024-09-15T22:34:47.495884+0000","last_undegraded":"2024-09-15T22:34:47.495884+0000","last_fullsized":"2024-09-15T22:34:47.495884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3504,"log_dups_size":0,"ondisk_log_size":3504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2557,"num_write_kb":53761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'919","reported_seq":955,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.167626+0000","last_change":"2024-09-15T22:09:17.405327+0000","last_active":"2024-09-15T22:34:48.167626+0000","last_peered":"2024-09-15T22:34:48.167626+0000","last_clean":"2024-09-15T22:34:48.167626+0000","last_became_active":"2024-09-15T22:09:17.405065+0000","last_became_peered":"2024-09-15T22:09:17.405065+0000","last_unstale":"2024-09-15T22:34:48.167626+0000","last_undegraded":"2024-09-15T22:34:48.167626+0000","last_fullsized":"2024-09-15T22:34:48.167626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3442","reported_seq":3480,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.153528+0000","last_change":"2024-09-15T22:09:16.406705+0000","last_active":"2024-09-15T22:34:48.153528+0000","last_peered":"2024-09-15T22:34:48.153528+0000","last_clean":"2024-09-15T22:34:48.153528+0000","last_became_active":"2024-09-15T22:09:16.406454+0000","last_became_peered":"2024-09-15T22:09:16.406454+0000","last_unstale":"2024-09-15T22:34:48.153528+0000","last_undegraded":"2024-09-15T22:34:48.153528+0000","last_fullsized":"2024-09-15T22:34:48.153528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3442,"log_dups_size":0,"ondisk_log_size":3442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3448,"num_write_kb":30365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'4173","reported_seq":4210,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.163072+0000","last_change":"2024-09-15T22:09:59.805673+0000","last_active":"2024-09-15T22:34:48.163072+0000","last_peered":"2024-09-15T22:34:48.163072+0000","last_clean":"2024-09-15T22:34:48.163072+0000","last_became_active":"2024-09-15T22:09:59.805100+0000","last_became_peered":"2024-09-15T22:09:59.805100+0000","last_unstale":"2024-09-15T22:34:48.163072+0000","last_undegraded":"2024-09-15T22:34:48.163072+0000","last_fullsized":"2024-09-15T22:34:48.163072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4173,"log_dups_size":0,"ondisk_log_size":4173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3298,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'955","reported_seq":991,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.155189+0000","last_change":"2024-09-15T22:09:17.399551+0000","last_active":"2024-09-15T22:34:48.155189+0000","last_peered":"2024-09-15T22:34:48.155189+0000","last_clean":"2024-09-15T22:34:48.155189+0000","last_became_active":"2024-09-15T22:09:17.399290+0000","last_became_peered":"2024-09-15T22:09:17.399290+0000","last_unstale":"2024-09-15T22:34:48.155189+0000","last_undegraded":"2024-09-15T22:34:48.155189+0000","last_fullsized":"2024-09-15T22:34:48.155189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2082","reported_seq":2120,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.151132+0000","last_change":"2024-09-15T22:09:16.408974+0000","last_active":"2024-09-15T22:34:48.151132+0000","last_peered":"2024-09-15T22:34:48.151132+0000","last_clean":"2024-09-15T22:34:48.151132+0000","last_became_active":"2024-09-15T22:09:16.408691+0000","last_became_peered":"2024-09-15T22:09:16.408691+0000","last_unstale":"2024-09-15T22:34:48.151132+0000","last_undegraded":"2024-09-15T22:34:48.151132+0000","last_fullsized":"2024-09-15T22:34:48.151132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2082,"log_dups_size":0,"ondisk_log_size":2082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2101,"num_write_kb":17400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'3631","reported_seq":3661,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.478841+0000","last_change":"2024-09-15T22:09:21.458893+0000","last_active":"2024-09-15T22:34:47.478841+0000","last_peered":"2024-09-15T22:34:47.478841+0000","last_clean":"2024-09-15T22:34:47.478841+0000","last_became_active":"2024-09-15T22:09:21.458548+0000","last_became_peered":"2024-09-15T22:09:21.458548+0000","last_unstale":"2024-09-15T22:34:47.478841+0000","last_undegraded":"2024-09-15T22:34:47.478841+0000","last_fullsized":"2024-09-15T22:34:47.478841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3631,"log_dups_size":0,"ondisk_log_size":3631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2705,"num_write_kb":61946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'892","reported_seq":928,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.982388+0000","last_change":"2024-09-15T22:09:17.400823+0000","last_active":"2024-09-15T22:34:47.982388+0000","last_peered":"2024-09-15T22:34:47.982388+0000","last_clean":"2024-09-15T22:34:47.982388+0000","last_became_active":"2024-09-15T22:09:17.400494+0000","last_became_peered":"2024-09-15T22:09:17.400494+0000","last_unstale":"2024-09-15T22:34:47.982388+0000","last_undegraded":"2024-09-15T22:34:47.982388+0000","last_fullsized":"2024-09-15T22:34:47.982388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1674","reported_seq":1712,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.125569+0000","last_change":"2024-09-15T22:09:16.409156+0000","last_active":"2024-09-15T22:34:48.125569+0000","last_peered":"2024-09-15T22:34:48.125569+0000","last_clean":"2024-09-15T22:34:48.125569+0000","last_became_active":"2024-09-15T22:09:16.408603+0000","last_became_peered":"2024-09-15T22:09:16.408603+0000","last_unstale":"2024-09-15T22:34:48.125569+0000","last_undegraded":"2024-09-15T22:34:48.125569+0000","last_fullsized":"2024-09-15T22:34:48.125569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1674,"log_dups_size":0,"ondisk_log_size":1674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1676,"num_write_kb":13088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'3587","reported_seq":3617,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.173730+0000","last_change":"2024-09-15T22:09:21.447940+0000","last_active":"2024-09-15T22:34:48.173730+0000","last_peered":"2024-09-15T22:34:48.173730+0000","last_clean":"2024-09-15T22:34:48.173730+0000","last_became_active":"2024-09-15T22:09:21.447348+0000","last_became_peered":"2024-09-15T22:09:21.447348+0000","last_unstale":"2024-09-15T22:34:48.173730+0000","last_undegraded":"2024-09-15T22:34:48.173730+0000","last_fullsized":"2024-09-15T22:34:48.173730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3587,"log_dups_size":0,"ondisk_log_size":3587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2651,"num_write_kb":118894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'899","reported_seq":935,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.973771+0000","last_change":"2024-09-15T22:09:17.402826+0000","last_active":"2024-09-15T22:34:47.973771+0000","last_peered":"2024-09-15T22:34:47.973771+0000","last_clean":"2024-09-15T22:34:47.973771+0000","last_became_active":"2024-09-15T22:09:17.402585+0000","last_became_peered":"2024-09-15T22:09:17.402585+0000","last_unstale":"2024-09-15T22:34:47.973771+0000","last_undegraded":"2024-09-15T22:34:47.973771+0000","last_fullsized":"2024-09-15T22:34:47.973771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'1634","reported_seq":1672,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.157203+0000","last_change":"2024-09-15T22:09:16.408097+0000","last_active":"2024-09-15T22:34:48.157203+0000","last_peered":"2024-09-15T22:34:48.157203+0000","last_clean":"2024-09-15T22:34:48.157203+0000","last_became_active":"2024-09-15T22:09:16.407657+0000","last_became_peered":"2024-09-15T22:09:16.407657+0000","last_unstale":"2024-09-15T22:34:48.157203+0000","last_undegraded":"2024-09-15T22:34:48.157203+0000","last_fullsized":"2024-09-15T22:34:48.157203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1634,"log_dups_size":0,"ondisk_log_size":1634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":13124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'3592","reported_seq":3623,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.703104+0000","last_change":"2024-09-15T22:09:21.451205+0000","last_active":"2024-09-15T22:34:47.703104+0000","last_peered":"2024-09-15T22:34:47.703104+0000","last_clean":"2024-09-15T22:34:47.703104+0000","last_became_active":"2024-09-15T22:09:21.450731+0000","last_became_peered":"2024-09-15T22:09:21.450731+0000","last_unstale":"2024-09-15T22:34:47.703104+0000","last_undegraded":"2024-09-15T22:34:47.703104+0000","last_fullsized":"2024-09-15T22:34:47.703104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2678,"num_write_kb":64130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'844","reported_seq":880,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.997116+0000","last_change":"2024-09-15T22:09:17.421690+0000","last_active":"2024-09-15T22:34:47.997116+0000","last_peered":"2024-09-15T22:34:47.997116+0000","last_clean":"2024-09-15T22:34:47.997116+0000","last_became_active":"2024-09-15T22:09:17.421379+0000","last_became_peered":"2024-09-15T22:09:17.421379+0000","last_unstale":"2024-09-15T22:34:47.997116+0000","last_undegraded":"2024-09-15T22:34:47.997116+0000","last_fullsized":"2024-09-15T22:34:47.997116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2976","reported_seq":3014,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.487793+0000","last_change":"2024-09-15T22:09:16.408662+0000","last_active":"2024-09-15T22:34:48.487793+0000","last_peered":"2024-09-15T22:34:48.487793+0000","last_clean":"2024-09-15T22:34:48.487793+0000","last_became_active":"2024-09-15T22:09:16.408068+0000","last_became_peered":"2024-09-15T22:09:16.408068+0000","last_unstale":"2024-09-15T22:34:48.487793+0000","last_undegraded":"2024-09-15T22:34:48.487793+0000","last_fullsized":"2024-09-15T22:34:48.487793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2976,"log_dups_size":0,"ondisk_log_size":2976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5729,"num_write_kb":16111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'3599","reported_seq":3630,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.173332+0000","last_change":"2024-09-15T22:09:21.457447+0000","last_active":"2024-09-15T22:34:48.173332+0000","last_peered":"2024-09-15T22:34:48.173332+0000","last_clean":"2024-09-15T22:34:48.173332+0000","last_became_active":"2024-09-15T22:09:21.457031+0000","last_became_peered":"2024-09-15T22:09:21.457031+0000","last_unstale":"2024-09-15T22:34:48.173332+0000","last_undegraded":"2024-09-15T22:34:48.173332+0000","last_fullsized":"2024-09-15T22:34:48.173332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":57002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'901","reported_seq":938,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.974688+0000","last_change":"2024-09-15T22:09:17.400043+0000","last_active":"2024-09-15T22:34:47.974688+0000","last_peered":"2024-09-15T22:34:47.974688+0000","last_clean":"2024-09-15T22:34:47.974688+0000","last_became_active":"2024-09-15T22:09:17.399815+0000","last_became_peered":"2024-09-15T22:09:17.399815+0000","last_unstale":"2024-09-15T22:34:47.974688+0000","last_undegraded":"2024-09-15T22:34:47.974688+0000","last_fullsized":"2024-09-15T22:34:47.974688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2759","reported_seq":2798,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.128748+0000","last_change":"2024-09-15T22:09:16.407483+0000","last_active":"2024-09-15T22:34:48.128748+0000","last_peered":"2024-09-15T22:34:48.128748+0000","last_clean":"2024-09-15T22:34:48.128748+0000","last_became_active":"2024-09-15T22:09:16.407199+0000","last_became_peered":"2024-09-15T22:09:16.407199+0000","last_unstale":"2024-09-15T22:34:48.128748+0000","last_undegraded":"2024-09-15T22:34:48.128748+0000","last_fullsized":"2024-09-15T22:34:48.128748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2759,"log_dups_size":0,"ondisk_log_size":2759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2756,"num_write_kb":21836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'4104","reported_seq":4135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.168730+0000","last_change":"2024-09-15T22:09:21.449620+0000","last_active":"2024-09-15T22:34:48.168730+0000","last_peered":"2024-09-15T22:34:48.168730+0000","last_clean":"2024-09-15T22:34:48.168730+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:34:48.168730+0000","last_undegraded":"2024-09-15T22:34:48.168730+0000","last_fullsized":"2024-09-15T22:34:48.168730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4104,"log_dups_size":0,"ondisk_log_size":4104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3164,"num_write_kb":141390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'867","reported_seq":912,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.948510+0000","last_change":"2024-09-15T22:34:59.948548+0000","last_active":"2024-09-15T22:34:59.948510+0000","last_peered":"2024-09-15T22:34:59.948510+0000","last_clean":"2024-09-15T22:34:59.948510+0000","last_became_active":"2024-09-15T22:09:17.414645+0000","last_became_peered":"2024-09-15T22:09:17.414645+0000","last_unstale":"2024-09-15T22:34:59.948510+0000","last_undegraded":"2024-09-15T22:34:59.948510+0000","last_fullsized":"2024-09-15T22:34:59.948510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'867","last_scrub_stamp":"2024-09-15T22:34:59.948405+0000","last_deep_scrub":"27'867","last_deep_scrub_stamp":"2024-09-15T22:34:59.948405+0000","last_clean_scrub_stamp":"2024-09-15T22:34:59.948405+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:04.705970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'2263","reported_seq":2302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.133232+0000","last_change":"2024-09-15T22:09:16.408794+0000","last_active":"2024-09-15T22:34:48.133232+0000","last_peered":"2024-09-15T22:34:48.133232+0000","last_clean":"2024-09-15T22:34:48.133232+0000","last_became_active":"2024-09-15T22:09:16.408530+0000","last_became_peered":"2024-09-15T22:09:16.408530+0000","last_unstale":"2024-09-15T22:34:48.133232+0000","last_undegraded":"2024-09-15T22:34:48.133232+0000","last_fullsized":"2024-09-15T22:34:48.133232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2263,"log_dups_size":0,"ondisk_log_size":2263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2269,"num_write_kb":17504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'4348","reported_seq":4379,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.164401+0000","last_change":"2024-09-15T22:09:21.451875+0000","last_active":"2024-09-15T22:34:48.164401+0000","last_peered":"2024-09-15T22:34:48.164401+0000","last_clean":"2024-09-15T22:34:48.164401+0000","last_became_active":"2024-09-15T22:09:21.451491+0000","last_became_peered":"2024-09-15T22:09:21.451491+0000","last_unstale":"2024-09-15T22:34:48.164401+0000","last_undegraded":"2024-09-15T22:34:48.164401+0000","last_fullsized":"2024-09-15T22:34:48.164401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4348,"log_dups_size":0,"ondisk_log_size":4348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3466,"num_write_kb":69520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'894","reported_seq":931,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.975107+0000","last_change":"2024-09-15T22:09:17.409336+0000","last_active":"2024-09-15T22:34:47.975107+0000","last_peered":"2024-09-15T22:34:47.975107+0000","last_clean":"2024-09-15T22:34:47.975107+0000","last_became_active":"2024-09-15T22:09:17.409038+0000","last_became_peered":"2024-09-15T22:09:17.409038+0000","last_unstale":"2024-09-15T22:34:47.975107+0000","last_undegraded":"2024-09-15T22:34:47.975107+0000","last_fullsized":"2024-09-15T22:34:47.975107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5436","reported_seq":5475,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:51.471787+0000","last_change":"2024-09-15T22:09:16.409869+0000","last_active":"2024-09-15T22:34:51.471787+0000","last_peered":"2024-09-15T22:34:51.471787+0000","last_clean":"2024-09-15T22:34:51.471787+0000","last_became_active":"2024-09-15T22:09:16.409532+0000","last_became_peered":"2024-09-15T22:09:16.409532+0000","last_unstale":"2024-09-15T22:34:51.471787+0000","last_undegraded":"2024-09-15T22:34:51.471787+0000","last_fullsized":"2024-09-15T22:34:51.471787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":5436,"log_dups_size":0,"ondisk_log_size":5436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20462761,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5431,"num_write_kb":47203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'4057","reported_seq":4088,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.703179+0000","last_change":"2024-09-15T22:09:21.458201+0000","last_active":"2024-09-15T22:34:47.703179+0000","last_peered":"2024-09-15T22:34:47.703179+0000","last_clean":"2024-09-15T22:34:47.703179+0000","last_became_active":"2024-09-15T22:09:21.457818+0000","last_became_peered":"2024-09-15T22:09:21.457818+0000","last_unstale":"2024-09-15T22:34:47.703179+0000","last_undegraded":"2024-09-15T22:34:47.703179+0000","last_fullsized":"2024-09-15T22:34:47.703179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4057,"log_dups_size":0,"ondisk_log_size":4057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3146,"num_write_kb":128629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'903","reported_seq":940,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.968594+0000","last_change":"2024-09-15T22:09:17.399405+0000","last_active":"2024-09-15T22:34:47.968594+0000","last_peered":"2024-09-15T22:34:47.968594+0000","last_clean":"2024-09-15T22:34:47.968594+0000","last_became_active":"2024-09-15T22:09:17.399148+0000","last_became_peered":"2024-09-15T22:09:17.399148+0000","last_unstale":"2024-09-15T22:34:47.968594+0000","last_undegraded":"2024-09-15T22:34:47.968594+0000","last_fullsized":"2024-09-15T22:34:47.968594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'4746","reported_seq":7026,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:57.967635+0000","last_change":"2024-09-15T22:34:57.967665+0000","last_active":"2024-09-15T22:34:57.967635+0000","last_peered":"2024-09-15T22:34:57.967635+0000","last_clean":"2024-09-15T22:34:57.967635+0000","last_became_active":"2024-09-15T22:09:16.402575+0000","last_became_peered":"2024-09-15T22:09:16.402575+0000","last_unstale":"2024-09-15T22:34:57.967635+0000","last_undegraded":"2024-09-15T22:34:57.967635+0000","last_fullsized":"2024-09-15T22:34:57.967635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4746","last_scrub_stamp":"2024-09-15T22:34:57.967572+0000","last_deep_scrub":"27'4746","last_deep_scrub_stamp":"2024-09-15T22:34:57.967572+0000","last_clean_scrub_stamp":"2024-09-15T22:34:57.967572+0000","objects_scrubbed":2,"log_size":4746,"log_dups_size":0,"ondisk_log_size":4746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:35.306589+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2233,"num_read_kb":5661,"num_write":4757,"num_write_kb":27314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'3833","reported_seq":3863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.166156+0000","last_change":"2024-09-15T22:09:21.457254+0000","last_active":"2024-09-15T22:34:48.166156+0000","last_peered":"2024-09-15T22:34:48.166156+0000","last_clean":"2024-09-15T22:34:48.166156+0000","last_became_active":"2024-09-15T22:09:21.456858+0000","last_became_peered":"2024-09-15T22:09:21.456858+0000","last_unstale":"2024-09-15T22:34:48.166156+0000","last_undegraded":"2024-09-15T22:34:48.166156+0000","last_fullsized":"2024-09-15T22:34:48.166156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2989,"num_write_kb":154181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'860","reported_seq":897,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.985002+0000","last_change":"2024-09-15T22:09:17.411196+0000","last_active":"2024-09-15T22:34:47.985002+0000","last_peered":"2024-09-15T22:34:47.985002+0000","last_clean":"2024-09-15T22:34:47.985002+0000","last_became_active":"2024-09-15T22:09:17.409905+0000","last_became_peered":"2024-09-15T22:09:17.409905+0000","last_unstale":"2024-09-15T22:34:47.985002+0000","last_undegraded":"2024-09-15T22:34:47.985002+0000","last_fullsized":"2024-09-15T22:34:47.985002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'3959","reported_seq":3998,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.172785+0000","last_change":"2024-09-15T22:09:16.409152+0000","last_active":"2024-09-15T22:34:48.172785+0000","last_peered":"2024-09-15T22:34:48.172785+0000","last_clean":"2024-09-15T22:34:48.172785+0000","last_became_active":"2024-09-15T22:09:16.408793+0000","last_became_peered":"2024-09-15T22:09:16.408793+0000","last_unstale":"2024-09-15T22:34:48.172785+0000","last_undegraded":"2024-09-15T22:34:48.172785+0000","last_fullsized":"2024-09-15T22:34:48.172785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3959,"log_dups_size":0,"ondisk_log_size":3959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3958,"num_write_kb":30646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'3858","reported_seq":3888,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.554207+0000","last_change":"2024-09-15T22:09:21.456804+0000","last_active":"2024-09-15T22:34:47.554207+0000","last_peered":"2024-09-15T22:34:47.554207+0000","last_clean":"2024-09-15T22:34:47.554207+0000","last_became_active":"2024-09-15T22:09:21.456416+0000","last_became_peered":"2024-09-15T22:09:21.456416+0000","last_unstale":"2024-09-15T22:34:47.554207+0000","last_undegraded":"2024-09-15T22:34:47.554207+0000","last_fullsized":"2024-09-15T22:34:47.554207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3858,"log_dups_size":0,"ondisk_log_size":3858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2949,"num_write_kb":92106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'903","reported_seq":926,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:57.915297+0000","last_change":"2024-09-15T22:09:59.531923+0000","last_active":"2024-09-15T22:34:57.915297+0000","last_peered":"2024-09-15T22:34:57.915297+0000","last_clean":"2024-09-15T22:34:57.915297+0000","last_became_active":"2024-09-15T22:09:59.531667+0000","last_became_peered":"2024-09-15T22:09:59.531667+0000","last_unstale":"2024-09-15T22:34:57.915297+0000","last_undegraded":"2024-09-15T22:34:57.915297+0000","last_fullsized":"2024-09-15T22:34:57.915297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'2199","reported_seq":2238,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.140288+0000","last_change":"2024-09-15T22:09:16.401625+0000","last_active":"2024-09-15T22:34:48.140288+0000","last_peered":"2024-09-15T22:34:48.140288+0000","last_clean":"2024-09-15T22:34:48.140288+0000","last_became_active":"2024-09-15T22:09:16.401328+0000","last_became_peered":"2024-09-15T22:09:16.401328+0000","last_unstale":"2024-09-15T22:34:48.140288+0000","last_undegraded":"2024-09-15T22:34:48.140288+0000","last_fullsized":"2024-09-15T22:34:48.140288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2199,"log_dups_size":0,"ondisk_log_size":2199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2201,"num_write_kb":17467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:33:10.149983+0000","last_change":"2024-09-15T22:09:07.243631+0000","last_active":"2024-09-15T22:33:10.149983+0000","last_peered":"2024-09-15T22:33:10.149983+0000","last_clean":"2024-09-15T22:33:10.149983+0000","last_became_active":"2024-09-15T22:09:07.243223+0000","last_became_peered":"2024-09-15T22:09:07.243223+0000","last_unstale":"2024-09-15T22:33:10.149983+0000","last_undegraded":"2024-09-15T22:33:10.149983+0000","last_fullsized":"2024-09-15T22:33:10.149983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:06.009777+0000","last_clean_scrub_stamp":"2024-09-15T22:09:06.009777+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'4430","reported_seq":4461,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.647536+0000","last_change":"2024-09-15T22:09:21.453536+0000","last_active":"2024-09-15T22:34:47.647536+0000","last_peered":"2024-09-15T22:34:47.647536+0000","last_clean":"2024-09-15T22:34:47.647536+0000","last_became_active":"2024-09-15T22:09:21.453022+0000","last_became_peered":"2024-09-15T22:09:21.453022+0000","last_unstale":"2024-09-15T22:34:47.647536+0000","last_undegraded":"2024-09-15T22:34:47.647536+0000","last_fullsized":"2024-09-15T22:34:47.647536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4430,"log_dups_size":0,"ondisk_log_size":4430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3508,"num_write_kb":155329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'902","reported_seq":943,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.991315+0000","last_change":"2024-09-15T22:09:59.534250+0000","last_active":"2024-09-15T22:34:47.991315+0000","last_peered":"2024-09-15T22:34:47.991315+0000","last_clean":"2024-09-15T22:34:47.991315+0000","last_became_active":"2024-09-15T22:09:59.533885+0000","last_became_peered":"2024-09-15T22:09:59.533885+0000","last_unstale":"2024-09-15T22:34:47.991315+0000","last_undegraded":"2024-09-15T22:34:47.991315+0000","last_fullsized":"2024-09-15T22:34:47.991315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'3375","reported_seq":3421,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.029076+0000","last_change":"2024-09-15T22:34:59.029133+0000","last_active":"2024-09-15T22:34:59.029076+0000","last_peered":"2024-09-15T22:34:59.029076+0000","last_clean":"2024-09-15T22:34:59.029076+0000","last_became_active":"2024-09-15T22:09:16.404639+0000","last_became_peered":"2024-09-15T22:09:16.404639+0000","last_unstale":"2024-09-15T22:34:59.029076+0000","last_undegraded":"2024-09-15T22:34:59.029076+0000","last_fullsized":"2024-09-15T22:34:59.029076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3375","last_scrub_stamp":"2024-09-15T22:34:59.028962+0000","last_deep_scrub":"27'3375","last_deep_scrub_stamp":"2024-09-15T22:34:59.028962+0000","last_clean_scrub_stamp":"2024-09-15T22:34:59.028962+0000","objects_scrubbed":4,"log_size":3375,"log_dups_size":0,"ondisk_log_size":3375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:01.174355+0000","scrub_duration":60,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3372,"num_write_kb":30249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'3562","reported_seq":3592,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.703561+0000","last_change":"2024-09-15T22:09:21.457352+0000","last_active":"2024-09-15T22:34:47.703561+0000","last_peered":"2024-09-15T22:34:47.703561+0000","last_clean":"2024-09-15T22:34:47.703561+0000","last_became_active":"2024-09-15T22:09:21.456906+0000","last_became_peered":"2024-09-15T22:09:21.456906+0000","last_unstale":"2024-09-15T22:34:47.703561+0000","last_undegraded":"2024-09-15T22:34:47.703561+0000","last_fullsized":"2024-09-15T22:34:47.703561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3562,"log_dups_size":0,"ondisk_log_size":3562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2654,"num_write_kb":61277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'891","reported_seq":927,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.152467+0000","last_change":"2024-09-15T22:09:17.416652+0000","last_active":"2024-09-15T22:34:48.152467+0000","last_peered":"2024-09-15T22:34:48.152467+0000","last_clean":"2024-09-15T22:34:48.152467+0000","last_became_active":"2024-09-15T22:09:17.415597+0000","last_became_peered":"2024-09-15T22:09:17.415597+0000","last_unstale":"2024-09-15T22:34:48.152467+0000","last_undegraded":"2024-09-15T22:34:48.152467+0000","last_fullsized":"2024-09-15T22:34:48.152467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'4278","reported_seq":4316,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.160137+0000","last_change":"2024-09-15T22:09:16.405689+0000","last_active":"2024-09-15T22:34:48.160137+0000","last_peered":"2024-09-15T22:34:48.160137+0000","last_clean":"2024-09-15T22:34:48.160137+0000","last_became_active":"2024-09-15T22:09:16.405433+0000","last_became_peered":"2024-09-15T22:09:16.405433+0000","last_unstale":"2024-09-15T22:34:48.160137+0000","last_undegraded":"2024-09-15T22:34:48.160137+0000","last_fullsized":"2024-09-15T22:34:48.160137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4278,"log_dups_size":0,"ondisk_log_size":4278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4278,"num_write_kb":34786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'3805","reported_seq":3842,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.177487+0000","last_change":"2024-09-15T22:09:59.534678+0000","last_active":"2024-09-15T22:34:48.177487+0000","last_peered":"2024-09-15T22:34:48.177487+0000","last_clean":"2024-09-15T22:34:48.177487+0000","last_became_active":"2024-09-15T22:09:59.534224+0000","last_became_peered":"2024-09-15T22:09:59.534224+0000","last_unstale":"2024-09-15T22:34:48.177487+0000","last_undegraded":"2024-09-15T22:34:48.177487+0000","last_fullsized":"2024-09-15T22:34:48.177487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3805,"log_dups_size":0,"ondisk_log_size":3805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2836,"num_write_kb":60139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'879","reported_seq":915,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.006458+0000","last_change":"2024-09-15T22:09:17.412910+0000","last_active":"2024-09-15T22:34:48.006458+0000","last_peered":"2024-09-15T22:34:48.006458+0000","last_clean":"2024-09-15T22:34:48.006458+0000","last_became_active":"2024-09-15T22:09:17.412079+0000","last_became_peered":"2024-09-15T22:09:17.412079+0000","last_unstale":"2024-09-15T22:34:48.006458+0000","last_undegraded":"2024-09-15T22:34:48.006458+0000","last_fullsized":"2024-09-15T22:34:48.006458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'2412","reported_seq":2458,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:00.028614+0000","last_change":"2024-09-15T22:35:00.028659+0000","last_active":"2024-09-15T22:35:00.028614+0000","last_peered":"2024-09-15T22:35:00.028614+0000","last_clean":"2024-09-15T22:35:00.028614+0000","last_became_active":"2024-09-15T22:09:16.405621+0000","last_became_peered":"2024-09-15T22:09:16.405621+0000","last_unstale":"2024-09-15T22:35:00.028614+0000","last_undegraded":"2024-09-15T22:35:00.028614+0000","last_fullsized":"2024-09-15T22:35:00.028614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2412","last_scrub_stamp":"2024-09-15T22:35:00.028543+0000","last_deep_scrub":"27'2412","last_deep_scrub_stamp":"2024-09-15T22:35:00.028543+0000","last_clean_scrub_stamp":"2024-09-15T22:35:00.028543+0000","objects_scrubbed":3,"log_size":2412,"log_dups_size":0,"ondisk_log_size":2412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:43.457891+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2412,"num_write_kb":21631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'4109","reported_seq":4139,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.176222+0000","last_change":"2024-09-15T22:09:21.449669+0000","last_active":"2024-09-15T22:34:48.176222+0000","last_peered":"2024-09-15T22:34:48.176222+0000","last_clean":"2024-09-15T22:34:48.176222+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:34:48.176222+0000","last_undegraded":"2024-09-15T22:34:48.176222+0000","last_fullsized":"2024-09-15T22:34:48.176222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4109,"log_dups_size":0,"ondisk_log_size":4109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3191,"num_write_kb":110194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'910","reported_seq":946,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.153929+0000","last_change":"2024-09-15T22:09:17.410475+0000","last_active":"2024-09-15T22:34:48.153929+0000","last_peered":"2024-09-15T22:34:48.153929+0000","last_clean":"2024-09-15T22:34:48.153929+0000","last_became_active":"2024-09-15T22:09:17.410176+0000","last_became_peered":"2024-09-15T22:09:17.410176+0000","last_unstale":"2024-09-15T22:34:48.153929+0000","last_undegraded":"2024-09-15T22:34:48.153929+0000","last_fullsized":"2024-09-15T22:34:48.153929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'1506","reported_seq":1552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.648599+0000","last_change":"2024-09-15T22:34:59.648641+0000","last_active":"2024-09-15T22:34:59.648599+0000","last_peered":"2024-09-15T22:34:59.648599+0000","last_clean":"2024-09-15T22:34:59.648599+0000","last_became_active":"2024-09-15T22:09:16.398789+0000","last_became_peered":"2024-09-15T22:09:16.398789+0000","last_unstale":"2024-09-15T22:34:59.648599+0000","last_undegraded":"2024-09-15T22:34:59.648599+0000","last_fullsized":"2024-09-15T22:34:59.648599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1506","last_scrub_stamp":"2024-09-15T22:34:59.648498+0000","last_deep_scrub":"27'1506","last_deep_scrub_stamp":"2024-09-15T22:34:59.648498+0000","last_clean_scrub_stamp":"2024-09-15T22:34:59.648498+0000","objects_scrubbed":2,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:23.497103+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1509,"num_write_kb":13058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'3700","reported_seq":3730,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.641630+0000","last_change":"2024-09-15T22:09:21.448270+0000","last_active":"2024-09-15T22:34:47.641630+0000","last_peered":"2024-09-15T22:34:47.641630+0000","last_clean":"2024-09-15T22:34:47.641630+0000","last_became_active":"2024-09-15T22:09:21.447541+0000","last_became_peered":"2024-09-15T22:09:21.447541+0000","last_unstale":"2024-09-15T22:34:47.641630+0000","last_undegraded":"2024-09-15T22:34:47.641630+0000","last_fullsized":"2024-09-15T22:34:47.641630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3700,"log_dups_size":0,"ondisk_log_size":3700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2791,"num_write_kb":90475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'922","reported_seq":958,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:00.081700+0000","last_change":"2024-09-15T22:09:17.410762+0000","last_active":"2024-09-15T22:35:00.081700+0000","last_peered":"2024-09-15T22:35:00.081700+0000","last_clean":"2024-09-15T22:35:00.081700+0000","last_became_active":"2024-09-15T22:09:17.410431+0000","last_became_peered":"2024-09-15T22:09:17.410431+0000","last_unstale":"2024-09-15T22:35:00.081700+0000","last_undegraded":"2024-09-15T22:35:00.081700+0000","last_fullsized":"2024-09-15T22:35:00.081700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'1787","reported_seq":1825,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:57.915296+0000","last_change":"2024-09-15T22:09:16.409298+0000","last_active":"2024-09-15T22:34:57.915296+0000","last_peered":"2024-09-15T22:34:57.915296+0000","last_clean":"2024-09-15T22:34:57.915296+0000","last_became_active":"2024-09-15T22:09:16.408991+0000","last_became_peered":"2024-09-15T22:09:16.408991+0000","last_unstale":"2024-09-15T22:34:57.915296+0000","last_undegraded":"2024-09-15T22:34:57.915296+0000","last_fullsized":"2024-09-15T22:34:57.915296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1787,"log_dups_size":0,"ondisk_log_size":1787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1802,"num_write_kb":13181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'3624","reported_seq":3653,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.708292+0000","last_change":"2024-09-15T22:09:21.453936+0000","last_active":"2024-09-15T22:34:47.708292+0000","last_peered":"2024-09-15T22:34:47.708292+0000","last_clean":"2024-09-15T22:34:47.708292+0000","last_became_active":"2024-09-15T22:09:21.453526+0000","last_became_peered":"2024-09-15T22:09:21.453526+0000","last_unstale":"2024-09-15T22:34:47.708292+0000","last_undegraded":"2024-09-15T22:34:47.708292+0000","last_fullsized":"2024-09-15T22:34:47.708292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2710,"num_write_kb":101760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'885","reported_seq":921,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.642065+0000","last_change":"2024-09-15T22:09:17.404617+0000","last_active":"2024-09-15T22:34:59.642065+0000","last_peered":"2024-09-15T22:34:59.642065+0000","last_clean":"2024-09-15T22:34:59.642065+0000","last_became_active":"2024-09-15T22:09:17.404310+0000","last_became_peered":"2024-09-15T22:09:17.404310+0000","last_unstale":"2024-09-15T22:34:59.642065+0000","last_undegraded":"2024-09-15T22:34:59.642065+0000","last_fullsized":"2024-09-15T22:34:59.642065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'963","reported_seq":1001,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.641962+0000","last_change":"2024-09-15T22:09:16.403439+0000","last_active":"2024-09-15T22:34:59.641962+0000","last_peered":"2024-09-15T22:34:59.641962+0000","last_clean":"2024-09-15T22:34:59.641962+0000","last_became_active":"2024-09-15T22:09:16.403137+0000","last_became_peered":"2024-09-15T22:09:16.403137+0000","last_unstale":"2024-09-15T22:34:59.641962+0000","last_undegraded":"2024-09-15T22:34:59.641962+0000","last_fullsized":"2024-09-15T22:34:59.641962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":974,"num_write_kb":8662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'3775","reported_seq":3804,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.164339+0000","last_change":"2024-09-15T22:09:21.451370+0000","last_active":"2024-09-15T22:34:48.164339+0000","last_peered":"2024-09-15T22:34:48.164339+0000","last_clean":"2024-09-15T22:34:48.164339+0000","last_became_active":"2024-09-15T22:09:21.451016+0000","last_became_peered":"2024-09-15T22:09:21.451016+0000","last_unstale":"2024-09-15T22:34:48.164339+0000","last_undegraded":"2024-09-15T22:34:48.164339+0000","last_fullsized":"2024-09-15T22:34:48.164339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2843,"num_write_kb":133663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'906","reported_seq":942,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:00.081735+0000","last_change":"2024-09-15T22:09:17.412953+0000","last_active":"2024-09-15T22:35:00.081735+0000","last_peered":"2024-09-15T22:35:00.081735+0000","last_clean":"2024-09-15T22:35:00.081735+0000","last_became_active":"2024-09-15T22:09:17.412680+0000","last_became_peered":"2024-09-15T22:09:17.412680+0000","last_unstale":"2024-09-15T22:35:00.081735+0000","last_undegraded":"2024-09-15T22:35:00.081735+0000","last_fullsized":"2024-09-15T22:35:00.081735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":906,"log_dups_size":0,"ondisk_log_size":906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'443","reported_seq":481,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.218948+0000","last_change":"2024-09-15T22:09:16.406833+0000","last_active":"2024-09-15T22:34:59.218948+0000","last_peered":"2024-09-15T22:34:59.218948+0000","last_clean":"2024-09-15T22:34:59.218948+0000","last_became_active":"2024-09-15T22:09:16.406550+0000","last_became_peered":"2024-09-15T22:09:16.406550+0000","last_unstale":"2024-09-15T22:34:59.218948+0000","last_undegraded":"2024-09-15T22:34:59.218948+0000","last_fullsized":"2024-09-15T22:34:59.218948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":462,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'4060","reported_seq":4089,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.680177+0000","last_change":"2024-09-15T22:09:21.450825+0000","last_active":"2024-09-15T22:34:47.680177+0000","last_peered":"2024-09-15T22:34:47.680177+0000","last_clean":"2024-09-15T22:34:47.680177+0000","last_became_active":"2024-09-15T22:09:21.450200+0000","last_became_peered":"2024-09-15T22:09:21.450200+0000","last_unstale":"2024-09-15T22:34:47.680177+0000","last_undegraded":"2024-09-15T22:34:47.680177+0000","last_fullsized":"2024-09-15T22:34:47.680177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4060,"log_dups_size":0,"ondisk_log_size":4060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3182,"num_write_kb":92617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'876","reported_seq":912,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:57.068048+0000","last_change":"2024-09-15T22:09:17.421088+0000","last_active":"2024-09-15T22:34:57.068048+0000","last_peered":"2024-09-15T22:34:57.068048+0000","last_clean":"2024-09-15T22:34:57.068048+0000","last_became_active":"2024-09-15T22:09:17.420802+0000","last_became_peered":"2024-09-15T22:09:17.420802+0000","last_unstale":"2024-09-15T22:34:57.068048+0000","last_undegraded":"2024-09-15T22:34:57.068048+0000","last_fullsized":"2024-09-15T22:34:57.068048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'2261","reported_seq":2307,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:58.664551+0000","last_change":"2024-09-15T22:34:58.664551+0000","last_active":"2024-09-15T22:34:58.664551+0000","last_peered":"2024-09-15T22:34:58.664551+0000","last_clean":"2024-09-15T22:34:58.664551+0000","last_became_active":"2024-09-15T22:09:16.394355+0000","last_became_peered":"2024-09-15T22:09:16.394355+0000","last_unstale":"2024-09-15T22:34:58.664551+0000","last_undegraded":"2024-09-15T22:34:58.664551+0000","last_fullsized":"2024-09-15T22:34:58.664551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2261","last_scrub_stamp":"2024-09-15T22:34:58.664448+0000","last_deep_scrub":"27'2261","last_deep_scrub_stamp":"2024-09-15T22:34:58.664448+0000","last_clean_scrub_stamp":"2024-09-15T22:34:58.664448+0000","objects_scrubbed":3,"log_size":2261,"log_dups_size":0,"ondisk_log_size":2261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:06.234732+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2267,"num_write_kb":17573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'3672","reported_seq":3701,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.657320+0000","last_change":"2024-09-15T22:09:21.454458+0000","last_active":"2024-09-15T22:34:47.657320+0000","last_peered":"2024-09-15T22:34:47.657320+0000","last_clean":"2024-09-15T22:34:47.657320+0000","last_became_active":"2024-09-15T22:09:21.453992+0000","last_became_peered":"2024-09-15T22:09:21.453992+0000","last_unstale":"2024-09-15T22:34:47.657320+0000","last_undegraded":"2024-09-15T22:34:47.657320+0000","last_fullsized":"2024-09-15T22:34:47.657320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3672,"log_dups_size":0,"ondisk_log_size":3672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2764,"num_write_kb":64906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'863","reported_seq":898,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.982165+0000","last_change":"2024-09-15T22:09:17.404161+0000","last_active":"2024-09-15T22:34:47.982165+0000","last_peered":"2024-09-15T22:34:47.982165+0000","last_clean":"2024-09-15T22:34:47.982165+0000","last_became_active":"2024-09-15T22:09:17.403899+0000","last_became_peered":"2024-09-15T22:09:17.403899+0000","last_unstale":"2024-09-15T22:34:47.982165+0000","last_undegraded":"2024-09-15T22:34:47.982165+0000","last_fullsized":"2024-09-15T22:34:47.982165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'3996","reported_seq":4034,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.642115+0000","last_change":"2024-09-15T22:09:16.403905+0000","last_active":"2024-09-15T22:34:59.642115+0000","last_peered":"2024-09-15T22:34:59.642115+0000","last_clean":"2024-09-15T22:34:59.642115+0000","last_became_active":"2024-09-15T22:09:16.403624+0000","last_became_peered":"2024-09-15T22:09:16.403624+0000","last_unstale":"2024-09-15T22:34:59.642115+0000","last_undegraded":"2024-09-15T22:34:59.642115+0000","last_fullsized":"2024-09-15T22:34:59.642115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3999,"num_write_kb":30696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'3842","reported_seq":3871,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.173323+0000","last_change":"2024-09-15T22:09:21.452045+0000","last_active":"2024-09-15T22:34:48.173323+0000","last_peered":"2024-09-15T22:34:48.173323+0000","last_clean":"2024-09-15T22:34:48.173323+0000","last_became_active":"2024-09-15T22:09:21.451617+0000","last_became_peered":"2024-09-15T22:09:21.451617+0000","last_unstale":"2024-09-15T22:34:48.173323+0000","last_undegraded":"2024-09-15T22:34:48.173323+0000","last_fullsized":"2024-09-15T22:34:48.173323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3842,"log_dups_size":0,"ondisk_log_size":3842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2980,"num_write_kb":152763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'896","reported_seq":932,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:58.778731+0000","last_change":"2024-09-15T22:09:17.399198+0000","last_active":"2024-09-15T22:34:58.778731+0000","last_peered":"2024-09-15T22:34:58.778731+0000","last_clean":"2024-09-15T22:34:58.778731+0000","last_became_active":"2024-09-15T22:09:17.398881+0000","last_became_peered":"2024-09-15T22:09:17.398881+0000","last_unstale":"2024-09-15T22:34:58.778731+0000","last_undegraded":"2024-09-15T22:34:58.778731+0000","last_fullsized":"2024-09-15T22:34:58.778731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'4322","reported_seq":4359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.181695+0000","last_change":"2024-09-15T22:09:16.408365+0000","last_active":"2024-09-15T22:34:48.181695+0000","last_peered":"2024-09-15T22:34:48.181695+0000","last_clean":"2024-09-15T22:34:48.181695+0000","last_became_active":"2024-09-15T22:09:16.408064+0000","last_became_peered":"2024-09-15T22:09:16.408064+0000","last_unstale":"2024-09-15T22:34:48.181695+0000","last_undegraded":"2024-09-15T22:34:48.181695+0000","last_fullsized":"2024-09-15T22:34:48.181695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4322,"log_dups_size":0,"ondisk_log_size":4322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4321,"num_write_kb":23285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'4245","reported_seq":4274,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.171284+0000","last_change":"2024-09-15T22:09:21.455334+0000","last_active":"2024-09-15T22:34:48.171284+0000","last_peered":"2024-09-15T22:34:48.171284+0000","last_clean":"2024-09-15T22:34:48.171284+0000","last_became_active":"2024-09-15T22:09:21.454907+0000","last_became_peered":"2024-09-15T22:09:21.454907+0000","last_unstale":"2024-09-15T22:34:48.171284+0000","last_undegraded":"2024-09-15T22:34:48.171284+0000","last_fullsized":"2024-09-15T22:34:48.171284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4245,"log_dups_size":0,"ondisk_log_size":4245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3329,"num_write_kb":357256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'888","reported_seq":923,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.157090+0000","last_change":"2024-09-15T22:09:17.415215+0000","last_active":"2024-09-15T22:34:48.157090+0000","last_peered":"2024-09-15T22:34:48.157090+0000","last_clean":"2024-09-15T22:34:48.157090+0000","last_became_active":"2024-09-15T22:09:17.414951+0000","last_became_peered":"2024-09-15T22:09:17.414951+0000","last_unstale":"2024-09-15T22:34:48.157090+0000","last_undegraded":"2024-09-15T22:34:48.157090+0000","last_fullsized":"2024-09-15T22:34:48.157090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3258","reported_seq":3295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.145859+0000","last_change":"2024-09-15T22:09:16.405521+0000","last_active":"2024-09-15T22:34:48.145859+0000","last_peered":"2024-09-15T22:34:48.145859+0000","last_clean":"2024-09-15T22:34:48.145859+0000","last_became_active":"2024-09-15T22:09:16.405230+0000","last_became_peered":"2024-09-15T22:09:16.405230+0000","last_unstale":"2024-09-15T22:34:48.145859+0000","last_undegraded":"2024-09-15T22:34:48.145859+0000","last_fullsized":"2024-09-15T22:34:48.145859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":3258,"log_dups_size":0,"ondisk_log_size":3258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3257,"num_write_kb":26116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'3612","reported_seq":3641,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.653357+0000","last_change":"2024-09-15T22:09:21.450431+0000","last_active":"2024-09-15T22:34:47.653357+0000","last_peered":"2024-09-15T22:34:47.653357+0000","last_clean":"2024-09-15T22:34:47.653357+0000","last_became_active":"2024-09-15T22:09:21.449896+0000","last_became_peered":"2024-09-15T22:09:21.449896+0000","last_unstale":"2024-09-15T22:34:47.653357+0000","last_undegraded":"2024-09-15T22:34:47.653357+0000","last_fullsized":"2024-09-15T22:34:47.653357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3612,"log_dups_size":0,"ondisk_log_size":3612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2735,"num_write_kb":71213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'873","reported_seq":908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.003753+0000","last_change":"2024-09-15T22:09:17.422669+0000","last_active":"2024-09-15T22:34:48.003753+0000","last_peered":"2024-09-15T22:34:48.003753+0000","last_clean":"2024-09-15T22:34:48.003753+0000","last_became_active":"2024-09-15T22:09:17.422401+0000","last_became_peered":"2024-09-15T22:09:17.422401+0000","last_unstale":"2024-09-15T22:34:48.003753+0000","last_undegraded":"2024-09-15T22:34:48.003753+0000","last_fullsized":"2024-09-15T22:34:48.003753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2844","reported_seq":3577,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.156929+0000","last_change":"2024-09-15T22:09:16.405552+0000","last_active":"2024-09-15T22:34:48.156929+0000","last_peered":"2024-09-15T22:34:48.156929+0000","last_clean":"2024-09-15T22:34:48.156929+0000","last_became_active":"2024-09-15T22:09:16.405208+0000","last_became_peered":"2024-09-15T22:09:16.405208+0000","last_unstale":"2024-09-15T22:34:48.156929+0000","last_undegraded":"2024-09-15T22:34:48.156929+0000","last_fullsized":"2024-09-15T22:34:48.156929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2844,"log_dups_size":0,"ondisk_log_size":2844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18685136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":696,"num_read_kb":2335,"num_write":2846,"num_write_kb":23873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'3807","reported_seq":3836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.674247+0000","last_change":"2024-09-15T22:09:21.448849+0000","last_active":"2024-09-15T22:34:47.674247+0000","last_peered":"2024-09-15T22:34:47.674247+0000","last_clean":"2024-09-15T22:34:47.674247+0000","last_became_active":"2024-09-15T22:09:21.448356+0000","last_became_peered":"2024-09-15T22:09:21.448356+0000","last_unstale":"2024-09-15T22:34:47.674247+0000","last_undegraded":"2024-09-15T22:34:47.674247+0000","last_fullsized":"2024-09-15T22:34:47.674247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3807,"log_dups_size":0,"ondisk_log_size":3807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2897,"num_write_kb":187512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'3625","reported_seq":3656,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.161778+0000","last_change":"2024-09-15T22:09:21.458815+0000","last_active":"2024-09-15T22:34:48.161778+0000","last_peered":"2024-09-15T22:34:48.161778+0000","last_clean":"2024-09-15T22:34:48.161778+0000","last_became_active":"2024-09-15T22:09:21.458418+0000","last_became_peered":"2024-09-15T22:09:21.458418+0000","last_unstale":"2024-09-15T22:34:48.161778+0000","last_undegraded":"2024-09-15T22:34:48.161778+0000","last_fullsized":"2024-09-15T22:34:48.161778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2737,"num_write_kb":87535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'902","reported_seq":945,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:58.744505+0000","last_change":"2024-09-15T22:34:58.744529+0000","last_active":"2024-09-15T22:34:58.744505+0000","last_peered":"2024-09-15T22:34:58.744505+0000","last_clean":"2024-09-15T22:34:58.744505+0000","last_became_active":"2024-09-15T22:09:17.400754+0000","last_became_peered":"2024-09-15T22:09:17.400754+0000","last_unstale":"2024-09-15T22:34:58.744505+0000","last_undegraded":"2024-09-15T22:34:58.744505+0000","last_fullsized":"2024-09-15T22:34:58.744505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'902","last_scrub_stamp":"2024-09-15T22:34:58.744440+0000","last_deep_scrub":"27'902","last_deep_scrub_stamp":"2024-09-15T22:34:58.744440+0000","last_clean_scrub_stamp":"2024-09-15T22:34:58.744440+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:53.025149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'4403","reported_seq":4440,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.159403+0000","last_change":"2024-09-15T22:09:16.404987+0000","last_active":"2024-09-15T22:34:48.159403+0000","last_peered":"2024-09-15T22:34:48.159403+0000","last_clean":"2024-09-15T22:34:48.159403+0000","last_became_active":"2024-09-15T22:09:16.404694+0000","last_became_peered":"2024-09-15T22:09:16.404694+0000","last_unstale":"2024-09-15T22:34:48.159403+0000","last_undegraded":"2024-09-15T22:34:48.159403+0000","last_fullsized":"2024-09-15T22:34:48.159403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4404,"num_write_kb":39122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'4168","reported_seq":4199,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.653535+0000","last_change":"2024-09-15T22:09:21.457334+0000","last_active":"2024-09-15T22:34:47.653535+0000","last_peered":"2024-09-15T22:34:47.653535+0000","last_clean":"2024-09-15T22:34:47.653535+0000","last_became_active":"2024-09-15T22:09:21.456871+0000","last_became_peered":"2024-09-15T22:09:21.456871+0000","last_unstale":"2024-09-15T22:34:47.653535+0000","last_undegraded":"2024-09-15T22:34:47.653535+0000","last_fullsized":"2024-09-15T22:34:47.653535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":4168,"log_dups_size":0,"ondisk_log_size":4168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3293,"num_write_kb":221802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'944","reported_seq":979,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.982821+0000","last_change":"2024-09-15T22:09:17.402872+0000","last_active":"2024-09-15T22:34:47.982821+0000","last_peered":"2024-09-15T22:34:47.982821+0000","last_clean":"2024-09-15T22:34:47.982821+0000","last_became_active":"2024-09-15T22:09:17.402625+0000","last_became_peered":"2024-09-15T22:09:17.402625+0000","last_unstale":"2024-09-15T22:34:47.982821+0000","last_undegraded":"2024-09-15T22:34:47.982821+0000","last_fullsized":"2024-09-15T22:34:47.982821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":944,"log_dups_size":0,"ondisk_log_size":944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'2057","reported_seq":2094,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.155024+0000","last_change":"2024-09-15T22:09:16.405821+0000","last_active":"2024-09-15T22:34:48.155024+0000","last_peered":"2024-09-15T22:34:48.155024+0000","last_clean":"2024-09-15T22:34:48.155024+0000","last_became_active":"2024-09-15T22:09:16.405561+0000","last_became_peered":"2024-09-15T22:09:16.405561+0000","last_unstale":"2024-09-15T22:34:48.155024+0000","last_undegraded":"2024-09-15T22:34:48.155024+0000","last_fullsized":"2024-09-15T22:34:48.155024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":2057,"log_dups_size":0,"ondisk_log_size":2057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2062,"num_write_kb":17437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4668","reported_seq":4713,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:00.104469+0000","last_change":"2024-09-15T22:35:00.104511+0000","last_active":"2024-09-15T22:35:00.104469+0000","last_peered":"2024-09-15T22:35:00.104469+0000","last_clean":"2024-09-15T22:35:00.104469+0000","last_became_active":"2024-09-15T22:09:16.403172+0000","last_became_peered":"2024-09-15T22:09:16.403172+0000","last_unstale":"2024-09-15T22:35:00.104469+0000","last_undegraded":"2024-09-15T22:35:00.104469+0000","last_fullsized":"2024-09-15T22:35:00.104469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4668","last_scrub_stamp":"2024-09-15T22:35:00.104378+0000","last_deep_scrub":"27'4668","last_deep_scrub_stamp":"2024-09-15T22:35:00.104378+0000","last_clean_scrub_stamp":"2024-09-15T22:35:00.104378+0000","objects_scrubbed":1,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:23.952982+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4675,"num_write_kb":35111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'885","reported_seq":920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.985369+0000","last_change":"2024-09-15T22:09:17.416335+0000","last_active":"2024-09-15T22:34:47.985369+0000","last_peered":"2024-09-15T22:34:47.985369+0000","last_clean":"2024-09-15T22:34:47.985369+0000","last_became_active":"2024-09-15T22:09:17.416102+0000","last_became_peered":"2024-09-15T22:09:17.416102+0000","last_unstale":"2024-09-15T22:34:47.985369+0000","last_undegraded":"2024-09-15T22:34:47.985369+0000","last_fullsized":"2024-09-15T22:34:47.985369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3664","reported_seq":3693,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.712087+0000","last_change":"2024-09-15T22:09:21.448449+0000","last_active":"2024-09-15T22:34:47.712087+0000","last_peered":"2024-09-15T22:34:47.712087+0000","last_clean":"2024-09-15T22:34:47.712087+0000","last_became_active":"2024-09-15T22:09:21.448020+0000","last_became_peered":"2024-09-15T22:09:21.448020+0000","last_unstale":"2024-09-15T22:34:47.712087+0000","last_undegraded":"2024-09-15T22:34:47.712087+0000","last_fullsized":"2024-09-15T22:34:47.712087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3664,"log_dups_size":0,"ondisk_log_size":3664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2728,"num_write_kb":145400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1987","reported_seq":2024,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.135897+0000","last_change":"2024-09-15T22:09:16.401331+0000","last_active":"2024-09-15T22:34:48.135897+0000","last_peered":"2024-09-15T22:34:48.135897+0000","last_clean":"2024-09-15T22:34:48.135897+0000","last_became_active":"2024-09-15T22:09:16.401040+0000","last_became_peered":"2024-09-15T22:09:16.401040+0000","last_unstale":"2024-09-15T22:34:48.135897+0000","last_undegraded":"2024-09-15T22:34:48.135897+0000","last_fullsized":"2024-09-15T22:34:48.135897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:15.376659+0000","last_clean_scrub_stamp":"2024-09-15T22:09:15.376659+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1992,"num_write_kb":17367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'895","reported_seq":930,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.161585+0000","last_change":"2024-09-15T22:09:17.405328+0000","last_active":"2024-09-15T22:34:48.161585+0000","last_peered":"2024-09-15T22:34:48.161585+0000","last_clean":"2024-09-15T22:34:48.161585+0000","last_became_active":"2024-09-15T22:09:17.404772+0000","last_became_peered":"2024-09-15T22:09:17.404772+0000","last_unstale":"2024-09-15T22:34:48.161585+0000","last_undegraded":"2024-09-15T22:34:48.161585+0000","last_fullsized":"2024-09-15T22:34:48.161585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3687","reported_seq":3716,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.161552+0000","last_change":"2024-09-15T22:09:21.458359+0000","last_active":"2024-09-15T22:34:48.161552+0000","last_peered":"2024-09-15T22:34:48.161552+0000","last_clean":"2024-09-15T22:34:48.161552+0000","last_became_active":"2024-09-15T22:09:21.457977+0000","last_became_peered":"2024-09-15T22:09:21.457977+0000","last_unstale":"2024-09-15T22:34:48.161552+0000","last_undegraded":"2024-09-15T22:34:48.161552+0000","last_fullsized":"2024-09-15T22:34:48.161552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:20.418600+0000","last_clean_scrub_stamp":"2024-09-15T22:09:20.418600+0000","objects_scrubbed":0,"log_size":3687,"log_dups_size":0,"ondisk_log_size":3687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2724,"num_write_kb":59138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'900","reported_seq":937,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.169624+0000","last_change":"2024-09-15T22:09:17.405556+0000","last_active":"2024-09-15T22:34:48.169624+0000","last_peered":"2024-09-15T22:34:48.169624+0000","last_clean":"2024-09-15T22:34:48.169624+0000","last_became_active":"2024-09-15T22:09:17.405129+0000","last_became_peered":"2024-09-15T22:09:17.405129+0000","last_unstale":"2024-09-15T22:34:48.169624+0000","last_undegraded":"2024-09-15T22:34:48.169624+0000","last_fullsized":"2024-09-15T22:34:48.169624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'940","reported_seq":977,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.003435+0000","last_change":"2024-09-15T22:09:17.408189+0000","last_active":"2024-09-15T22:34:48.003435+0000","last_peered":"2024-09-15T22:34:48.003435+0000","last_clean":"2024-09-15T22:34:48.003435+0000","last_became_active":"2024-09-15T22:09:17.407877+0000","last_became_peered":"2024-09-15T22:09:17.407877+0000","last_unstale":"2024-09-15T22:34:48.003435+0000","last_undegraded":"2024-09-15T22:34:48.003435+0000","last_fullsized":"2024-09-15T22:34:48.003435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":940,"log_dups_size":0,"ondisk_log_size":940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'881","reported_seq":923,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.004298+0000","last_change":"2024-09-15T22:09:59.534711+0000","last_active":"2024-09-15T22:34:48.004298+0000","last_peered":"2024-09-15T22:34:48.004298+0000","last_clean":"2024-09-15T22:34:48.004298+0000","last_became_active":"2024-09-15T22:09:59.534380+0000","last_became_peered":"2024-09-15T22:09:59.534380+0000","last_unstale":"2024-09-15T22:34:48.004298+0000","last_undegraded":"2024-09-15T22:34:48.004298+0000","last_fullsized":"2024-09-15T22:34:48.004298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'916","reported_seq":953,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.155748+0000","last_change":"2024-09-15T22:09:17.406140+0000","last_active":"2024-09-15T22:34:48.155748+0000","last_peered":"2024-09-15T22:34:48.155748+0000","last_clean":"2024-09-15T22:34:48.155748+0000","last_became_active":"2024-09-15T22:09:17.405142+0000","last_became_peered":"2024-09-15T22:09:17.405142+0000","last_unstale":"2024-09-15T22:34:48.155748+0000","last_undegraded":"2024-09-15T22:34:48.155748+0000","last_fullsized":"2024-09-15T22:34:48.155748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":916,"log_dups_size":0,"ondisk_log_size":916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'885","reported_seq":929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:58.410883+0000","last_change":"2024-09-15T22:34:58.410929+0000","last_active":"2024-09-15T22:34:58.410883+0000","last_peered":"2024-09-15T22:34:58.410883+0000","last_clean":"2024-09-15T22:34:58.410883+0000","last_became_active":"2024-09-15T22:09:17.408913+0000","last_became_peered":"2024-09-15T22:09:17.408913+0000","last_unstale":"2024-09-15T22:34:58.410883+0000","last_undegraded":"2024-09-15T22:34:58.410883+0000","last_fullsized":"2024-09-15T22:34:58.410883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'885","last_scrub_stamp":"2024-09-15T22:34:58.410806+0000","last_deep_scrub":"27'885","last_deep_scrub_stamp":"2024-09-15T22:34:58.410806+0000","last_clean_scrub_stamp":"2024-09-15T22:34:58.410806+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:20.551123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'886","reported_seq":930,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:57.759309+0000","last_change":"2024-09-15T22:34:57.759329+0000","last_active":"2024-09-15T22:34:57.759309+0000","last_peered":"2024-09-15T22:34:57.759309+0000","last_clean":"2024-09-15T22:34:57.759309+0000","last_became_active":"2024-09-15T22:09:17.400916+0000","last_became_peered":"2024-09-15T22:09:17.400916+0000","last_unstale":"2024-09-15T22:34:57.759309+0000","last_undegraded":"2024-09-15T22:34:57.759309+0000","last_fullsized":"2024-09-15T22:34:57.759309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'886","last_scrub_stamp":"2024-09-15T22:34:57.759238+0000","last_deep_scrub":"27'886","last_deep_scrub_stamp":"2024-09-15T22:34:57.759238+0000","last_clean_scrub_stamp":"2024-09-15T22:34:57.759238+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:54.306163+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'934","reported_seq":970,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.003935+0000","last_change":"2024-09-15T22:09:17.405622+0000","last_active":"2024-09-15T22:34:48.003935+0000","last_peered":"2024-09-15T22:34:48.003935+0000","last_clean":"2024-09-15T22:34:48.003935+0000","last_became_active":"2024-09-15T22:09:17.405319+0000","last_became_peered":"2024-09-15T22:09:17.405319+0000","last_unstale":"2024-09-15T22:34:48.003935+0000","last_undegraded":"2024-09-15T22:34:48.003935+0000","last_fullsized":"2024-09-15T22:34:48.003935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'869","reported_seq":905,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.158436+0000","last_change":"2024-09-15T22:09:17.409317+0000","last_active":"2024-09-15T22:34:48.158436+0000","last_peered":"2024-09-15T22:34:48.158436+0000","last_clean":"2024-09-15T22:34:48.158436+0000","last_became_active":"2024-09-15T22:09:17.408949+0000","last_became_peered":"2024-09-15T22:09:17.408949+0000","last_unstale":"2024-09-15T22:34:48.158436+0000","last_undegraded":"2024-09-15T22:34:48.158436+0000","last_fullsized":"2024-09-15T22:34:48.158436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'872","reported_seq":908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.167705+0000","last_change":"2024-09-15T22:09:17.416439+0000","last_active":"2024-09-15T22:34:48.167705+0000","last_peered":"2024-09-15T22:34:48.167705+0000","last_clean":"2024-09-15T22:34:48.167705+0000","last_became_active":"2024-09-15T22:09:17.416170+0000","last_became_peered":"2024-09-15T22:09:17.416170+0000","last_unstale":"2024-09-15T22:34:48.167705+0000","last_undegraded":"2024-09-15T22:34:48.167705+0000","last_fullsized":"2024-09-15T22:34:48.167705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'867","reported_seq":911,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.449001+0000","last_change":"2024-09-15T22:34:59.449025+0000","last_active":"2024-09-15T22:34:59.449001+0000","last_peered":"2024-09-15T22:34:59.449001+0000","last_clean":"2024-09-15T22:34:59.449001+0000","last_became_active":"2024-09-15T22:09:17.408969+0000","last_became_peered":"2024-09-15T22:09:17.408969+0000","last_unstale":"2024-09-15T22:34:59.449001+0000","last_undegraded":"2024-09-15T22:34:59.449001+0000","last_fullsized":"2024-09-15T22:34:59.449001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'867","last_scrub_stamp":"2024-09-15T22:34:59.448933+0000","last_deep_scrub":"27'867","last_deep_scrub_stamp":"2024-09-15T22:34:59.448933+0000","last_clean_scrub_stamp":"2024-09-15T22:34:59.448933+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:15.000873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'894","reported_seq":930,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.007020+0000","last_change":"2024-09-15T22:09:17.422118+0000","last_active":"2024-09-15T22:34:48.007020+0000","last_peered":"2024-09-15T22:34:48.007020+0000","last_clean":"2024-09-15T22:34:48.007020+0000","last_became_active":"2024-09-15T22:09:17.421846+0000","last_became_peered":"2024-09-15T22:09:17.421846+0000","last_unstale":"2024-09-15T22:34:48.007020+0000","last_undegraded":"2024-09-15T22:34:48.007020+0000","last_fullsized":"2024-09-15T22:34:48.007020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'909","reported_seq":945,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.997415+0000","last_change":"2024-09-15T22:09:17.421168+0000","last_active":"2024-09-15T22:34:47.997415+0000","last_peered":"2024-09-15T22:34:47.997415+0000","last_clean":"2024-09-15T22:34:47.997415+0000","last_became_active":"2024-09-15T22:09:17.420849+0000","last_became_peered":"2024-09-15T22:09:17.420849+0000","last_unstale":"2024-09-15T22:34:47.997415+0000","last_undegraded":"2024-09-15T22:34:47.997415+0000","last_fullsized":"2024-09-15T22:34:47.997415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'894","reported_seq":930,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.001998+0000","last_change":"2024-09-15T22:09:17.410112+0000","last_active":"2024-09-15T22:34:48.001998+0000","last_peered":"2024-09-15T22:34:48.001998+0000","last_clean":"2024-09-15T22:34:48.001998+0000","last_became_active":"2024-09-15T22:09:17.409837+0000","last_became_peered":"2024-09-15T22:09:17.409837+0000","last_unstale":"2024-09-15T22:34:48.001998+0000","last_undegraded":"2024-09-15T22:34:48.001998+0000","last_fullsized":"2024-09-15T22:34:48.001998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'901","reported_seq":923,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:49.094505+0000","last_change":"2024-09-15T22:09:59.534976+0000","last_active":"2024-09-15T22:34:49.094505+0000","last_peered":"2024-09-15T22:34:49.094505+0000","last_clean":"2024-09-15T22:34:49.094505+0000","last_became_active":"2024-09-15T22:09:59.534485+0000","last_became_peered":"2024-09-15T22:09:59.534485+0000","last_unstale":"2024-09-15T22:34:49.094505+0000","last_undegraded":"2024-09-15T22:34:49.094505+0000","last_fullsized":"2024-09-15T22:34:49.094505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"27'851","reported_seq":887,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:57.915370+0000","last_change":"2024-09-15T22:09:17.401680+0000","last_active":"2024-09-15T22:34:57.915370+0000","last_peered":"2024-09-15T22:34:57.915370+0000","last_clean":"2024-09-15T22:34:57.915370+0000","last_became_active":"2024-09-15T22:09:17.401413+0000","last_became_peered":"2024-09-15T22:09:17.401413+0000","last_unstale":"2024-09-15T22:34:57.915370+0000","last_undegraded":"2024-09-15T22:34:57.915370+0000","last_fullsized":"2024-09-15T22:34:57.915370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'922","reported_seq":943,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.969013+0000","last_change":"2024-09-15T22:09:59.528330+0000","last_active":"2024-09-15T22:34:47.969013+0000","last_peered":"2024-09-15T22:34:47.969013+0000","last_clean":"2024-09-15T22:34:47.969013+0000","last_became_active":"2024-09-15T22:09:59.528000+0000","last_became_peered":"2024-09-15T22:09:59.528000+0000","last_unstale":"2024-09-15T22:34:47.969013+0000","last_undegraded":"2024-09-15T22:34:47.969013+0000","last_fullsized":"2024-09-15T22:34:47.969013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"27'882","reported_seq":918,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.219100+0000","last_change":"2024-09-15T22:09:17.411524+0000","last_active":"2024-09-15T22:34:59.219100+0000","last_peered":"2024-09-15T22:34:59.219100+0000","last_clean":"2024-09-15T22:34:59.219100+0000","last_became_active":"2024-09-15T22:09:17.411244+0000","last_became_peered":"2024-09-15T22:09:17.411244+0000","last_unstale":"2024-09-15T22:34:59.219100+0000","last_undegraded":"2024-09-15T22:34:59.219100+0000","last_fullsized":"2024-09-15T22:34:59.219100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'910","reported_seq":946,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:57.491792+0000","last_change":"2024-09-15T22:09:17.409933+0000","last_active":"2024-09-15T22:34:57.491792+0000","last_peered":"2024-09-15T22:34:57.491792+0000","last_clean":"2024-09-15T22:34:57.491792+0000","last_became_active":"2024-09-15T22:09:17.409681+0000","last_became_peered":"2024-09-15T22:09:17.409681+0000","last_unstale":"2024-09-15T22:34:57.491792+0000","last_undegraded":"2024-09-15T22:34:57.491792+0000","last_fullsized":"2024-09-15T22:34:57.491792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'858","reported_seq":894,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:57.068210+0000","last_change":"2024-09-15T22:09:17.403522+0000","last_active":"2024-09-15T22:34:57.068210+0000","last_peered":"2024-09-15T22:34:57.068210+0000","last_clean":"2024-09-15T22:34:57.068210+0000","last_became_active":"2024-09-15T22:09:17.403220+0000","last_became_peered":"2024-09-15T22:09:17.403220+0000","last_unstale":"2024-09-15T22:34:57.068210+0000","last_undegraded":"2024-09-15T22:34:57.068210+0000","last_fullsized":"2024-09-15T22:34:57.068210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'870","reported_seq":905,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.155347+0000","last_change":"2024-09-15T22:09:17.400537+0000","last_active":"2024-09-15T22:34:48.155347+0000","last_peered":"2024-09-15T22:34:48.155347+0000","last_clean":"2024-09-15T22:34:48.155347+0000","last_became_active":"2024-09-15T22:09:17.400288+0000","last_became_peered":"2024-09-15T22:09:17.400288+0000","last_unstale":"2024-09-15T22:34:48.155347+0000","last_undegraded":"2024-09-15T22:34:48.155347+0000","last_fullsized":"2024-09-15T22:34:48.155347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'857","reported_seq":892,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.984648+0000","last_change":"2024-09-15T22:09:17.404318+0000","last_active":"2024-09-15T22:34:47.984648+0000","last_peered":"2024-09-15T22:34:47.984648+0000","last_clean":"2024-09-15T22:34:47.984648+0000","last_became_active":"2024-09-15T22:09:17.404038+0000","last_became_peered":"2024-09-15T22:09:17.404038+0000","last_unstale":"2024-09-15T22:34:47.984648+0000","last_undegraded":"2024-09-15T22:34:47.984648+0000","last_fullsized":"2024-09-15T22:34:47.984648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'885","reported_seq":920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.005576+0000","last_change":"2024-09-15T22:09:17.415645+0000","last_active":"2024-09-15T22:34:48.005576+0000","last_peered":"2024-09-15T22:34:48.005576+0000","last_clean":"2024-09-15T22:34:48.005576+0000","last_became_active":"2024-09-15T22:09:17.415354+0000","last_became_peered":"2024-09-15T22:09:17.415354+0000","last_unstale":"2024-09-15T22:34:48.005576+0000","last_undegraded":"2024-09-15T22:34:48.005576+0000","last_fullsized":"2024-09-15T22:34:48.005576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'874","reported_seq":909,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.005698+0000","last_change":"2024-09-15T22:09:17.415171+0000","last_active":"2024-09-15T22:34:48.005698+0000","last_peered":"2024-09-15T22:34:48.005698+0000","last_clean":"2024-09-15T22:34:48.005698+0000","last_became_active":"2024-09-15T22:09:17.414875+0000","last_became_peered":"2024-09-15T22:09:17.414875+0000","last_unstale":"2024-09-15T22:34:48.005698+0000","last_undegraded":"2024-09-15T22:34:48.005698+0000","last_fullsized":"2024-09-15T22:34:48.005698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'913","reported_seq":948,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.006585+0000","last_change":"2024-09-15T22:09:17.420121+0000","last_active":"2024-09-15T22:34:48.006585+0000","last_peered":"2024-09-15T22:34:48.006585+0000","last_clean":"2024-09-15T22:34:48.006585+0000","last_became_active":"2024-09-15T22:09:17.419854+0000","last_became_peered":"2024-09-15T22:09:17.419854+0000","last_unstale":"2024-09-15T22:34:48.006585+0000","last_undegraded":"2024-09-15T22:34:48.006585+0000","last_fullsized":"2024-09-15T22:34:48.006585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":913,"log_dups_size":0,"ondisk_log_size":913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'862","reported_seq":897,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.992415+0000","last_change":"2024-09-15T22:09:17.414316+0000","last_active":"2024-09-15T22:34:47.992415+0000","last_peered":"2024-09-15T22:34:47.992415+0000","last_clean":"2024-09-15T22:34:47.992415+0000","last_became_active":"2024-09-15T22:09:17.414020+0000","last_became_peered":"2024-09-15T22:09:17.414020+0000","last_unstale":"2024-09-15T22:34:47.992415+0000","last_undegraded":"2024-09-15T22:34:47.992415+0000","last_fullsized":"2024-09-15T22:34:47.992415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'898","reported_seq":933,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.979789+0000","last_change":"2024-09-15T22:09:17.404509+0000","last_active":"2024-09-15T22:34:47.979789+0000","last_peered":"2024-09-15T22:34:47.979789+0000","last_clean":"2024-09-15T22:34:47.979789+0000","last_became_active":"2024-09-15T22:09:17.404181+0000","last_became_peered":"2024-09-15T22:09:17.404181+0000","last_unstale":"2024-09-15T22:34:47.979789+0000","last_undegraded":"2024-09-15T22:34:47.979789+0000","last_fullsized":"2024-09-15T22:34:47.979789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'835","reported_seq":870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.163292+0000","last_change":"2024-09-15T22:09:17.414252+0000","last_active":"2024-09-15T22:34:48.163292+0000","last_peered":"2024-09-15T22:34:48.163292+0000","last_clean":"2024-09-15T22:34:48.163292+0000","last_became_active":"2024-09-15T22:09:17.413987+0000","last_became_peered":"2024-09-15T22:09:17.413987+0000","last_unstale":"2024-09-15T22:34:48.163292+0000","last_undegraded":"2024-09-15T22:34:48.163292+0000","last_fullsized":"2024-09-15T22:34:48.163292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'918","reported_seq":953,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.168400+0000","last_change":"2024-09-15T22:09:17.399744+0000","last_active":"2024-09-15T22:34:48.168400+0000","last_peered":"2024-09-15T22:34:48.168400+0000","last_clean":"2024-09-15T22:34:48.168400+0000","last_became_active":"2024-09-15T22:09:17.399470+0000","last_became_peered":"2024-09-15T22:09:17.399470+0000","last_unstale":"2024-09-15T22:34:48.168400+0000","last_undegraded":"2024-09-15T22:34:48.168400+0000","last_fullsized":"2024-09-15T22:34:48.168400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'877","reported_seq":900,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.974155+0000","last_change":"2024-09-15T22:09:59.804042+0000","last_active":"2024-09-15T22:34:47.974155+0000","last_peered":"2024-09-15T22:34:47.974155+0000","last_clean":"2024-09-15T22:34:47.974155+0000","last_became_active":"2024-09-15T22:09:59.803657+0000","last_became_peered":"2024-09-15T22:09:59.803657+0000","last_unstale":"2024-09-15T22:34:47.974155+0000","last_undegraded":"2024-09-15T22:34:47.974155+0000","last_fullsized":"2024-09-15T22:34:47.974155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'928","reported_seq":965,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.154494+0000","last_change":"2024-09-15T22:09:17.404558+0000","last_active":"2024-09-15T22:34:48.154494+0000","last_peered":"2024-09-15T22:34:48.154494+0000","last_clean":"2024-09-15T22:34:48.154494+0000","last_became_active":"2024-09-15T22:09:17.404301+0000","last_became_peered":"2024-09-15T22:09:17.404301+0000","last_unstale":"2024-09-15T22:34:48.154494+0000","last_undegraded":"2024-09-15T22:34:48.154494+0000","last_fullsized":"2024-09-15T22:34:48.154494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'838","reported_seq":875,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:47.968754+0000","last_change":"2024-09-15T22:09:17.402881+0000","last_active":"2024-09-15T22:34:47.968754+0000","last_peered":"2024-09-15T22:34:47.968754+0000","last_clean":"2024-09-15T22:34:47.968754+0000","last_became_active":"2024-09-15T22:09:17.402632+0000","last_became_peered":"2024-09-15T22:09:17.402632+0000","last_unstale":"2024-09-15T22:34:47.968754+0000","last_undegraded":"2024-09-15T22:34:47.968754+0000","last_fullsized":"2024-09-15T22:34:47.968754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'834","reported_seq":871,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:48.002449+0000","last_change":"2024-09-15T22:09:17.403017+0000","last_active":"2024-09-15T22:34:48.002449+0000","last_peered":"2024-09-15T22:34:48.002449+0000","last_clean":"2024-09-15T22:34:48.002449+0000","last_became_active":"2024-09-15T22:09:17.402751+0000","last_became_peered":"2024-09-15T22:09:17.402751+0000","last_unstale":"2024-09-15T22:34:48.002449+0000","last_undegraded":"2024-09-15T22:34:48.002449+0000","last_fullsized":"2024-09-15T22:34:48.002449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:16.382721+0000","last_clean_scrub_stamp":"2024-09-15T22:09:16.382721+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93952,"num_write_kb":3592319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123090,"ondisk_log_size":123090,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56939,"ondisk_log_size":56939,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":248864567,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2930,"num_read_kb":7996,"num_write":96424,"num_write_kb":735227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327417856,"data_stored":497729134,"data_compressed":51451918,"data_compressed_allocated":79175680,"data_compressed_original":249544704,"omap_allocated":0,"internal_metadata":0},"log_size":93536,"ondisk_log_size":93536,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542457,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":548100,"kb_used_data":43636,"kb_used_omap":1,"kb_used_meta":504446,"kb_avail":93823740,"statfs":{"total":96636764160,"available":96075509760,"internally_reserved":0,"allocated":44683264,"data_stored":67817371,"data_compressed":6954037,"data_compressed_allocated":10792960,"data_compressed_original":34103296,"omap_allocated":1590,"internal_metadata":516553162},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542457,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":562988,"kb_used_data":44636,"kb_used_omap":1,"kb_used_meta":518334,"kb_avail":93808852,"statfs":{"total":96636764160,"available":96060264448,"internally_reserved":0,"allocated":45707264,"data_stored":69135013,"data_compressed":7128351,"data_compressed_allocated":10952704,"data_compressed_original":34557952,"omap_allocated":1594,"internal_metadata":530774470},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542458,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":592640,"kb_used_data":61872,"kb_used_omap":1,"kb_used_meta":530750,"kb_avail":93779200,"statfs":{"total":96636764160,"available":96029900800,"internally_reserved":0,"allocated":63356928,"data_stored":97985800,"data_compressed":10458419,"data_compressed_allocated":16003072,"data_compressed_original":50806784,"omap_allocated":1594,"internal_metadata":543488454},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542459,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":450656,"kb_used_data":26640,"kb_used_omap":1,"kb_used_meta":423998,"kb_avail":93921184,"statfs":{"total":96636764160,"available":96175292416,"internally_reserved":0,"allocated":27279360,"data_stored":42060723,"data_compressed":4480082,"data_compressed_allocated":6909952,"data_compressed_original":21872640,"omap_allocated":1595,"internal_metadata":434174405},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542459,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":571996,"kb_used_data":41100,"kb_used_omap":1,"kb_used_meta":530878,"kb_avail":93799844,"statfs":{"total":96636764160,"available":96051040256,"internally_reserved":0,"allocated":42086400,"data_stored":63032789,"data_compressed":6347263,"data_compressed_allocated":9764864,"data_compressed_original":30887936,"omap_allocated":1593,"internal_metadata":543619527},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":336252,"kb_used_data":30188,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94035588,"statfs":{"total":96636764160,"available":96292442112,"internally_reserved":0,"allocated":30912512,"data_stored":46254901,"data_compressed":4726192,"data_compressed_allocated":7282688,"data_compressed_original":22794240,"omap_allocated":1592,"internal_metadata":313391560},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542458,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":399260,"kb_used_data":25228,"kb_used_omap":1,"kb_used_meta":374014,"kb_avail":93972580,"statfs":{"total":96636764160,"available":96227921920,"internally_reserved":0,"allocated":25833472,"data_stored":38457299,"data_compressed":3734837,"data_compressed_allocated":5775360,"data_compressed_original":18583552,"omap_allocated":1595,"internal_metadata":382990789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575162,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":657404,"kb_used_data":48812,"kb_used_omap":1,"kb_used_meta":608574,"kb_avail":93714436,"statfs":{"total":96636764160,"available":95963582464,"internally_reserved":0,"allocated":49983488,"data_stored":75106430,"data_compressed":7687781,"data_compressed_allocated":11784192,"data_compressed_original":37085184,"omap_allocated":1594,"internal_metadata":623180230},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25481216,"data_stored":37749374,"data_compressed":3702315,"data_compressed_allocated":5730304,"data_compressed_original":18010112,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49696768,"data_stored":74988873,"data_compressed":7687781,"data_compressed_allocated":11784192,"data_compressed_original":37085184,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30625792,"data_stored":46137344,"data_compressed":4726192,"data_compressed_allocated":7282688,"data_compressed_original":22794240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":41799680,"data_stored":62915232,"data_compressed":6347263,"data_compressed_allocated":9764864,"data_compressed_original":30887936,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26992640,"data_stored":41943166,"data_compressed":4480082,"data_compressed_allocated":6909952,"data_compressed_original":21872640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":63070208,"data_stored":97868243,"data_compressed":10458419,"data_compressed_allocated":16003072,"data_compressed_original":50806784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45420544,"data_stored":69017456,"data_compressed":7128351,"data_compressed_allocated":10952704,"data_compressed_original":34557952,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":44331008,"data_stored":67109446,"data_compressed":6921515,"data_compressed_allocated":10747904,"data_compressed_original":33529856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:35:00.398 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.398 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.398 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.398 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.398 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.398 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.398 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.398 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.398 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.399 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.399 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.399 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.399 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.399 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.399 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.399 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.399 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.399 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.400 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.400 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.400 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.400 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.400 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.400 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.400 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.400 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.400 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.400 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.401 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.401 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.401 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.401 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.401 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.401 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.401 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.401 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.401 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.402 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.402 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.402 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.402 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.402 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.402 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.402 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-15T22:09:06.009777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=6, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.402 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.402 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.403 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.403 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.403 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.403 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.403 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.403 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.403 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.403 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.403 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.404 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.404 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.404 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.404 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.404 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.404 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.404 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.404 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.404 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.405 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.405 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.405 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.405 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.405 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.405 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.405 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.405 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.406 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.406 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.406 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.406 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.406 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.406 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.406 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.406 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.406 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.407 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.407 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.407 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.407 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-15T22:09:15.376659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.407 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.407 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-15T22:09:20.418600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.407 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.407 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.407 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.408 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.408 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.408 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.408 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.408 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.408 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.408 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.408 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.408 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.409 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.409 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.409 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.409 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.409 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.409 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.409 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.409 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.409 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.410 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.410 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.410 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.410 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.410 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.410 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.410 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.410 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-15T22:09:16.382721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=9, tm_sec=16, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=34, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:35:00.410 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-15T22:35:20.411 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:35:20.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.524+0000 7f17aeaba640 1 Processor -- start 2024-09-15T22:35:20.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.524+0000 7f17aeaba640 1 -- start start 2024-09-15T22:35:20.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f17aeaba640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17a80b4d40 0x7f17a809ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:20.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f17aeaba640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f17a8074ca0 0x7f17a8075110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f17aeaba640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a8075650 con 0x7f17a809fbe0 2024-09-15T22:35:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f17aeaba640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f17a8149980 con 0x7f17a8074ca0 2024-09-15T22:35:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f17aeaba640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f17a8149c60 con 0x7f17a80b4d40 2024-09-15T22:35:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f179ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17a80b4d40 0x7f17a809ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f17ad057640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f17a8074ca0 0x7f17a8075110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f17ac856640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f17a809fbe0 0x7f17a8148f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.78:47644/0 (socket says 172.21.15.78:47644) 2024-09-15T22:35:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f17ac856640 1 -- 172.21.15.78:0/4122750508 learned_addr learned my addr 172.21.15.78:0/4122750508 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:35:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f179f7fe640 1 -- 172.21.15.78:0/4122750508 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3916754439 0 0) 0x7f17a8075650 con 0x7f17a809fbe0 2024-09-15T22:35:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f179f7fe640 1 -- 172.21.15.78:0/4122750508 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1790003520 con 0x7f17a809fbe0 2024-09-15T22:35:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f179ffff640 1 -- 172.21.15.78:0/4122750508 >> v2:172.21.15.175:3300/0 conn(0x7f17a8074ca0 msgr2=0x7f17a8075110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f179ffff640 1 --2- 172.21.15.78:0/4122750508 >> v2:172.21.15.175:3300/0 conn(0x7f17a8074ca0 0x7f17a8075110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f179ffff640 1 -- 172.21.15.78:0/4122750508 >> v1:172.21.15.175:6789/0 conn(0x7f17a809fbe0 legacy=0x7f17a8148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f179ffff640 1 -- 172.21.15.78:0/4122750508 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a80b60f0 con 0x7f17a80b4d40 2024-09-15T22:35:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.525+0000 7f17ad057640 1 --2- 172.21.15.78:0/4122750508 >> v2:172.21.15.175:3300/0 conn(0x7f17a8074ca0 0x7f17a8075110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:35:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.526+0000 7f179ffff640 1 --2- 172.21.15.78:0/4122750508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17a80b4d40 0x7f17a809ffc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1798009790 tx=0x7f179802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3832a3a8a86386cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.526+0000 7f179f7fe640 1 -- 172.21.15.78:0/4122750508 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798037070 con 0x7f17a80b4d40 2024-09-15T22:35:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.527+0000 7f179f7fe640 1 -- 172.21.15.78:0/4122750508 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179802ae50 con 0x7f17a80b4d40 2024-09-15T22:35:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.527+0000 7f179f7fe640 1 -- 172.21.15.78:0/4122750508 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798032660 con 0x7f17a80b4d40 2024-09-15T22:35:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.527+0000 7f17aeaba640 1 -- 172.21.15.78:0/4122750508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17a80b4d40 msgr2=0x7f17a809ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.527+0000 7f17aeaba640 1 --2- 172.21.15.78:0/4122750508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17a80b4d40 0x7f17a809ffc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1798009790 tx=0x7f179802a100 comp rx=0 tx=0).stop 2024-09-15T22:35:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.527+0000 7f17aeaba640 1 -- 172.21.15.78:0/4122750508 shutdown_connections 2024-09-15T22:35:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.527+0000 7f17aeaba640 1 --2- 172.21.15.78:0/4122750508 >> v2:172.21.15.175:3300/0 conn(0x7f17a8074ca0 0x7f17a8075110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.527+0000 7f17aeaba640 1 --2- 172.21.15.78:0/4122750508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17a80b4d40 0x7f17a809ffc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.527+0000 7f17aeaba640 1 -- 172.21.15.78:0/4122750508 >> 172.21.15.78:0/4122750508 conn(0x7f17a809c0f0 msgr2=0x7f17a809c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:20.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.527+0000 7f17aeaba640 1 -- 172.21.15.78:0/4122750508 shutdown_connections 2024-09-15T22:35:20.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.527+0000 7f17aeaba640 1 -- 172.21.15.78:0/4122750508 wait complete. 2024-09-15T22:35:20.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.528+0000 7f17aeaba640 1 Processor -- start 2024-09-15T22:35:20.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.528+0000 7f17aeaba640 1 -- start start 2024-09-15T22:35:20.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.529+0000 7f17aeaba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17a8074ca0 0x7f17a81deba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:20.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.529+0000 7f17aeaba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17a809fbe0 0x7f17a8142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:20.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.529+0000 7f17aeaba640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17a80b4d40 0x7f17a81409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:20.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.529+0000 7f17aeaba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f17a8150430 con 0x7f17a8074ca0 2024-09-15T22:35:20.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.529+0000 7f17aeaba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f17a81502b0 con 0x7f17a809fbe0 2024-09-15T22:35:20.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.529+0000 7f17aeaba640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f17a81505b0 con 0x7f17a80b4d40 2024-09-15T22:35:20.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.529+0000 7f17ac856640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17a8074ca0 0x7f17a81deba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:20.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.529+0000 7f17ac856640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17a8074ca0 0x7f17a81deba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33234/0 (socket says 172.21.15.78:33234) 2024-09-15T22:35:20.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.529+0000 7f17ac856640 1 -- 172.21.15.78:0/3517233890 learned_addr learned my addr 172.21.15.78:0/3517233890 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:35:20.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.529+0000 7f179ffff640 1 --2- 172.21.15.78:0/3517233890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17a809fbe0 0x7f17a8142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:20.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.529+0000 7f17ad057640 1 --2- 172.21.15.78:0/3517233890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17a80b4d40 0x7f17a81409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:20.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.530+0000 7f17ac856640 1 -- 172.21.15.78:0/3517233890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17a80b4d40 msgr2=0x7f17a81409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:20.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.530+0000 7f17ac856640 1 --2- 172.21.15.78:0/3517233890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17a80b4d40 0x7f17a81409b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:20.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.530+0000 7f17ac856640 1 -- 172.21.15.78:0/3517233890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17a809fbe0 msgr2=0x7f17a8142ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:20.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.530+0000 7f17ac856640 1 --2- 172.21.15.78:0/3517233890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17a809fbe0 0x7f17a8142ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:20.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.530+0000 7f17ac856640 1 -- 172.21.15.78:0/3517233890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a81431e0 con 0x7f17a8074ca0 2024-09-15T22:35:20.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.530+0000 7f17ac856640 1 --2- 172.21.15.78:0/3517233890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17a8074ca0 0x7f17a81deba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f17a400c430 tx=0x7f17a400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:20.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.530+0000 7f179d7fa640 1 -- 172.21.15.78:0/3517233890 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4017070 con 0x7f17a8074ca0 2024-09-15T22:35:20.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.530+0000 7f179d7fa640 1 -- 172.21.15.78:0/3517233890 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a4005ce0 con 0x7f17a8074ca0 2024-09-15T22:35:20.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.530+0000 7f179d7fa640 1 -- 172.21.15.78:0/3517233890 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a40072f0 con 0x7f17a8074ca0 2024-09-15T22:35:20.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.530+0000 7f17aeaba640 1 -- 172.21.15.78:0/3517233890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a80b3c60 con 0x7f17a8074ca0 2024-09-15T22:35:20.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.530+0000 7f17aeaba640 1 -- 172.21.15.78:0/3517233890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a81df5f0 con 0x7f17a8074ca0 2024-09-15T22:35:20.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.531+0000 7f17aeaba640 1 -- 172.21.15.78:0/3517233890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a809e570 con 0x7f17a8074ca0 2024-09-15T22:35:20.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.532+0000 7f179d7fa640 1 -- 172.21.15.78:0/3517233890 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f17a401a070 con 0x7f17a8074ca0 2024-09-15T22:35:20.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.532+0000 7f179d7fa640 1 --2- 172.21.15.78:0/3517233890 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f179406c2b0 0x7f179406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:20.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.532+0000 7f179ffff640 1 --2- 172.21.15.78:0/3517233890 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f179406c2b0 0x7f179406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:20.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.532+0000 7f179d7fa640 1 -- 172.21.15.78:0/3517233890 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7f17a408abf0 con 0x7f17a8074ca0 2024-09-15T22:35:20.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.533+0000 7f179ffff640 1 --2- 172.21.15.78:0/3517233890 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f179406c2b0 0x7f179406e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1798034000 tx=0x7f179802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:20.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.537+0000 7f179d7fa640 1 -- 172.21.15.78:0/3517233890 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f17a809e570 con 0x7f17a8074ca0 2024-09-15T22:35:20.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.700+0000 7f17aeaba640 1 -- 172.21.15.78:0/3517233890 --> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f17a81df830 con 0x7f179406c2b0 2024-09-15T22:35:20.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.708+0000 7f179d7fa640 1 -- 172.21.15.78:0/3517233890 <== mgr.4113 v2:172.21.15.78:6832/3668002812 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+336086 (secure 0 0 0) 0x7f17a81df830 con 0x7f179406c2b0 2024-09-15T22:35:20.713 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:35:20.715 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-15T22:35:20.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.711+0000 7f17aeaba640 1 -- 172.21.15.78:0/3517233890 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f179406c2b0 msgr2=0x7f179406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:20.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.711+0000 7f17aeaba640 1 --2- 172.21.15.78:0/3517233890 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f179406c2b0 0x7f179406e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1798034000 tx=0x7f179802e000 comp rx=0 tx=0).stop 2024-09-15T22:35:20.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.711+0000 7f17aeaba640 1 -- 172.21.15.78:0/3517233890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17a8074ca0 msgr2=0x7f17a81deba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:20.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.711+0000 7f17aeaba640 1 --2- 172.21.15.78:0/3517233890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17a8074ca0 0x7f17a81deba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f17a400c430 tx=0x7f17a400c830 comp rx=0 tx=0).stop 2024-09-15T22:35:20.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.711+0000 7f17aeaba640 1 -- 172.21.15.78:0/3517233890 shutdown_connections 2024-09-15T22:35:20.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.711+0000 7f17aeaba640 1 --2- 172.21.15.78:0/3517233890 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f179406c2b0 0x7f179406e770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:20.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.711+0000 7f17aeaba640 1 --2- 172.21.15.78:0/3517233890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17a80b4d40 0x7f17a81409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:20.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.711+0000 7f17aeaba640 1 --2- 172.21.15.78:0/3517233890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17a809fbe0 0x7f17a8142ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:20.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.711+0000 7f17aeaba640 1 --2- 172.21.15.78:0/3517233890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17a8074ca0 0x7f17a81deba0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:20.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.711+0000 7f17aeaba640 1 -- 172.21.15.78:0/3517233890 >> 172.21.15.78:0/3517233890 conn(0x7f17a809c0f0 msgr2=0x7f17a80b8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:20.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.711+0000 7f17aeaba640 1 -- 172.21.15.78:0/3517233890 shutdown_connections 2024-09-15T22:35:20.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.711+0000 7f17aeaba640 1 -- 172.21.15.78:0/3517233890 wait complete. 2024-09-15T22:35:20.724 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":808,"stamp":"2024-09-15T22:35:20.307508+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":249454935,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":3046,"num_read_kb":8096,"num_write":191655,"num_write_kb":4329962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5441,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273740,"ondisk_log_size":273740,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4086016,"kb_used_data":322112,"kb_used_omap":12,"kb_used_meta":3763763,"kb_avail":750888704,"statfs":{"total":773094113280,"available":768910032896,"internally_reserved":0,"allocated":329842688,"data_stored":499850326,"data_compressed":51516962,"data_compressed_allocated":79265792,"data_compressed_original":250691584,"omap_allocated":12747,"internal_metadata":3854093877},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003174"},"pg_stats":[{"pgid":"2.1f","version":"27'1786","reported_seq":1833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.694756+0000","last_change":"2024-09-15T22:34:59.694801+0000","last_active":"2024-09-15T22:34:59.694756+0000","last_peered":"2024-09-15T22:34:59.694756+0000","last_clean":"2024-09-15T22:34:59.694756+0000","last_became_active":"2024-09-15T22:09:16.402725+0000","last_became_peered":"2024-09-15T22:09:16.402725+0000","last_unstale":"2024-09-15T22:34:59.694756+0000","last_undegraded":"2024-09-15T22:34:59.694756+0000","last_fullsized":"2024-09-15T22:34:59.694756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1786","last_scrub_stamp":"2024-09-15T22:34:59.694667+0000","last_deep_scrub":"27'1786","last_deep_scrub_stamp":"2024-09-15T22:34:59.694667+0000","last_clean_scrub_stamp":"2024-09-15T22:34:59.694667+0000","objects_scrubbed":3,"log_size":1786,"log_dups_size":0,"ondisk_log_size":1786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:47.714864+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1792,"num_write_kb":13194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'869","reported_seq":915,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:07.305423+0000","last_change":"2024-09-15T22:35:07.305423+0000","last_active":"2024-09-15T22:35:07.305423+0000","last_peered":"2024-09-15T22:35:07.305423+0000","last_clean":"2024-09-15T22:35:07.305423+0000","last_became_active":"2024-09-15T22:09:17.400428+0000","last_became_peered":"2024-09-15T22:09:17.400428+0000","last_unstale":"2024-09-15T22:35:07.305423+0000","last_undegraded":"2024-09-15T22:35:07.305423+0000","last_fullsized":"2024-09-15T22:35:07.305423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'869","last_scrub_stamp":"2024-09-15T22:35:07.305275+0000","last_deep_scrub":"27'869","last_deep_scrub_stamp":"2024-09-15T22:35:07.305275+0000","last_clean_scrub_stamp":"2024-09-15T22:35:07.305275+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:51.182278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4221","reported_seq":4258,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:12.347890+0000","last_change":"2024-09-15T22:35:12.347919+0000","last_active":"2024-09-15T22:35:12.347890+0000","last_peered":"2024-09-15T22:35:12.347890+0000","last_clean":"2024-09-15T22:35:12.347890+0000","last_became_active":"2024-09-15T22:09:21.449376+0000","last_became_peered":"2024-09-15T22:09:21.449376+0000","last_unstale":"2024-09-15T22:35:12.347890+0000","last_undegraded":"2024-09-15T22:35:12.347890+0000","last_fullsized":"2024-09-15T22:35:12.347890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4221","last_scrub_stamp":"2024-09-15T22:35:12.347785+0000","last_deep_scrub":"27'4221","last_deep_scrub_stamp":"2024-09-15T22:35:12.347785+0000","last_clean_scrub_stamp":"2024-09-15T22:35:12.347785+0000","objects_scrubbed":0,"log_size":4221,"log_dups_size":0,"ondisk_log_size":4221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:53:59.766177+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3323,"num_write_kb":95202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3537","reported_seq":3585,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:04.336638+0000","last_change":"2024-09-15T22:35:04.336638+0000","last_active":"2024-09-15T22:35:04.336638+0000","last_peered":"2024-09-15T22:35:04.336638+0000","last_clean":"2024-09-15T22:35:04.336638+0000","last_became_active":"2024-09-15T22:09:16.407458+0000","last_became_peered":"2024-09-15T22:09:16.407458+0000","last_unstale":"2024-09-15T22:35:04.336638+0000","last_undegraded":"2024-09-15T22:35:04.336638+0000","last_fullsized":"2024-09-15T22:35:04.336638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3537","last_scrub_stamp":"2024-09-15T22:35:04.336476+0000","last_deep_scrub":"27'3537","last_deep_scrub_stamp":"2024-09-15T22:35:04.336476+0000","last_clean_scrub_stamp":"2024-09-15T22:35:04.336476+0000","objects_scrubbed":1,"log_size":3537,"log_dups_size":0,"ondisk_log_size":3537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:53.262937+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":30404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'865","reported_seq":910,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:57.645513+0000","last_change":"2024-09-15T22:34:57.645536+0000","last_active":"2024-09-15T22:34:57.645513+0000","last_peered":"2024-09-15T22:34:57.645513+0000","last_clean":"2024-09-15T22:34:57.645513+0000","last_became_active":"2024-09-15T22:09:17.414966+0000","last_became_peered":"2024-09-15T22:09:17.414966+0000","last_unstale":"2024-09-15T22:34:57.645513+0000","last_undegraded":"2024-09-15T22:34:57.645513+0000","last_fullsized":"2024-09-15T22:34:57.645513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'865","last_scrub_stamp":"2024-09-15T22:34:57.645445+0000","last_deep_scrub":"27'865","last_deep_scrub_stamp":"2024-09-15T22:34:57.645445+0000","last_clean_scrub_stamp":"2024-09-15T22:34:57.645445+0000","objects_scrubbed":0,"log_size":865,"log_dups_size":0,"ondisk_log_size":865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:53.811425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'3714","reported_seq":3751,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:09.548741+0000","last_change":"2024-09-15T22:35:09.548794+0000","last_active":"2024-09-15T22:35:09.548741+0000","last_peered":"2024-09-15T22:35:09.548741+0000","last_clean":"2024-09-15T22:35:09.548741+0000","last_became_active":"2024-09-15T22:09:21.453701+0000","last_became_peered":"2024-09-15T22:09:21.453701+0000","last_unstale":"2024-09-15T22:35:09.548741+0000","last_undegraded":"2024-09-15T22:35:09.548741+0000","last_fullsized":"2024-09-15T22:35:09.548741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3714","last_scrub_stamp":"2024-09-15T22:35:09.548633+0000","last_deep_scrub":"27'3714","last_deep_scrub_stamp":"2024-09-15T22:35:09.548633+0000","last_clean_scrub_stamp":"2024-09-15T22:35:09.548633+0000","objects_scrubbed":0,"log_size":3714,"log_dups_size":0,"ondisk_log_size":3714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:59.365152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2789,"num_write_kb":63634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'4511","reported_seq":4556,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:03.385389+0000","last_change":"2024-09-15T22:35:03.385418+0000","last_active":"2024-09-15T22:35:03.385389+0000","last_peered":"2024-09-15T22:35:03.385389+0000","last_clean":"2024-09-15T22:35:03.385389+0000","last_became_active":"2024-09-15T22:09:16.405626+0000","last_became_peered":"2024-09-15T22:09:16.405626+0000","last_unstale":"2024-09-15T22:35:03.385389+0000","last_undegraded":"2024-09-15T22:35:03.385389+0000","last_fullsized":"2024-09-15T22:35:03.385389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4511","last_scrub_stamp":"2024-09-15T22:35:03.385322+0000","last_deep_scrub":"27'4511","last_deep_scrub_stamp":"2024-09-15T22:35:03.385322+0000","last_clean_scrub_stamp":"2024-09-15T22:35:03.385322+0000","objects_scrubbed":2,"log_size":4511,"log_dups_size":0,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:53.949730+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4510,"num_write_kb":35033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'918","reported_seq":966,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:15.745014+0000","last_change":"2024-09-15T22:35:15.745037+0000","last_active":"2024-09-15T22:35:15.745014+0000","last_peered":"2024-09-15T22:35:15.745014+0000","last_clean":"2024-09-15T22:35:15.745014+0000","last_became_active":"2024-09-15T22:09:59.804970+0000","last_became_peered":"2024-09-15T22:09:59.804970+0000","last_unstale":"2024-09-15T22:35:15.745014+0000","last_undegraded":"2024-09-15T22:35:15.745014+0000","last_fullsized":"2024-09-15T22:35:15.745014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'918","last_scrub_stamp":"2024-09-15T22:35:15.744937+0000","last_deep_scrub":"27'918","last_deep_scrub_stamp":"2024-09-15T22:35:15.744937+0000","last_clean_scrub_stamp":"2024-09-15T22:35:15.744937+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:03.163329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3619","reported_seq":3656,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:10.546542+0000","last_change":"2024-09-15T22:35:10.546583+0000","last_active":"2024-09-15T22:35:10.546542+0000","last_peered":"2024-09-15T22:35:10.546542+0000","last_clean":"2024-09-15T22:35:10.546542+0000","last_became_active":"2024-09-15T22:09:21.454850+0000","last_became_peered":"2024-09-15T22:09:21.454850+0000","last_unstale":"2024-09-15T22:35:10.546542+0000","last_undegraded":"2024-09-15T22:35:10.546542+0000","last_fullsized":"2024-09-15T22:35:10.546542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3619","last_scrub_stamp":"2024-09-15T22:35:10.546468+0000","last_deep_scrub":"27'3619","last_deep_scrub_stamp":"2024-09-15T22:35:10.546468+0000","last_clean_scrub_stamp":"2024-09-15T22:35:10.546468+0000","objects_scrubbed":0,"log_size":3619,"log_dups_size":0,"ondisk_log_size":3619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:32.878458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2687,"num_write_kb":123513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'2010","reported_seq":2055,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:05.483870+0000","last_change":"2024-09-15T22:35:05.483905+0000","last_active":"2024-09-15T22:35:05.483870+0000","last_peered":"2024-09-15T22:35:05.483870+0000","last_clean":"2024-09-15T22:35:05.483870+0000","last_became_active":"2024-09-15T22:09:16.407364+0000","last_became_peered":"2024-09-15T22:09:16.407364+0000","last_unstale":"2024-09-15T22:35:05.483870+0000","last_undegraded":"2024-09-15T22:35:05.483870+0000","last_fullsized":"2024-09-15T22:35:05.483870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2010","last_scrub_stamp":"2024-09-15T22:35:05.483794+0000","last_deep_scrub":"27'2010","last_deep_scrub_stamp":"2024-09-15T22:35:05.483794+0000","last_clean_scrub_stamp":"2024-09-15T22:35:05.483794+0000","objects_scrubbed":4,"log_size":2010,"log_dups_size":0,"ondisk_log_size":2010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:26.717115+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2007,"num_write_kb":17393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'890","reported_seq":933,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:05.836951+0000","last_change":"2024-09-15T22:35:05.836973+0000","last_active":"2024-09-15T22:35:05.836951+0000","last_peered":"2024-09-15T22:35:05.836951+0000","last_clean":"2024-09-15T22:35:05.836951+0000","last_became_active":"2024-09-15T22:09:17.407881+0000","last_became_peered":"2024-09-15T22:09:17.407881+0000","last_unstale":"2024-09-15T22:35:05.836951+0000","last_undegraded":"2024-09-15T22:35:05.836951+0000","last_fullsized":"2024-09-15T22:35:05.836951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'890","last_scrub_stamp":"2024-09-15T22:35:05.836889+0000","last_deep_scrub":"27'890","last_deep_scrub_stamp":"2024-09-15T22:35:05.836889+0000","last_clean_scrub_stamp":"2024-09-15T22:35:05.836889+0000","objects_scrubbed":0,"log_size":890,"log_dups_size":0,"ondisk_log_size":890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:47.666251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'3863","reported_seq":3900,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:07.489857+0000","last_change":"2024-09-15T22:35:07.489898+0000","last_active":"2024-09-15T22:35:07.489857+0000","last_peered":"2024-09-15T22:35:07.489857+0000","last_clean":"2024-09-15T22:35:07.489857+0000","last_became_active":"2024-09-15T22:09:21.450265+0000","last_became_peered":"2024-09-15T22:09:21.450265+0000","last_unstale":"2024-09-15T22:35:07.489857+0000","last_undegraded":"2024-09-15T22:35:07.489857+0000","last_fullsized":"2024-09-15T22:35:07.489857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3863","last_scrub_stamp":"2024-09-15T22:35:07.489760+0000","last_deep_scrub":"27'3863","last_deep_scrub_stamp":"2024-09-15T22:35:07.489760+0000","last_clean_scrub_stamp":"2024-09-15T22:35:07.489760+0000","objects_scrubbed":0,"log_size":3863,"log_dups_size":0,"ondisk_log_size":3863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:28.723081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3014,"num_write_kb":86107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'883","reported_seq":928,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:09.179643+0000","last_change":"2024-09-15T22:35:09.179643+0000","last_active":"2024-09-15T22:35:09.179643+0000","last_peered":"2024-09-15T22:35:09.179643+0000","last_clean":"2024-09-15T22:35:09.179643+0000","last_became_active":"2024-09-15T22:09:17.410383+0000","last_became_peered":"2024-09-15T22:09:17.410383+0000","last_unstale":"2024-09-15T22:35:09.179643+0000","last_undegraded":"2024-09-15T22:35:09.179643+0000","last_fullsized":"2024-09-15T22:35:09.179643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'883","last_scrub_stamp":"2024-09-15T22:35:09.179548+0000","last_deep_scrub":"27'883","last_deep_scrub_stamp":"2024-09-15T22:35:09.179548+0000","last_clean_scrub_stamp":"2024-09-15T22:35:09.179548+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:51.008911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'3970","reported_seq":4016,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:02.421424+0000","last_change":"2024-09-15T22:35:02.421452+0000","last_active":"2024-09-15T22:35:02.421424+0000","last_peered":"2024-09-15T22:35:02.421424+0000","last_clean":"2024-09-15T22:35:02.421424+0000","last_became_active":"2024-09-15T22:09:16.405010+0000","last_became_peered":"2024-09-15T22:09:16.405010+0000","last_unstale":"2024-09-15T22:35:02.421424+0000","last_undegraded":"2024-09-15T22:35:02.421424+0000","last_fullsized":"2024-09-15T22:35:02.421424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3970","last_scrub_stamp":"2024-09-15T22:35:02.421359+0000","last_deep_scrub":"27'3970","last_deep_scrub_stamp":"2024-09-15T22:35:02.421359+0000","last_clean_scrub_stamp":"2024-09-15T22:35:02.421359+0000","objects_scrubbed":2,"log_size":3970,"log_dups_size":0,"ondisk_log_size":3970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:17.973300+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3969,"num_write_kb":30662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'3504","reported_seq":3549,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:12.525710+0000","last_change":"2024-09-15T22:35:12.525753+0000","last_active":"2024-09-15T22:35:12.525710+0000","last_peered":"2024-09-15T22:35:12.525710+0000","last_clean":"2024-09-15T22:35:12.525710+0000","last_became_active":"2024-09-15T22:09:59.533675+0000","last_became_peered":"2024-09-15T22:09:59.533675+0000","last_unstale":"2024-09-15T22:35:12.525710+0000","last_undegraded":"2024-09-15T22:35:12.525710+0000","last_fullsized":"2024-09-15T22:35:12.525710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3504","last_scrub_stamp":"2024-09-15T22:35:12.525617+0000","last_deep_scrub":"27'3504","last_deep_scrub_stamp":"2024-09-15T22:35:12.525617+0000","last_clean_scrub_stamp":"2024-09-15T22:35:12.525617+0000","objects_scrubbed":0,"log_size":3504,"log_dups_size":0,"ondisk_log_size":3504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:24.064702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2557,"num_write_kb":53761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'919","reported_seq":963,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:09.280660+0000","last_change":"2024-09-15T22:35:09.280687+0000","last_active":"2024-09-15T22:35:09.280660+0000","last_peered":"2024-09-15T22:35:09.280660+0000","last_clean":"2024-09-15T22:35:09.280660+0000","last_became_active":"2024-09-15T22:09:17.405065+0000","last_became_peered":"2024-09-15T22:09:17.405065+0000","last_unstale":"2024-09-15T22:35:09.280660+0000","last_undegraded":"2024-09-15T22:35:09.280660+0000","last_fullsized":"2024-09-15T22:35:09.280660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'919","last_scrub_stamp":"2024-09-15T22:35:09.280562+0000","last_deep_scrub":"27'919","last_deep_scrub_stamp":"2024-09-15T22:35:09.280562+0000","last_clean_scrub_stamp":"2024-09-15T22:35:09.280562+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:05.294805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3444","reported_seq":3490,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:00.750797+0000","last_change":"2024-09-15T22:35:00.750822+0000","last_active":"2024-09-15T22:35:00.750797+0000","last_peered":"2024-09-15T22:35:00.750797+0000","last_clean":"2024-09-15T22:35:00.750797+0000","last_became_active":"2024-09-15T22:09:16.406454+0000","last_became_peered":"2024-09-15T22:09:16.406454+0000","last_unstale":"2024-09-15T22:35:00.750797+0000","last_undegraded":"2024-09-15T22:35:00.750797+0000","last_fullsized":"2024-09-15T22:35:00.750797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3444","last_scrub_stamp":"2024-09-15T22:35:00.750731+0000","last_deep_scrub":"27'3444","last_deep_scrub_stamp":"2024-09-15T22:35:00.750731+0000","last_clean_scrub_stamp":"2024-09-15T22:35:00.750731+0000","objects_scrubbed":2,"log_size":3444,"log_dups_size":0,"ondisk_log_size":3444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:48.612079+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3448,"num_write_kb":30365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'4173","reported_seq":4218,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:13.569941+0000","last_change":"2024-09-15T22:35:13.569964+0000","last_active":"2024-09-15T22:35:13.569941+0000","last_peered":"2024-09-15T22:35:13.569941+0000","last_clean":"2024-09-15T22:35:13.569941+0000","last_became_active":"2024-09-15T22:09:59.805100+0000","last_became_peered":"2024-09-15T22:09:59.805100+0000","last_unstale":"2024-09-15T22:35:13.569941+0000","last_undegraded":"2024-09-15T22:35:13.569941+0000","last_fullsized":"2024-09-15T22:35:13.569941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4173","last_scrub_stamp":"2024-09-15T22:35:13.569867+0000","last_deep_scrub":"27'4173","last_deep_scrub_stamp":"2024-09-15T22:35:13.569867+0000","last_clean_scrub_stamp":"2024-09-15T22:35:13.569867+0000","objects_scrubbed":0,"log_size":4173,"log_dups_size":0,"ondisk_log_size":4173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:06.844758+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3298,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'955","reported_seq":1000,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:05.279198+0000","last_change":"2024-09-15T22:35:05.279198+0000","last_active":"2024-09-15T22:35:05.279198+0000","last_peered":"2024-09-15T22:35:05.279198+0000","last_clean":"2024-09-15T22:35:05.279198+0000","last_became_active":"2024-09-15T22:09:17.399290+0000","last_became_peered":"2024-09-15T22:09:17.399290+0000","last_unstale":"2024-09-15T22:35:05.279198+0000","last_undegraded":"2024-09-15T22:35:05.279198+0000","last_fullsized":"2024-09-15T22:35:05.279198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'955","last_scrub_stamp":"2024-09-15T22:35:05.279078+0000","last_deep_scrub":"27'955","last_deep_scrub_stamp":"2024-09-15T22:35:05.279078+0000","last_clean_scrub_stamp":"2024-09-15T22:35:05.279078+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:19.013956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'2083","reported_seq":2130,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:04.797402+0000","last_change":"2024-09-15T22:35:04.797402+0000","last_active":"2024-09-15T22:35:04.797402+0000","last_peered":"2024-09-15T22:35:04.797402+0000","last_clean":"2024-09-15T22:35:04.797402+0000","last_became_active":"2024-09-15T22:09:16.408691+0000","last_became_peered":"2024-09-15T22:09:16.408691+0000","last_unstale":"2024-09-15T22:35:04.797402+0000","last_undegraded":"2024-09-15T22:35:04.797402+0000","last_fullsized":"2024-09-15T22:35:04.797402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2083","last_scrub_stamp":"2024-09-15T22:35:04.797273+0000","last_deep_scrub":"27'2083","last_deep_scrub_stamp":"2024-09-15T22:35:04.797273+0000","last_clean_scrub_stamp":"2024-09-15T22:35:04.797273+0000","objects_scrubbed":1,"log_size":2083,"log_dups_size":0,"ondisk_log_size":2083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:21.769391+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2101,"num_write_kb":17400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'3631","reported_seq":3669,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:13.883203+0000","last_change":"2024-09-15T22:35:13.883232+0000","last_active":"2024-09-15T22:35:13.883203+0000","last_peered":"2024-09-15T22:35:13.883203+0000","last_clean":"2024-09-15T22:35:13.883203+0000","last_became_active":"2024-09-15T22:09:21.458548+0000","last_became_peered":"2024-09-15T22:09:21.458548+0000","last_unstale":"2024-09-15T22:35:13.883203+0000","last_undegraded":"2024-09-15T22:35:13.883203+0000","last_fullsized":"2024-09-15T22:35:13.883203+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3631","last_scrub_stamp":"2024-09-15T22:35:13.883096+0000","last_deep_scrub":"27'3631","last_deep_scrub_stamp":"2024-09-15T22:35:13.883096+0000","last_clean_scrub_stamp":"2024-09-15T22:35:13.883096+0000","objects_scrubbed":0,"log_size":3631,"log_dups_size":0,"ondisk_log_size":3631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:09.691645+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2705,"num_write_kb":61946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'892","reported_seq":937,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:01.641670+0000","last_change":"2024-09-15T22:35:01.641670+0000","last_active":"2024-09-15T22:35:01.641670+0000","last_peered":"2024-09-15T22:35:01.641670+0000","last_clean":"2024-09-15T22:35:01.641670+0000","last_became_active":"2024-09-15T22:09:17.400494+0000","last_became_peered":"2024-09-15T22:09:17.400494+0000","last_unstale":"2024-09-15T22:35:01.641670+0000","last_undegraded":"2024-09-15T22:35:01.641670+0000","last_fullsized":"2024-09-15T22:35:01.641670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'892","last_scrub_stamp":"2024-09-15T22:35:01.641537+0000","last_deep_scrub":"27'892","last_deep_scrub_stamp":"2024-09-15T22:35:01.641537+0000","last_clean_scrub_stamp":"2024-09-15T22:35:01.641537+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:10.343486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1675","reported_seq":1722,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:07.453982+0000","last_change":"2024-09-15T22:35:07.453982+0000","last_active":"2024-09-15T22:35:07.453982+0000","last_peered":"2024-09-15T22:35:07.453982+0000","last_clean":"2024-09-15T22:35:07.453982+0000","last_became_active":"2024-09-15T22:09:16.408603+0000","last_became_peered":"2024-09-15T22:09:16.408603+0000","last_unstale":"2024-09-15T22:35:07.453982+0000","last_undegraded":"2024-09-15T22:35:07.453982+0000","last_fullsized":"2024-09-15T22:35:07.453982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1675","last_scrub_stamp":"2024-09-15T22:35:07.453845+0000","last_deep_scrub":"27'1675","last_deep_scrub_stamp":"2024-09-15T22:35:07.453845+0000","last_clean_scrub_stamp":"2024-09-15T22:35:07.453845+0000","objects_scrubbed":1,"log_size":1675,"log_dups_size":0,"ondisk_log_size":1675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:57.270365+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1676,"num_write_kb":13088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'3587","reported_seq":3625,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:05.534659+0000","last_change":"2024-09-15T22:35:05.534703+0000","last_active":"2024-09-15T22:35:05.534659+0000","last_peered":"2024-09-15T22:35:05.534659+0000","last_clean":"2024-09-15T22:35:05.534659+0000","last_became_active":"2024-09-15T22:09:21.447348+0000","last_became_peered":"2024-09-15T22:09:21.447348+0000","last_unstale":"2024-09-15T22:35:05.534659+0000","last_undegraded":"2024-09-15T22:35:05.534659+0000","last_fullsized":"2024-09-15T22:35:05.534659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3587","last_scrub_stamp":"2024-09-15T22:35:05.534543+0000","last_deep_scrub":"27'3587","last_deep_scrub_stamp":"2024-09-15T22:35:05.534543+0000","last_clean_scrub_stamp":"2024-09-15T22:35:05.534543+0000","objects_scrubbed":0,"log_size":3587,"log_dups_size":0,"ondisk_log_size":3587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:56.098952+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2651,"num_write_kb":118894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'899","reported_seq":944,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:00.652409+0000","last_change":"2024-09-15T22:35:00.652409+0000","last_active":"2024-09-15T22:35:00.652409+0000","last_peered":"2024-09-15T22:35:00.652409+0000","last_clean":"2024-09-15T22:35:00.652409+0000","last_became_active":"2024-09-15T22:09:17.402585+0000","last_became_peered":"2024-09-15T22:09:17.402585+0000","last_unstale":"2024-09-15T22:35:00.652409+0000","last_undegraded":"2024-09-15T22:35:00.652409+0000","last_fullsized":"2024-09-15T22:35:00.652409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'899","last_scrub_stamp":"2024-09-15T22:35:00.652321+0000","last_deep_scrub":"27'899","last_deep_scrub_stamp":"2024-09-15T22:35:00.652321+0000","last_clean_scrub_stamp":"2024-09-15T22:35:00.652321+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:22.792638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'1637","reported_seq":1684,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:04.195160+0000","last_change":"2024-09-15T22:35:04.195160+0000","last_active":"2024-09-15T22:35:04.195160+0000","last_peered":"2024-09-15T22:35:04.195160+0000","last_clean":"2024-09-15T22:35:04.195160+0000","last_became_active":"2024-09-15T22:09:16.407657+0000","last_became_peered":"2024-09-15T22:09:16.407657+0000","last_unstale":"2024-09-15T22:35:04.195160+0000","last_undegraded":"2024-09-15T22:35:04.195160+0000","last_fullsized":"2024-09-15T22:35:04.195160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1637","last_scrub_stamp":"2024-09-15T22:35:04.195062+0000","last_deep_scrub":"27'1637","last_deep_scrub_stamp":"2024-09-15T22:35:04.195062+0000","last_clean_scrub_stamp":"2024-09-15T22:35:04.195062+0000","objects_scrubbed":3,"log_size":1637,"log_dups_size":0,"ondisk_log_size":1637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:43.371822+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":13124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'3592","reported_seq":3631,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:08.512577+0000","last_change":"2024-09-15T22:35:08.512603+0000","last_active":"2024-09-15T22:35:08.512577+0000","last_peered":"2024-09-15T22:35:08.512577+0000","last_clean":"2024-09-15T22:35:08.512577+0000","last_became_active":"2024-09-15T22:09:21.450731+0000","last_became_peered":"2024-09-15T22:09:21.450731+0000","last_unstale":"2024-09-15T22:35:08.512577+0000","last_undegraded":"2024-09-15T22:35:08.512577+0000","last_fullsized":"2024-09-15T22:35:08.512577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3592","last_scrub_stamp":"2024-09-15T22:35:08.512500+0000","last_deep_scrub":"27'3592","last_deep_scrub_stamp":"2024-09-15T22:35:08.512500+0000","last_clean_scrub_stamp":"2024-09-15T22:35:08.512500+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:31.725254+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2678,"num_write_kb":64130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'844","reported_seq":889,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:10.291184+0000","last_change":"2024-09-15T22:35:10.291184+0000","last_active":"2024-09-15T22:35:10.291184+0000","last_peered":"2024-09-15T22:35:10.291184+0000","last_clean":"2024-09-15T22:35:10.291184+0000","last_became_active":"2024-09-15T22:09:17.421379+0000","last_became_peered":"2024-09-15T22:09:17.421379+0000","last_unstale":"2024-09-15T22:35:10.291184+0000","last_undegraded":"2024-09-15T22:35:10.291184+0000","last_fullsized":"2024-09-15T22:35:10.291184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'844","last_scrub_stamp":"2024-09-15T22:35:10.291065+0000","last_deep_scrub":"27'844","last_deep_scrub_stamp":"2024-09-15T22:35:10.291065+0000","last_clean_scrub_stamp":"2024-09-15T22:35:10.291065+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:42:11.062852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2977","reported_seq":3024,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:02.805656+0000","last_change":"2024-09-15T22:35:02.805656+0000","last_active":"2024-09-15T22:35:02.805656+0000","last_peered":"2024-09-15T22:35:02.805656+0000","last_clean":"2024-09-15T22:35:02.805656+0000","last_became_active":"2024-09-15T22:09:16.408068+0000","last_became_peered":"2024-09-15T22:09:16.408068+0000","last_unstale":"2024-09-15T22:35:02.805656+0000","last_undegraded":"2024-09-15T22:35:02.805656+0000","last_fullsized":"2024-09-15T22:35:02.805656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2977","last_scrub_stamp":"2024-09-15T22:35:02.805497+0000","last_deep_scrub":"27'2977","last_deep_scrub_stamp":"2024-09-15T22:35:02.805497+0000","last_clean_scrub_stamp":"2024-09-15T22:35:02.805497+0000","objects_scrubbed":2,"log_size":2977,"log_dups_size":0,"ondisk_log_size":2977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:07.753315+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5729,"num_write_kb":16111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'3599","reported_seq":3638,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:16.317369+0000","last_change":"2024-09-15T22:35:16.317397+0000","last_active":"2024-09-15T22:35:16.317369+0000","last_peered":"2024-09-15T22:35:16.317369+0000","last_clean":"2024-09-15T22:35:16.317369+0000","last_became_active":"2024-09-15T22:09:21.457031+0000","last_became_peered":"2024-09-15T22:09:21.457031+0000","last_unstale":"2024-09-15T22:35:16.317369+0000","last_undegraded":"2024-09-15T22:35:16.317369+0000","last_fullsized":"2024-09-15T22:35:16.317369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3599","last_scrub_stamp":"2024-09-15T22:35:16.317265+0000","last_deep_scrub":"27'3599","last_deep_scrub_stamp":"2024-09-15T22:35:16.317265+0000","last_clean_scrub_stamp":"2024-09-15T22:35:16.317265+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:40.695981+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":57002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'901","reported_seq":946,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:06.748081+0000","last_change":"2024-09-15T22:35:06.748108+0000","last_active":"2024-09-15T22:35:06.748081+0000","last_peered":"2024-09-15T22:35:06.748081+0000","last_clean":"2024-09-15T22:35:06.748081+0000","last_became_active":"2024-09-15T22:09:17.399815+0000","last_became_peered":"2024-09-15T22:09:17.399815+0000","last_unstale":"2024-09-15T22:35:06.748081+0000","last_undegraded":"2024-09-15T22:35:06.748081+0000","last_fullsized":"2024-09-15T22:35:06.748081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'901","last_scrub_stamp":"2024-09-15T22:35:06.747998+0000","last_deep_scrub":"27'901","last_deep_scrub_stamp":"2024-09-15T22:35:06.747998+0000","last_clean_scrub_stamp":"2024-09-15T22:35:06.747998+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:14.272601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2760","reported_seq":2807,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:04.425719+0000","last_change":"2024-09-15T22:35:04.425766+0000","last_active":"2024-09-15T22:35:04.425719+0000","last_peered":"2024-09-15T22:35:04.425719+0000","last_clean":"2024-09-15T22:35:04.425719+0000","last_became_active":"2024-09-15T22:09:16.407199+0000","last_became_peered":"2024-09-15T22:09:16.407199+0000","last_unstale":"2024-09-15T22:35:04.425719+0000","last_undegraded":"2024-09-15T22:35:04.425719+0000","last_fullsized":"2024-09-15T22:35:04.425719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2760","last_scrub_stamp":"2024-09-15T22:35:04.425618+0000","last_deep_scrub":"27'2760","last_deep_scrub_stamp":"2024-09-15T22:35:04.425618+0000","last_clean_scrub_stamp":"2024-09-15T22:35:04.425618+0000","objects_scrubbed":1,"log_size":2760,"log_dups_size":0,"ondisk_log_size":2760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:57.573352+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2756,"num_write_kb":21836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'4104","reported_seq":4143,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:09.557359+0000","last_change":"2024-09-15T22:35:09.557400+0000","last_active":"2024-09-15T22:35:09.557359+0000","last_peered":"2024-09-15T22:35:09.557359+0000","last_clean":"2024-09-15T22:35:09.557359+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:35:09.557359+0000","last_undegraded":"2024-09-15T22:35:09.557359+0000","last_fullsized":"2024-09-15T22:35:09.557359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4104","last_scrub_stamp":"2024-09-15T22:35:09.557252+0000","last_deep_scrub":"27'4104","last_deep_scrub_stamp":"2024-09-15T22:35:09.557252+0000","last_clean_scrub_stamp":"2024-09-15T22:35:09.557252+0000","objects_scrubbed":0,"log_size":4104,"log_dups_size":0,"ondisk_log_size":4104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:21.096337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3164,"num_write_kb":141390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'867","reported_seq":912,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.948510+0000","last_change":"2024-09-15T22:34:59.948548+0000","last_active":"2024-09-15T22:34:59.948510+0000","last_peered":"2024-09-15T22:34:59.948510+0000","last_clean":"2024-09-15T22:34:59.948510+0000","last_became_active":"2024-09-15T22:09:17.414645+0000","last_became_peered":"2024-09-15T22:09:17.414645+0000","last_unstale":"2024-09-15T22:34:59.948510+0000","last_undegraded":"2024-09-15T22:34:59.948510+0000","last_fullsized":"2024-09-15T22:34:59.948510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'867","last_scrub_stamp":"2024-09-15T22:34:59.948405+0000","last_deep_scrub":"27'867","last_deep_scrub_stamp":"2024-09-15T22:34:59.948405+0000","last_clean_scrub_stamp":"2024-09-15T22:34:59.948405+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:04.705970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'2266","reported_seq":2313,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:03.828604+0000","last_change":"2024-09-15T22:35:03.828654+0000","last_active":"2024-09-15T22:35:03.828604+0000","last_peered":"2024-09-15T22:35:03.828604+0000","last_clean":"2024-09-15T22:35:03.828604+0000","last_became_active":"2024-09-15T22:09:16.408530+0000","last_became_peered":"2024-09-15T22:09:16.408530+0000","last_unstale":"2024-09-15T22:35:03.828604+0000","last_undegraded":"2024-09-15T22:35:03.828604+0000","last_fullsized":"2024-09-15T22:35:03.828604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2266","last_scrub_stamp":"2024-09-15T22:35:03.828510+0000","last_deep_scrub":"27'2266","last_deep_scrub_stamp":"2024-09-15T22:35:03.828510+0000","last_clean_scrub_stamp":"2024-09-15T22:35:03.828510+0000","objects_scrubbed":3,"log_size":2266,"log_dups_size":0,"ondisk_log_size":2266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:38.889569+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2269,"num_write_kb":17504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'4348","reported_seq":4387,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:09.846800+0000","last_change":"2024-09-15T22:35:09.846850+0000","last_active":"2024-09-15T22:35:09.846800+0000","last_peered":"2024-09-15T22:35:09.846800+0000","last_clean":"2024-09-15T22:35:09.846800+0000","last_became_active":"2024-09-15T22:09:21.451491+0000","last_became_peered":"2024-09-15T22:09:21.451491+0000","last_unstale":"2024-09-15T22:35:09.846800+0000","last_undegraded":"2024-09-15T22:35:09.846800+0000","last_fullsized":"2024-09-15T22:35:09.846800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4348","last_scrub_stamp":"2024-09-15T22:35:09.846686+0000","last_deep_scrub":"27'4348","last_deep_scrub_stamp":"2024-09-15T22:35:09.846686+0000","last_clean_scrub_stamp":"2024-09-15T22:35:09.846686+0000","objects_scrubbed":0,"log_size":4348,"log_dups_size":0,"ondisk_log_size":4348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:20.193483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3466,"num_write_kb":69520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'894","reported_seq":939,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:04.559476+0000","last_change":"2024-09-15T22:35:04.559515+0000","last_active":"2024-09-15T22:35:04.559476+0000","last_peered":"2024-09-15T22:35:04.559476+0000","last_clean":"2024-09-15T22:35:04.559476+0000","last_became_active":"2024-09-15T22:09:17.409038+0000","last_became_peered":"2024-09-15T22:09:17.409038+0000","last_unstale":"2024-09-15T22:35:04.559476+0000","last_undegraded":"2024-09-15T22:35:04.559476+0000","last_fullsized":"2024-09-15T22:35:04.559476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'894","last_scrub_stamp":"2024-09-15T22:35:04.559370+0000","last_deep_scrub":"27'894","last_deep_scrub_stamp":"2024-09-15T22:35:04.559370+0000","last_clean_scrub_stamp":"2024-09-15T22:35:04.559370+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:20.111310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5440","reported_seq":5487,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:04.905031+0000","last_change":"2024-09-15T22:35:04.905060+0000","last_active":"2024-09-15T22:35:04.905031+0000","last_peered":"2024-09-15T22:35:04.905031+0000","last_clean":"2024-09-15T22:35:04.905031+0000","last_became_active":"2024-09-15T22:09:16.409532+0000","last_became_peered":"2024-09-15T22:09:16.409532+0000","last_unstale":"2024-09-15T22:35:04.905031+0000","last_undegraded":"2024-09-15T22:35:04.905031+0000","last_fullsized":"2024-09-15T22:35:04.905031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5440","last_scrub_stamp":"2024-09-15T22:35:04.904969+0000","last_deep_scrub":"27'5440","last_deep_scrub_stamp":"2024-09-15T22:35:04.904969+0000","last_clean_scrub_stamp":"2024-09-15T22:35:04.904969+0000","objects_scrubbed":5,"log_size":5440,"log_dups_size":0,"ondisk_log_size":5440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:06.031630+0000","scrub_duration":66,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20462761,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5431,"num_write_kb":47203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'4057","reported_seq":4096,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:12.892446+0000","last_change":"2024-09-15T22:35:12.892474+0000","last_active":"2024-09-15T22:35:12.892446+0000","last_peered":"2024-09-15T22:35:12.892446+0000","last_clean":"2024-09-15T22:35:12.892446+0000","last_became_active":"2024-09-15T22:09:21.457818+0000","last_became_peered":"2024-09-15T22:09:21.457818+0000","last_unstale":"2024-09-15T22:35:12.892446+0000","last_undegraded":"2024-09-15T22:35:12.892446+0000","last_fullsized":"2024-09-15T22:35:12.892446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4057","last_scrub_stamp":"2024-09-15T22:35:12.892353+0000","last_deep_scrub":"27'4057","last_deep_scrub_stamp":"2024-09-15T22:35:12.892353+0000","last_clean_scrub_stamp":"2024-09-15T22:35:12.892353+0000","objects_scrubbed":0,"log_size":4057,"log_dups_size":0,"ondisk_log_size":4057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:09.768569+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3146,"num_write_kb":128629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'903","reported_seq":948,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:05.767294+0000","last_change":"2024-09-15T22:35:05.767322+0000","last_active":"2024-09-15T22:35:05.767294+0000","last_peered":"2024-09-15T22:35:05.767294+0000","last_clean":"2024-09-15T22:35:05.767294+0000","last_became_active":"2024-09-15T22:09:17.399148+0000","last_became_peered":"2024-09-15T22:09:17.399148+0000","last_unstale":"2024-09-15T22:35:05.767294+0000","last_undegraded":"2024-09-15T22:35:05.767294+0000","last_fullsized":"2024-09-15T22:35:05.767294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'903","last_scrub_stamp":"2024-09-15T22:35:05.767200+0000","last_deep_scrub":"27'903","last_deep_scrub_stamp":"2024-09-15T22:35:05.767200+0000","last_clean_scrub_stamp":"2024-09-15T22:35:05.767200+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:54.728298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'4746","reported_seq":7026,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:57.967635+0000","last_change":"2024-09-15T22:34:57.967665+0000","last_active":"2024-09-15T22:34:57.967635+0000","last_peered":"2024-09-15T22:34:57.967635+0000","last_clean":"2024-09-15T22:34:57.967635+0000","last_became_active":"2024-09-15T22:09:16.402575+0000","last_became_peered":"2024-09-15T22:09:16.402575+0000","last_unstale":"2024-09-15T22:34:57.967635+0000","last_undegraded":"2024-09-15T22:34:57.967635+0000","last_fullsized":"2024-09-15T22:34:57.967635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4746","last_scrub_stamp":"2024-09-15T22:34:57.967572+0000","last_deep_scrub":"27'4746","last_deep_scrub_stamp":"2024-09-15T22:34:57.967572+0000","last_clean_scrub_stamp":"2024-09-15T22:34:57.967572+0000","objects_scrubbed":2,"log_size":4746,"log_dups_size":0,"ondisk_log_size":4746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:35.306589+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2233,"num_read_kb":5661,"num_write":4757,"num_write_kb":27314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'3833","reported_seq":3871,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:11.858199+0000","last_change":"2024-09-15T22:35:11.858243+0000","last_active":"2024-09-15T22:35:11.858199+0000","last_peered":"2024-09-15T22:35:11.858199+0000","last_clean":"2024-09-15T22:35:11.858199+0000","last_became_active":"2024-09-15T22:09:21.456858+0000","last_became_peered":"2024-09-15T22:09:21.456858+0000","last_unstale":"2024-09-15T22:35:11.858199+0000","last_undegraded":"2024-09-15T22:35:11.858199+0000","last_fullsized":"2024-09-15T22:35:11.858199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3833","last_scrub_stamp":"2024-09-15T22:35:11.858068+0000","last_deep_scrub":"27'3833","last_deep_scrub_stamp":"2024-09-15T22:35:11.858068+0000","last_clean_scrub_stamp":"2024-09-15T22:35:11.858068+0000","objects_scrubbed":0,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:09.783182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2989,"num_write_kb":154181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'860","reported_seq":905,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:04.694029+0000","last_change":"2024-09-15T22:35:04.694056+0000","last_active":"2024-09-15T22:35:04.694029+0000","last_peered":"2024-09-15T22:35:04.694029+0000","last_clean":"2024-09-15T22:35:04.694029+0000","last_became_active":"2024-09-15T22:09:17.409905+0000","last_became_peered":"2024-09-15T22:09:17.409905+0000","last_unstale":"2024-09-15T22:35:04.694029+0000","last_undegraded":"2024-09-15T22:35:04.694029+0000","last_fullsized":"2024-09-15T22:35:04.694029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'860","last_scrub_stamp":"2024-09-15T22:35:04.693939+0000","last_deep_scrub":"27'860","last_deep_scrub_stamp":"2024-09-15T22:35:04.693939+0000","last_clean_scrub_stamp":"2024-09-15T22:35:04.693939+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:25.927260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'3962","reported_seq":4010,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:06.496952+0000","last_change":"2024-09-15T22:35:06.496952+0000","last_active":"2024-09-15T22:35:06.496952+0000","last_peered":"2024-09-15T22:35:06.496952+0000","last_clean":"2024-09-15T22:35:06.496952+0000","last_became_active":"2024-09-15T22:09:16.408793+0000","last_became_peered":"2024-09-15T22:09:16.408793+0000","last_unstale":"2024-09-15T22:35:06.496952+0000","last_undegraded":"2024-09-15T22:35:06.496952+0000","last_fullsized":"2024-09-15T22:35:06.496952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3962","last_scrub_stamp":"2024-09-15T22:35:06.496860+0000","last_deep_scrub":"27'3962","last_deep_scrub_stamp":"2024-09-15T22:35:06.496860+0000","last_clean_scrub_stamp":"2024-09-15T22:35:06.496860+0000","objects_scrubbed":3,"log_size":3962,"log_dups_size":0,"ondisk_log_size":3962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:29.709614+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3958,"num_write_kb":30646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'3858","reported_seq":3896,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:11.517156+0000","last_change":"2024-09-15T22:35:11.517196+0000","last_active":"2024-09-15T22:35:11.517156+0000","last_peered":"2024-09-15T22:35:11.517156+0000","last_clean":"2024-09-15T22:35:11.517156+0000","last_became_active":"2024-09-15T22:09:21.456416+0000","last_became_peered":"2024-09-15T22:09:21.456416+0000","last_unstale":"2024-09-15T22:35:11.517156+0000","last_undegraded":"2024-09-15T22:35:11.517156+0000","last_fullsized":"2024-09-15T22:35:11.517156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3858","last_scrub_stamp":"2024-09-15T22:35:11.517066+0000","last_deep_scrub":"27'3858","last_deep_scrub_stamp":"2024-09-15T22:35:11.517066+0000","last_clean_scrub_stamp":"2024-09-15T22:35:11.517066+0000","objects_scrubbed":0,"log_size":3858,"log_dups_size":0,"ondisk_log_size":3858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:07.606805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2949,"num_write_kb":92106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'903","reported_seq":934,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:05.998442+0000","last_change":"2024-09-15T22:35:05.998469+0000","last_active":"2024-09-15T22:35:05.998442+0000","last_peered":"2024-09-15T22:35:05.998442+0000","last_clean":"2024-09-15T22:35:05.998442+0000","last_became_active":"2024-09-15T22:09:59.531667+0000","last_became_peered":"2024-09-15T22:09:59.531667+0000","last_unstale":"2024-09-15T22:35:05.998442+0000","last_undegraded":"2024-09-15T22:35:05.998442+0000","last_fullsized":"2024-09-15T22:35:05.998442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'903","last_scrub_stamp":"2024-09-15T22:35:05.998337+0000","last_deep_scrub":"27'903","last_deep_scrub_stamp":"2024-09-15T22:35:05.998337+0000","last_clean_scrub_stamp":"2024-09-15T22:35:05.998337+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:44.644307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'2201","reported_seq":2248,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:00.985508+0000","last_change":"2024-09-15T22:35:00.985533+0000","last_active":"2024-09-15T22:35:00.985508+0000","last_peered":"2024-09-15T22:35:00.985508+0000","last_clean":"2024-09-15T22:35:00.985508+0000","last_became_active":"2024-09-15T22:09:16.401328+0000","last_became_peered":"2024-09-15T22:09:16.401328+0000","last_unstale":"2024-09-15T22:35:00.985508+0000","last_undegraded":"2024-09-15T22:35:00.985508+0000","last_fullsized":"2024-09-15T22:35:00.985508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2201","last_scrub_stamp":"2024-09-15T22:35:00.985445+0000","last_deep_scrub":"27'2201","last_deep_scrub_stamp":"2024-09-15T22:35:00.985445+0000","last_clean_scrub_stamp":"2024-09-15T22:35:00.985445+0000","objects_scrubbed":2,"log_size":2201,"log_dups_size":0,"ondisk_log_size":2201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:40.162206+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2201,"num_write_kb":17467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":206,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:01.353056+0000","last_change":"2024-09-15T22:35:01.353056+0000","last_active":"2024-09-15T22:35:01.353056+0000","last_peered":"2024-09-15T22:35:01.353056+0000","last_clean":"2024-09-15T22:35:01.353056+0000","last_became_active":"2024-09-15T22:09:07.243223+0000","last_became_peered":"2024-09-15T22:09:07.243223+0000","last_unstale":"2024-09-15T22:35:01.353056+0000","last_undegraded":"2024-09-15T22:35:01.353056+0000","last_fullsized":"2024-09-15T22:35:01.353056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-09-15T22:35:01.352972+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-09-15T22:35:01.352972+0000","last_clean_scrub_stamp":"2024-09-15T22:35:01.352972+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:23.493289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'4430","reported_seq":4469,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:12.250616+0000","last_change":"2024-09-15T22:35:12.250639+0000","last_active":"2024-09-15T22:35:12.250616+0000","last_peered":"2024-09-15T22:35:12.250616+0000","last_clean":"2024-09-15T22:35:12.250616+0000","last_became_active":"2024-09-15T22:09:21.453022+0000","last_became_peered":"2024-09-15T22:09:21.453022+0000","last_unstale":"2024-09-15T22:35:12.250616+0000","last_undegraded":"2024-09-15T22:35:12.250616+0000","last_fullsized":"2024-09-15T22:35:12.250616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4430","last_scrub_stamp":"2024-09-15T22:35:12.250549+0000","last_deep_scrub":"27'4430","last_deep_scrub_stamp":"2024-09-15T22:35:12.250549+0000","last_clean_scrub_stamp":"2024-09-15T22:35:12.250549+0000","objects_scrubbed":0,"log_size":4430,"log_dups_size":0,"ondisk_log_size":4430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:25.985428+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3508,"num_write_kb":155329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'902","reported_seq":951,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:16.408184+0000","last_change":"2024-09-15T22:35:16.408223+0000","last_active":"2024-09-15T22:35:16.408184+0000","last_peered":"2024-09-15T22:35:16.408184+0000","last_clean":"2024-09-15T22:35:16.408184+0000","last_became_active":"2024-09-15T22:09:59.533885+0000","last_became_peered":"2024-09-15T22:09:59.533885+0000","last_unstale":"2024-09-15T22:35:16.408184+0000","last_undegraded":"2024-09-15T22:35:16.408184+0000","last_fullsized":"2024-09-15T22:35:16.408184+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'902","last_scrub_stamp":"2024-09-15T22:35:16.408088+0000","last_deep_scrub":"27'902","last_deep_scrub_stamp":"2024-09-15T22:35:16.408088+0000","last_clean_scrub_stamp":"2024-09-15T22:35:16.408088+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:38.799567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'3375","reported_seq":3421,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.029076+0000","last_change":"2024-09-15T22:34:59.029133+0000","last_active":"2024-09-15T22:34:59.029076+0000","last_peered":"2024-09-15T22:34:59.029076+0000","last_clean":"2024-09-15T22:34:59.029076+0000","last_became_active":"2024-09-15T22:09:16.404639+0000","last_became_peered":"2024-09-15T22:09:16.404639+0000","last_unstale":"2024-09-15T22:34:59.029076+0000","last_undegraded":"2024-09-15T22:34:59.029076+0000","last_fullsized":"2024-09-15T22:34:59.029076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3375","last_scrub_stamp":"2024-09-15T22:34:59.028962+0000","last_deep_scrub":"27'3375","last_deep_scrub_stamp":"2024-09-15T22:34:59.028962+0000","last_clean_scrub_stamp":"2024-09-15T22:34:59.028962+0000","objects_scrubbed":4,"log_size":3375,"log_dups_size":0,"ondisk_log_size":3375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:01.174355+0000","scrub_duration":60,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3372,"num_write_kb":30249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'3562","reported_seq":3600,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:14.312392+0000","last_change":"2024-09-15T22:35:14.312435+0000","last_active":"2024-09-15T22:35:14.312392+0000","last_peered":"2024-09-15T22:35:14.312392+0000","last_clean":"2024-09-15T22:35:14.312392+0000","last_became_active":"2024-09-15T22:09:21.456906+0000","last_became_peered":"2024-09-15T22:09:21.456906+0000","last_unstale":"2024-09-15T22:35:14.312392+0000","last_undegraded":"2024-09-15T22:35:14.312392+0000","last_fullsized":"2024-09-15T22:35:14.312392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3562","last_scrub_stamp":"2024-09-15T22:35:14.312306+0000","last_deep_scrub":"27'3562","last_deep_scrub_stamp":"2024-09-15T22:35:14.312306+0000","last_clean_scrub_stamp":"2024-09-15T22:35:14.312306+0000","objects_scrubbed":0,"log_size":3562,"log_dups_size":0,"ondisk_log_size":3562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:58.189309+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2654,"num_write_kb":61277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'891","reported_seq":935,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:09.774770+0000","last_change":"2024-09-15T22:35:09.774811+0000","last_active":"2024-09-15T22:35:09.774770+0000","last_peered":"2024-09-15T22:35:09.774770+0000","last_clean":"2024-09-15T22:35:09.774770+0000","last_became_active":"2024-09-15T22:09:17.415597+0000","last_became_peered":"2024-09-15T22:09:17.415597+0000","last_unstale":"2024-09-15T22:35:09.774770+0000","last_undegraded":"2024-09-15T22:35:09.774770+0000","last_fullsized":"2024-09-15T22:35:09.774770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'891","last_scrub_stamp":"2024-09-15T22:35:09.774662+0000","last_deep_scrub":"27'891","last_deep_scrub_stamp":"2024-09-15T22:35:09.774662+0000","last_clean_scrub_stamp":"2024-09-15T22:35:09.774662+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:24.403584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'4281","reported_seq":4327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.784015+0000","last_change":"2024-09-15T22:34:59.784063+0000","last_active":"2024-09-15T22:34:59.784015+0000","last_peered":"2024-09-15T22:34:59.784015+0000","last_clean":"2024-09-15T22:34:59.784015+0000","last_became_active":"2024-09-15T22:09:16.405433+0000","last_became_peered":"2024-09-15T22:09:16.405433+0000","last_unstale":"2024-09-15T22:34:59.784015+0000","last_undegraded":"2024-09-15T22:34:59.784015+0000","last_fullsized":"2024-09-15T22:34:59.784015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4281","last_scrub_stamp":"2024-09-15T22:34:59.783939+0000","last_deep_scrub":"27'4281","last_deep_scrub_stamp":"2024-09-15T22:34:59.783939+0000","last_clean_scrub_stamp":"2024-09-15T22:34:59.783939+0000","objects_scrubbed":3,"log_size":4281,"log_dups_size":0,"ondisk_log_size":4281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:17.545211+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4278,"num_write_kb":34786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'3805","reported_seq":3850,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:13.499548+0000","last_change":"2024-09-15T22:35:13.499595+0000","last_active":"2024-09-15T22:35:13.499548+0000","last_peered":"2024-09-15T22:35:13.499548+0000","last_clean":"2024-09-15T22:35:13.499548+0000","last_became_active":"2024-09-15T22:09:59.534224+0000","last_became_peered":"2024-09-15T22:09:59.534224+0000","last_unstale":"2024-09-15T22:35:13.499548+0000","last_undegraded":"2024-09-15T22:35:13.499548+0000","last_fullsized":"2024-09-15T22:35:13.499548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3805","last_scrub_stamp":"2024-09-15T22:35:13.499420+0000","last_deep_scrub":"27'3805","last_deep_scrub_stamp":"2024-09-15T22:35:13.499420+0000","last_clean_scrub_stamp":"2024-09-15T22:35:13.499420+0000","objects_scrubbed":0,"log_size":3805,"log_dups_size":0,"ondisk_log_size":3805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:00.917812+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2836,"num_write_kb":60139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'879","reported_seq":923,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:13.462931+0000","last_change":"2024-09-15T22:35:13.462969+0000","last_active":"2024-09-15T22:35:13.462931+0000","last_peered":"2024-09-15T22:35:13.462931+0000","last_clean":"2024-09-15T22:35:13.462931+0000","last_became_active":"2024-09-15T22:09:17.412079+0000","last_became_peered":"2024-09-15T22:09:17.412079+0000","last_unstale":"2024-09-15T22:35:13.462931+0000","last_undegraded":"2024-09-15T22:35:13.462931+0000","last_fullsized":"2024-09-15T22:35:13.462931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'879","last_scrub_stamp":"2024-09-15T22:35:13.462825+0000","last_deep_scrub":"27'879","last_deep_scrub_stamp":"2024-09-15T22:35:13.462825+0000","last_clean_scrub_stamp":"2024-09-15T22:35:13.462825+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:09.552563+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'2412","reported_seq":2458,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:00.028614+0000","last_change":"2024-09-15T22:35:00.028659+0000","last_active":"2024-09-15T22:35:00.028614+0000","last_peered":"2024-09-15T22:35:00.028614+0000","last_clean":"2024-09-15T22:35:00.028614+0000","last_became_active":"2024-09-15T22:09:16.405621+0000","last_became_peered":"2024-09-15T22:09:16.405621+0000","last_unstale":"2024-09-15T22:35:00.028614+0000","last_undegraded":"2024-09-15T22:35:00.028614+0000","last_fullsized":"2024-09-15T22:35:00.028614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2412","last_scrub_stamp":"2024-09-15T22:35:00.028543+0000","last_deep_scrub":"27'2412","last_deep_scrub_stamp":"2024-09-15T22:35:00.028543+0000","last_clean_scrub_stamp":"2024-09-15T22:35:00.028543+0000","objects_scrubbed":3,"log_size":2412,"log_dups_size":0,"ondisk_log_size":2412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:43.457891+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2412,"num_write_kb":21631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'4109","reported_seq":4147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:12.764599+0000","last_change":"2024-09-15T22:35:12.764623+0000","last_active":"2024-09-15T22:35:12.764599+0000","last_peered":"2024-09-15T22:35:12.764599+0000","last_clean":"2024-09-15T22:35:12.764599+0000","last_became_active":"2024-09-15T22:09:21.449244+0000","last_became_peered":"2024-09-15T22:09:21.449244+0000","last_unstale":"2024-09-15T22:35:12.764599+0000","last_undegraded":"2024-09-15T22:35:12.764599+0000","last_fullsized":"2024-09-15T22:35:12.764599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4109","last_scrub_stamp":"2024-09-15T22:35:12.764517+0000","last_deep_scrub":"27'4109","last_deep_scrub_stamp":"2024-09-15T22:35:12.764517+0000","last_clean_scrub_stamp":"2024-09-15T22:35:12.764517+0000","objects_scrubbed":0,"log_size":4109,"log_dups_size":0,"ondisk_log_size":4109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:08.778761+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3191,"num_write_kb":110194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'910","reported_seq":954,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:11.461768+0000","last_change":"2024-09-15T22:35:11.461791+0000","last_active":"2024-09-15T22:35:11.461768+0000","last_peered":"2024-09-15T22:35:11.461768+0000","last_clean":"2024-09-15T22:35:11.461768+0000","last_became_active":"2024-09-15T22:09:17.410176+0000","last_became_peered":"2024-09-15T22:09:17.410176+0000","last_unstale":"2024-09-15T22:35:11.461768+0000","last_undegraded":"2024-09-15T22:35:11.461768+0000","last_fullsized":"2024-09-15T22:35:11.461768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'910","last_scrub_stamp":"2024-09-15T22:35:11.461692+0000","last_deep_scrub":"27'910","last_deep_scrub_stamp":"2024-09-15T22:35:11.461692+0000","last_clean_scrub_stamp":"2024-09-15T22:35:11.461692+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:04.736583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'1506","reported_seq":1552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.648599+0000","last_change":"2024-09-15T22:34:59.648641+0000","last_active":"2024-09-15T22:34:59.648599+0000","last_peered":"2024-09-15T22:34:59.648599+0000","last_clean":"2024-09-15T22:34:59.648599+0000","last_became_active":"2024-09-15T22:09:16.398789+0000","last_became_peered":"2024-09-15T22:09:16.398789+0000","last_unstale":"2024-09-15T22:34:59.648599+0000","last_undegraded":"2024-09-15T22:34:59.648599+0000","last_fullsized":"2024-09-15T22:34:59.648599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1506","last_scrub_stamp":"2024-09-15T22:34:59.648498+0000","last_deep_scrub":"27'1506","last_deep_scrub_stamp":"2024-09-15T22:34:59.648498+0000","last_clean_scrub_stamp":"2024-09-15T22:34:59.648498+0000","objects_scrubbed":2,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:23.497103+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1509,"num_write_kb":13058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'3700","reported_seq":3738,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:06.525660+0000","last_change":"2024-09-15T22:35:06.525684+0000","last_active":"2024-09-15T22:35:06.525660+0000","last_peered":"2024-09-15T22:35:06.525660+0000","last_clean":"2024-09-15T22:35:06.525660+0000","last_became_active":"2024-09-15T22:09:21.447541+0000","last_became_peered":"2024-09-15T22:09:21.447541+0000","last_unstale":"2024-09-15T22:35:06.525660+0000","last_undegraded":"2024-09-15T22:35:06.525660+0000","last_fullsized":"2024-09-15T22:35:06.525660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3700","last_scrub_stamp":"2024-09-15T22:35:06.525594+0000","last_deep_scrub":"27'3700","last_deep_scrub_stamp":"2024-09-15T22:35:06.525594+0000","last_clean_scrub_stamp":"2024-09-15T22:35:06.525594+0000","objects_scrubbed":0,"log_size":3700,"log_dups_size":0,"ondisk_log_size":3700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:59.673328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2791,"num_write_kb":90475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'922","reported_seq":966,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:12.492450+0000","last_change":"2024-09-15T22:35:12.492477+0000","last_active":"2024-09-15T22:35:12.492450+0000","last_peered":"2024-09-15T22:35:12.492450+0000","last_clean":"2024-09-15T22:35:12.492450+0000","last_became_active":"2024-09-15T22:09:17.410431+0000","last_became_peered":"2024-09-15T22:09:17.410431+0000","last_unstale":"2024-09-15T22:35:12.492450+0000","last_undegraded":"2024-09-15T22:35:12.492450+0000","last_fullsized":"2024-09-15T22:35:12.492450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'922","last_scrub_stamp":"2024-09-15T22:35:12.492385+0000","last_deep_scrub":"27'922","last_deep_scrub_stamp":"2024-09-15T22:35:12.492385+0000","last_clean_scrub_stamp":"2024-09-15T22:35:12.492385+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:52.535368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'1792","reported_seq":1838,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:01.010336+0000","last_change":"2024-09-15T22:35:01.010370+0000","last_active":"2024-09-15T22:35:01.010336+0000","last_peered":"2024-09-15T22:35:01.010336+0000","last_clean":"2024-09-15T22:35:01.010336+0000","last_became_active":"2024-09-15T22:09:16.408991+0000","last_became_peered":"2024-09-15T22:09:16.408991+0000","last_unstale":"2024-09-15T22:35:01.010336+0000","last_undegraded":"2024-09-15T22:35:01.010336+0000","last_fullsized":"2024-09-15T22:35:01.010336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1792","last_scrub_stamp":"2024-09-15T22:35:01.010258+0000","last_deep_scrub":"27'1792","last_deep_scrub_stamp":"2024-09-15T22:35:01.010258+0000","last_clean_scrub_stamp":"2024-09-15T22:35:01.010258+0000","objects_scrubbed":5,"log_size":1792,"log_dups_size":0,"ondisk_log_size":1792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:49.691866+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1802,"num_write_kb":13181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'3624","reported_seq":3661,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:10.561629+0000","last_change":"2024-09-15T22:35:10.561657+0000","last_active":"2024-09-15T22:35:10.561629+0000","last_peered":"2024-09-15T22:35:10.561629+0000","last_clean":"2024-09-15T22:35:10.561629+0000","last_became_active":"2024-09-15T22:09:21.453526+0000","last_became_peered":"2024-09-15T22:09:21.453526+0000","last_unstale":"2024-09-15T22:35:10.561629+0000","last_undegraded":"2024-09-15T22:35:10.561629+0000","last_fullsized":"2024-09-15T22:35:10.561629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3624","last_scrub_stamp":"2024-09-15T22:35:10.561537+0000","last_deep_scrub":"27'3624","last_deep_scrub_stamp":"2024-09-15T22:35:10.561537+0000","last_clean_scrub_stamp":"2024-09-15T22:35:10.561537+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:50.604520+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2710,"num_write_kb":101760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'885","reported_seq":929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:05.154506+0000","last_change":"2024-09-15T22:35:05.154552+0000","last_active":"2024-09-15T22:35:05.154506+0000","last_peered":"2024-09-15T22:35:05.154506+0000","last_clean":"2024-09-15T22:35:05.154506+0000","last_became_active":"2024-09-15T22:09:17.404310+0000","last_became_peered":"2024-09-15T22:09:17.404310+0000","last_unstale":"2024-09-15T22:35:05.154506+0000","last_undegraded":"2024-09-15T22:35:05.154506+0000","last_fullsized":"2024-09-15T22:35:05.154506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'885","last_scrub_stamp":"2024-09-15T22:35:05.154426+0000","last_deep_scrub":"27'885","last_deep_scrub_stamp":"2024-09-15T22:35:05.154426+0000","last_clean_scrub_stamp":"2024-09-15T22:35:05.154426+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:08.462903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'964","reported_seq":1010,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:01.141886+0000","last_change":"2024-09-15T22:35:01.141929+0000","last_active":"2024-09-15T22:35:01.141886+0000","last_peered":"2024-09-15T22:35:01.141886+0000","last_clean":"2024-09-15T22:35:01.141886+0000","last_became_active":"2024-09-15T22:09:16.403137+0000","last_became_peered":"2024-09-15T22:09:16.403137+0000","last_unstale":"2024-09-15T22:35:01.141886+0000","last_undegraded":"2024-09-15T22:35:01.141886+0000","last_fullsized":"2024-09-15T22:35:01.141886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'964","last_scrub_stamp":"2024-09-15T22:35:01.141796+0000","last_deep_scrub":"27'964","last_deep_scrub_stamp":"2024-09-15T22:35:01.141796+0000","last_clean_scrub_stamp":"2024-09-15T22:35:01.141796+0000","objects_scrubbed":1,"log_size":964,"log_dups_size":0,"ondisk_log_size":964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:36.990500+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":974,"num_write_kb":8662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'3775","reported_seq":3812,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:15.332474+0000","last_change":"2024-09-15T22:35:15.332523+0000","last_active":"2024-09-15T22:35:15.332474+0000","last_peered":"2024-09-15T22:35:15.332474+0000","last_clean":"2024-09-15T22:35:15.332474+0000","last_became_active":"2024-09-15T22:09:21.451016+0000","last_became_peered":"2024-09-15T22:09:21.451016+0000","last_unstale":"2024-09-15T22:35:15.332474+0000","last_undegraded":"2024-09-15T22:35:15.332474+0000","last_fullsized":"2024-09-15T22:35:15.332474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3775","last_scrub_stamp":"2024-09-15T22:35:15.332378+0000","last_deep_scrub":"27'3775","last_deep_scrub_stamp":"2024-09-15T22:35:15.332378+0000","last_clean_scrub_stamp":"2024-09-15T22:35:15.332378+0000","objects_scrubbed":0,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:16.498319+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2843,"num_write_kb":133663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'906","reported_seq":950,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:14.414866+0000","last_change":"2024-09-15T22:35:14.414903+0000","last_active":"2024-09-15T22:35:14.414866+0000","last_peered":"2024-09-15T22:35:14.414866+0000","last_clean":"2024-09-15T22:35:14.414866+0000","last_became_active":"2024-09-15T22:09:17.412680+0000","last_became_peered":"2024-09-15T22:09:17.412680+0000","last_unstale":"2024-09-15T22:35:14.414866+0000","last_undegraded":"2024-09-15T22:35:14.414866+0000","last_fullsized":"2024-09-15T22:35:14.414866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'906","last_scrub_stamp":"2024-09-15T22:35:14.414771+0000","last_deep_scrub":"27'906","last_deep_scrub_stamp":"2024-09-15T22:35:14.414771+0000","last_clean_scrub_stamp":"2024-09-15T22:35:14.414771+0000","objects_scrubbed":0,"log_size":906,"log_dups_size":0,"ondisk_log_size":906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:42:15.186558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'444","reported_seq":490,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:03.878648+0000","last_change":"2024-09-15T22:35:03.878690+0000","last_active":"2024-09-15T22:35:03.878648+0000","last_peered":"2024-09-15T22:35:03.878648+0000","last_clean":"2024-09-15T22:35:03.878648+0000","last_became_active":"2024-09-15T22:09:16.406550+0000","last_became_peered":"2024-09-15T22:09:16.406550+0000","last_unstale":"2024-09-15T22:35:03.878648+0000","last_undegraded":"2024-09-15T22:35:03.878648+0000","last_fullsized":"2024-09-15T22:35:03.878648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'444","last_scrub_stamp":"2024-09-15T22:35:03.878575+0000","last_deep_scrub":"27'444","last_deep_scrub_stamp":"2024-09-15T22:35:03.878575+0000","last_clean_scrub_stamp":"2024-09-15T22:35:03.878575+0000","objects_scrubbed":1,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:21.575908+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":462,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'4060","reported_seq":4098,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:14.326910+0000","last_change":"2024-09-15T22:35:14.326956+0000","last_active":"2024-09-15T22:35:14.326910+0000","last_peered":"2024-09-15T22:35:14.326910+0000","last_clean":"2024-09-15T22:35:14.326910+0000","last_became_active":"2024-09-15T22:09:21.450200+0000","last_became_peered":"2024-09-15T22:09:21.450200+0000","last_unstale":"2024-09-15T22:35:14.326910+0000","last_undegraded":"2024-09-15T22:35:14.326910+0000","last_fullsized":"2024-09-15T22:35:14.326910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4060","last_scrub_stamp":"2024-09-15T22:35:14.326773+0000","last_deep_scrub":"27'4060","last_deep_scrub_stamp":"2024-09-15T22:35:14.326773+0000","last_clean_scrub_stamp":"2024-09-15T22:35:14.326773+0000","objects_scrubbed":0,"log_size":4060,"log_dups_size":0,"ondisk_log_size":4060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:28.495269+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3182,"num_write_kb":92617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'876","reported_seq":920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:07.621959+0000","last_change":"2024-09-15T22:35:07.621992+0000","last_active":"2024-09-15T22:35:07.621959+0000","last_peered":"2024-09-15T22:35:07.621959+0000","last_clean":"2024-09-15T22:35:07.621959+0000","last_became_active":"2024-09-15T22:09:17.420802+0000","last_became_peered":"2024-09-15T22:09:17.420802+0000","last_unstale":"2024-09-15T22:35:07.621959+0000","last_undegraded":"2024-09-15T22:35:07.621959+0000","last_fullsized":"2024-09-15T22:35:07.621959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'876","last_scrub_stamp":"2024-09-15T22:35:07.621842+0000","last_deep_scrub":"27'876","last_deep_scrub_stamp":"2024-09-15T22:35:07.621842+0000","last_clean_scrub_stamp":"2024-09-15T22:35:07.621842+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:29.953832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'2261","reported_seq":2307,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:58.664551+0000","last_change":"2024-09-15T22:34:58.664551+0000","last_active":"2024-09-15T22:34:58.664551+0000","last_peered":"2024-09-15T22:34:58.664551+0000","last_clean":"2024-09-15T22:34:58.664551+0000","last_became_active":"2024-09-15T22:09:16.394355+0000","last_became_peered":"2024-09-15T22:09:16.394355+0000","last_unstale":"2024-09-15T22:34:58.664551+0000","last_undegraded":"2024-09-15T22:34:58.664551+0000","last_fullsized":"2024-09-15T22:34:58.664551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2261","last_scrub_stamp":"2024-09-15T22:34:58.664448+0000","last_deep_scrub":"27'2261","last_deep_scrub_stamp":"2024-09-15T22:34:58.664448+0000","last_clean_scrub_stamp":"2024-09-15T22:34:58.664448+0000","objects_scrubbed":3,"log_size":2261,"log_dups_size":0,"ondisk_log_size":2261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:06.234732+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2267,"num_write_kb":17573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'3672","reported_seq":3709,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:13.753849+0000","last_change":"2024-09-15T22:35:13.753901+0000","last_active":"2024-09-15T22:35:13.753849+0000","last_peered":"2024-09-15T22:35:13.753849+0000","last_clean":"2024-09-15T22:35:13.753849+0000","last_became_active":"2024-09-15T22:09:21.453992+0000","last_became_peered":"2024-09-15T22:09:21.453992+0000","last_unstale":"2024-09-15T22:35:13.753849+0000","last_undegraded":"2024-09-15T22:35:13.753849+0000","last_fullsized":"2024-09-15T22:35:13.753849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3672","last_scrub_stamp":"2024-09-15T22:35:13.753767+0000","last_deep_scrub":"27'3672","last_deep_scrub_stamp":"2024-09-15T22:35:13.753767+0000","last_clean_scrub_stamp":"2024-09-15T22:35:13.753767+0000","objects_scrubbed":0,"log_size":3672,"log_dups_size":0,"ondisk_log_size":3672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:42:14.525554+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2764,"num_write_kb":64906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'863","reported_seq":906,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:09.458408+0000","last_change":"2024-09-15T22:35:09.458456+0000","last_active":"2024-09-15T22:35:09.458408+0000","last_peered":"2024-09-15T22:35:09.458408+0000","last_clean":"2024-09-15T22:35:09.458408+0000","last_became_active":"2024-09-15T22:09:17.403899+0000","last_became_peered":"2024-09-15T22:09:17.403899+0000","last_unstale":"2024-09-15T22:35:09.458408+0000","last_undegraded":"2024-09-15T22:35:09.458408+0000","last_fullsized":"2024-09-15T22:35:09.458408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'863","last_scrub_stamp":"2024-09-15T22:35:09.458331+0000","last_deep_scrub":"27'863","last_deep_scrub_stamp":"2024-09-15T22:35:09.458331+0000","last_clean_scrub_stamp":"2024-09-15T22:35:09.458331+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:29.486750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'4000","reported_seq":4046,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:02.213189+0000","last_change":"2024-09-15T22:35:02.213236+0000","last_active":"2024-09-15T22:35:02.213189+0000","last_peered":"2024-09-15T22:35:02.213189+0000","last_clean":"2024-09-15T22:35:02.213189+0000","last_became_active":"2024-09-15T22:09:16.403624+0000","last_became_peered":"2024-09-15T22:09:16.403624+0000","last_unstale":"2024-09-15T22:35:02.213189+0000","last_undegraded":"2024-09-15T22:35:02.213189+0000","last_fullsized":"2024-09-15T22:35:02.213189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4000","last_scrub_stamp":"2024-09-15T22:35:02.213066+0000","last_deep_scrub":"27'4000","last_deep_scrub_stamp":"2024-09-15T22:35:02.213066+0000","last_clean_scrub_stamp":"2024-09-15T22:35:02.213066+0000","objects_scrubbed":5,"log_size":4000,"log_dups_size":0,"ondisk_log_size":4000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:04.952438+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3999,"num_write_kb":30696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'3842","reported_seq":3880,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:10.869075+0000","last_change":"2024-09-15T22:35:10.869117+0000","last_active":"2024-09-15T22:35:10.869075+0000","last_peered":"2024-09-15T22:35:10.869075+0000","last_clean":"2024-09-15T22:35:10.869075+0000","last_became_active":"2024-09-15T22:09:21.451617+0000","last_became_peered":"2024-09-15T22:09:21.451617+0000","last_unstale":"2024-09-15T22:35:10.869075+0000","last_undegraded":"2024-09-15T22:35:10.869075+0000","last_fullsized":"2024-09-15T22:35:10.869075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3842","last_scrub_stamp":"2024-09-15T22:35:10.868980+0000","last_deep_scrub":"27'3842","last_deep_scrub_stamp":"2024-09-15T22:35:10.868980+0000","last_clean_scrub_stamp":"2024-09-15T22:35:10.868980+0000","objects_scrubbed":0,"log_size":3842,"log_dups_size":0,"ondisk_log_size":3842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:13.407666+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2980,"num_write_kb":152763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'896","reported_seq":940,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:00.615491+0000","last_change":"2024-09-15T22:35:00.615513+0000","last_active":"2024-09-15T22:35:00.615491+0000","last_peered":"2024-09-15T22:35:00.615491+0000","last_clean":"2024-09-15T22:35:00.615491+0000","last_became_active":"2024-09-15T22:09:17.398881+0000","last_became_peered":"2024-09-15T22:09:17.398881+0000","last_unstale":"2024-09-15T22:35:00.615491+0000","last_undegraded":"2024-09-15T22:35:00.615491+0000","last_fullsized":"2024-09-15T22:35:00.615491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'896","last_scrub_stamp":"2024-09-15T22:35:00.615423+0000","last_deep_scrub":"27'896","last_deep_scrub_stamp":"2024-09-15T22:35:00.615423+0000","last_clean_scrub_stamp":"2024-09-15T22:35:00.615423+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:56.781403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'4323","reported_seq":4368,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:01.753782+0000","last_change":"2024-09-15T22:35:01.753811+0000","last_active":"2024-09-15T22:35:01.753782+0000","last_peered":"2024-09-15T22:35:01.753782+0000","last_clean":"2024-09-15T22:35:01.753782+0000","last_became_active":"2024-09-15T22:09:16.408064+0000","last_became_peered":"2024-09-15T22:09:16.408064+0000","last_unstale":"2024-09-15T22:35:01.753782+0000","last_undegraded":"2024-09-15T22:35:01.753782+0000","last_fullsized":"2024-09-15T22:35:01.753782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4323","last_scrub_stamp":"2024-09-15T22:35:01.753700+0000","last_deep_scrub":"27'4323","last_deep_scrub_stamp":"2024-09-15T22:35:01.753700+0000","last_clean_scrub_stamp":"2024-09-15T22:35:01.753700+0000","objects_scrubbed":2,"log_size":4323,"log_dups_size":0,"ondisk_log_size":4323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:22.058017+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4321,"num_write_kb":23285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'4245","reported_seq":4283,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:11.535878+0000","last_change":"2024-09-15T22:35:11.535900+0000","last_active":"2024-09-15T22:35:11.535878+0000","last_peered":"2024-09-15T22:35:11.535878+0000","last_clean":"2024-09-15T22:35:11.535878+0000","last_became_active":"2024-09-15T22:09:21.454907+0000","last_became_peered":"2024-09-15T22:09:21.454907+0000","last_unstale":"2024-09-15T22:35:11.535878+0000","last_undegraded":"2024-09-15T22:35:11.535878+0000","last_fullsized":"2024-09-15T22:35:11.535878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4245","last_scrub_stamp":"2024-09-15T22:35:11.535812+0000","last_deep_scrub":"27'4245","last_deep_scrub_stamp":"2024-09-15T22:35:11.535812+0000","last_clean_scrub_stamp":"2024-09-15T22:35:11.535812+0000","objects_scrubbed":0,"log_size":4245,"log_dups_size":0,"ondisk_log_size":4245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:31.564231+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3329,"num_write_kb":357256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'888","reported_seq":931,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:05.670500+0000","last_change":"2024-09-15T22:35:05.670529+0000","last_active":"2024-09-15T22:35:05.670500+0000","last_peered":"2024-09-15T22:35:05.670500+0000","last_clean":"2024-09-15T22:35:05.670500+0000","last_became_active":"2024-09-15T22:09:17.414951+0000","last_became_peered":"2024-09-15T22:09:17.414951+0000","last_unstale":"2024-09-15T22:35:05.670500+0000","last_undegraded":"2024-09-15T22:35:05.670500+0000","last_fullsized":"2024-09-15T22:35:05.670500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'888","last_scrub_stamp":"2024-09-15T22:35:05.670398+0000","last_deep_scrub":"27'888","last_deep_scrub_stamp":"2024-09-15T22:35:05.670398+0000","last_clean_scrub_stamp":"2024-09-15T22:35:05.670398+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:28.883152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3259","reported_seq":3304,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:01.932059+0000","last_change":"2024-09-15T22:35:01.932086+0000","last_active":"2024-09-15T22:35:01.932059+0000","last_peered":"2024-09-15T22:35:01.932059+0000","last_clean":"2024-09-15T22:35:01.932059+0000","last_became_active":"2024-09-15T22:09:16.405230+0000","last_became_peered":"2024-09-15T22:09:16.405230+0000","last_unstale":"2024-09-15T22:35:01.932059+0000","last_undegraded":"2024-09-15T22:35:01.932059+0000","last_fullsized":"2024-09-15T22:35:01.932059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3259","last_scrub_stamp":"2024-09-15T22:35:01.931995+0000","last_deep_scrub":"27'3259","last_deep_scrub_stamp":"2024-09-15T22:35:01.931995+0000","last_clean_scrub_stamp":"2024-09-15T22:35:01.931995+0000","objects_scrubbed":1,"log_size":3259,"log_dups_size":0,"ondisk_log_size":3259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:05.240472+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3257,"num_write_kb":26116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'3612","reported_seq":3650,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:13.310764+0000","last_change":"2024-09-15T22:35:13.310791+0000","last_active":"2024-09-15T22:35:13.310764+0000","last_peered":"2024-09-15T22:35:13.310764+0000","last_clean":"2024-09-15T22:35:13.310764+0000","last_became_active":"2024-09-15T22:09:21.449896+0000","last_became_peered":"2024-09-15T22:09:21.449896+0000","last_unstale":"2024-09-15T22:35:13.310764+0000","last_undegraded":"2024-09-15T22:35:13.310764+0000","last_fullsized":"2024-09-15T22:35:13.310764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3612","last_scrub_stamp":"2024-09-15T22:35:13.310672+0000","last_deep_scrub":"27'3612","last_deep_scrub_stamp":"2024-09-15T22:35:13.310672+0000","last_clean_scrub_stamp":"2024-09-15T22:35:13.310672+0000","objects_scrubbed":0,"log_size":3612,"log_dups_size":0,"ondisk_log_size":3612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:35.702150+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2735,"num_write_kb":71213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'873","reported_seq":916,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:11.773605+0000","last_change":"2024-09-15T22:35:11.773643+0000","last_active":"2024-09-15T22:35:11.773605+0000","last_peered":"2024-09-15T22:35:11.773605+0000","last_clean":"2024-09-15T22:35:11.773605+0000","last_became_active":"2024-09-15T22:09:17.422401+0000","last_became_peered":"2024-09-15T22:09:17.422401+0000","last_unstale":"2024-09-15T22:35:11.773605+0000","last_undegraded":"2024-09-15T22:35:11.773605+0000","last_fullsized":"2024-09-15T22:35:11.773605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'873","last_scrub_stamp":"2024-09-15T22:35:11.773520+0000","last_deep_scrub":"27'873","last_deep_scrub_stamp":"2024-09-15T22:35:11.773520+0000","last_clean_scrub_stamp":"2024-09-15T22:35:11.773520+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:59.161308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2848","reported_seq":3589,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:03.215520+0000","last_change":"2024-09-15T22:35:03.215550+0000","last_active":"2024-09-15T22:35:03.215520+0000","last_peered":"2024-09-15T22:35:03.215520+0000","last_clean":"2024-09-15T22:35:03.215520+0000","last_became_active":"2024-09-15T22:09:16.405208+0000","last_became_peered":"2024-09-15T22:09:16.405208+0000","last_unstale":"2024-09-15T22:35:03.215520+0000","last_undegraded":"2024-09-15T22:35:03.215520+0000","last_fullsized":"2024-09-15T22:35:03.215520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2848","last_scrub_stamp":"2024-09-15T22:35:03.215458+0000","last_deep_scrub":"27'2848","last_deep_scrub_stamp":"2024-09-15T22:35:03.215458+0000","last_clean_scrub_stamp":"2024-09-15T22:35:03.215458+0000","objects_scrubbed":5,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:07.973023+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18685136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":696,"num_read_kb":2335,"num_write":2846,"num_write_kb":23873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'3807","reported_seq":3845,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:11.308598+0000","last_change":"2024-09-15T22:35:11.308641+0000","last_active":"2024-09-15T22:35:11.308598+0000","last_peered":"2024-09-15T22:35:11.308598+0000","last_clean":"2024-09-15T22:35:11.308598+0000","last_became_active":"2024-09-15T22:09:21.448356+0000","last_became_peered":"2024-09-15T22:09:21.448356+0000","last_unstale":"2024-09-15T22:35:11.308598+0000","last_undegraded":"2024-09-15T22:35:11.308598+0000","last_fullsized":"2024-09-15T22:35:11.308598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3807","last_scrub_stamp":"2024-09-15T22:35:11.308513+0000","last_deep_scrub":"27'3807","last_deep_scrub_stamp":"2024-09-15T22:35:11.308513+0000","last_clean_scrub_stamp":"2024-09-15T22:35:11.308513+0000","objects_scrubbed":0,"log_size":3807,"log_dups_size":0,"ondisk_log_size":3807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:38.098520+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2897,"num_write_kb":187512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'3625","reported_seq":3664,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:12.533114+0000","last_change":"2024-09-15T22:35:12.533143+0000","last_active":"2024-09-15T22:35:12.533114+0000","last_peered":"2024-09-15T22:35:12.533114+0000","last_clean":"2024-09-15T22:35:12.533114+0000","last_became_active":"2024-09-15T22:09:21.458418+0000","last_became_peered":"2024-09-15T22:09:21.458418+0000","last_unstale":"2024-09-15T22:35:12.533114+0000","last_undegraded":"2024-09-15T22:35:12.533114+0000","last_fullsized":"2024-09-15T22:35:12.533114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3625","last_scrub_stamp":"2024-09-15T22:35:12.533022+0000","last_deep_scrub":"27'3625","last_deep_scrub_stamp":"2024-09-15T22:35:12.533022+0000","last_clean_scrub_stamp":"2024-09-15T22:35:12.533022+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:42:13.304809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2737,"num_write_kb":87535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'902","reported_seq":945,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:58.744505+0000","last_change":"2024-09-15T22:34:58.744529+0000","last_active":"2024-09-15T22:34:58.744505+0000","last_peered":"2024-09-15T22:34:58.744505+0000","last_clean":"2024-09-15T22:34:58.744505+0000","last_became_active":"2024-09-15T22:09:17.400754+0000","last_became_peered":"2024-09-15T22:09:17.400754+0000","last_unstale":"2024-09-15T22:34:58.744505+0000","last_undegraded":"2024-09-15T22:34:58.744505+0000","last_fullsized":"2024-09-15T22:34:58.744505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'902","last_scrub_stamp":"2024-09-15T22:34:58.744440+0000","last_deep_scrub":"27'902","last_deep_scrub_stamp":"2024-09-15T22:34:58.744440+0000","last_clean_scrub_stamp":"2024-09-15T22:34:58.744440+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:53.025149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'4406","reported_seq":4451,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:02.919324+0000","last_change":"2024-09-15T22:35:02.919370+0000","last_active":"2024-09-15T22:35:02.919324+0000","last_peered":"2024-09-15T22:35:02.919324+0000","last_clean":"2024-09-15T22:35:02.919324+0000","last_became_active":"2024-09-15T22:09:16.404694+0000","last_became_peered":"2024-09-15T22:09:16.404694+0000","last_unstale":"2024-09-15T22:35:02.919324+0000","last_undegraded":"2024-09-15T22:35:02.919324+0000","last_fullsized":"2024-09-15T22:35:02.919324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4406","last_scrub_stamp":"2024-09-15T22:35:02.919251+0000","last_deep_scrub":"27'4406","last_deep_scrub_stamp":"2024-09-15T22:35:02.919251+0000","last_clean_scrub_stamp":"2024-09-15T22:35:02.919251+0000","objects_scrubbed":3,"log_size":4406,"log_dups_size":0,"ondisk_log_size":4406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:02.398605+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4404,"num_write_kb":39122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'4168","reported_seq":4207,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:13.282665+0000","last_change":"2024-09-15T22:35:13.282710+0000","last_active":"2024-09-15T22:35:13.282665+0000","last_peered":"2024-09-15T22:35:13.282665+0000","last_clean":"2024-09-15T22:35:13.282665+0000","last_became_active":"2024-09-15T22:09:21.456871+0000","last_became_peered":"2024-09-15T22:09:21.456871+0000","last_unstale":"2024-09-15T22:35:13.282665+0000","last_undegraded":"2024-09-15T22:35:13.282665+0000","last_fullsized":"2024-09-15T22:35:13.282665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4168","last_scrub_stamp":"2024-09-15T22:35:13.282579+0000","last_deep_scrub":"27'4168","last_deep_scrub_stamp":"2024-09-15T22:35:13.282579+0000","last_clean_scrub_stamp":"2024-09-15T22:35:13.282579+0000","objects_scrubbed":0,"log_size":4168,"log_dups_size":0,"ondisk_log_size":4168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:27.911501+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3293,"num_write_kb":221802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'944","reported_seq":987,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:08.286855+0000","last_change":"2024-09-15T22:35:08.286883+0000","last_active":"2024-09-15T22:35:08.286855+0000","last_peered":"2024-09-15T22:35:08.286855+0000","last_clean":"2024-09-15T22:35:08.286855+0000","last_became_active":"2024-09-15T22:09:17.402625+0000","last_became_peered":"2024-09-15T22:09:17.402625+0000","last_unstale":"2024-09-15T22:35:08.286855+0000","last_undegraded":"2024-09-15T22:35:08.286855+0000","last_fullsized":"2024-09-15T22:35:08.286855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'944","last_scrub_stamp":"2024-09-15T22:35:08.286770+0000","last_deep_scrub":"27'944","last_deep_scrub_stamp":"2024-09-15T22:35:08.286770+0000","last_clean_scrub_stamp":"2024-09-15T22:35:08.286770+0000","objects_scrubbed":0,"log_size":944,"log_dups_size":0,"ondisk_log_size":944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:55.674558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'2059","reported_seq":2104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:03.355217+0000","last_change":"2024-09-15T22:35:03.355250+0000","last_active":"2024-09-15T22:35:03.355217+0000","last_peered":"2024-09-15T22:35:03.355217+0000","last_clean":"2024-09-15T22:35:03.355217+0000","last_became_active":"2024-09-15T22:09:16.405561+0000","last_became_peered":"2024-09-15T22:09:16.405561+0000","last_unstale":"2024-09-15T22:35:03.355217+0000","last_undegraded":"2024-09-15T22:35:03.355217+0000","last_fullsized":"2024-09-15T22:35:03.355217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2059","last_scrub_stamp":"2024-09-15T22:35:03.355119+0000","last_deep_scrub":"27'2059","last_deep_scrub_stamp":"2024-09-15T22:35:03.355119+0000","last_clean_scrub_stamp":"2024-09-15T22:35:03.355119+0000","objects_scrubbed":3,"log_size":2059,"log_dups_size":0,"ondisk_log_size":2059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:27.496619+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2062,"num_write_kb":17437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4668","reported_seq":4713,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:00.104469+0000","last_change":"2024-09-15T22:35:00.104511+0000","last_active":"2024-09-15T22:35:00.104469+0000","last_peered":"2024-09-15T22:35:00.104469+0000","last_clean":"2024-09-15T22:35:00.104469+0000","last_became_active":"2024-09-15T22:09:16.403172+0000","last_became_peered":"2024-09-15T22:09:16.403172+0000","last_unstale":"2024-09-15T22:35:00.104469+0000","last_undegraded":"2024-09-15T22:35:00.104469+0000","last_fullsized":"2024-09-15T22:35:00.104469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4668","last_scrub_stamp":"2024-09-15T22:35:00.104378+0000","last_deep_scrub":"27'4668","last_deep_scrub_stamp":"2024-09-15T22:35:00.104378+0000","last_clean_scrub_stamp":"2024-09-15T22:35:00.104378+0000","objects_scrubbed":1,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:23.952982+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4675,"num_write_kb":35111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'885","reported_seq":928,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:06.624165+0000","last_change":"2024-09-15T22:35:06.624233+0000","last_active":"2024-09-15T22:35:06.624165+0000","last_peered":"2024-09-15T22:35:06.624165+0000","last_clean":"2024-09-15T22:35:06.624165+0000","last_became_active":"2024-09-15T22:09:17.416102+0000","last_became_peered":"2024-09-15T22:09:17.416102+0000","last_unstale":"2024-09-15T22:35:06.624165+0000","last_undegraded":"2024-09-15T22:35:06.624165+0000","last_fullsized":"2024-09-15T22:35:06.624165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'885","last_scrub_stamp":"2024-09-15T22:35:06.624022+0000","last_deep_scrub":"27'885","last_deep_scrub_stamp":"2024-09-15T22:35:06.624022+0000","last_clean_scrub_stamp":"2024-09-15T22:35:06.624022+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:56.440542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3664","reported_seq":3701,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:03.958231+0000","last_change":"2024-09-15T22:35:03.958260+0000","last_active":"2024-09-15T22:35:03.958231+0000","last_peered":"2024-09-15T22:35:03.958231+0000","last_clean":"2024-09-15T22:35:03.958231+0000","last_became_active":"2024-09-15T22:09:21.448020+0000","last_became_peered":"2024-09-15T22:09:21.448020+0000","last_unstale":"2024-09-15T22:35:03.958231+0000","last_undegraded":"2024-09-15T22:35:03.958231+0000","last_fullsized":"2024-09-15T22:35:03.958231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3664","last_scrub_stamp":"2024-09-15T22:35:03.958126+0000","last_deep_scrub":"27'3664","last_deep_scrub_stamp":"2024-09-15T22:35:03.958126+0000","last_clean_scrub_stamp":"2024-09-15T22:35:03.958126+0000","objects_scrubbed":0,"log_size":3664,"log_dups_size":0,"ondisk_log_size":3664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:16:17.210993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2728,"num_write_kb":145400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1989","reported_seq":2034,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:02.376941+0000","last_change":"2024-09-15T22:35:02.376970+0000","last_active":"2024-09-15T22:35:02.376941+0000","last_peered":"2024-09-15T22:35:02.376941+0000","last_clean":"2024-09-15T22:35:02.376941+0000","last_became_active":"2024-09-15T22:09:16.401040+0000","last_became_peered":"2024-09-15T22:09:16.401040+0000","last_unstale":"2024-09-15T22:35:02.376941+0000","last_undegraded":"2024-09-15T22:35:02.376941+0000","last_fullsized":"2024-09-15T22:35:02.376941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1989","last_scrub_stamp":"2024-09-15T22:35:02.376820+0000","last_deep_scrub":"27'1989","last_deep_scrub_stamp":"2024-09-15T22:35:02.376820+0000","last_clean_scrub_stamp":"2024-09-15T22:35:02.376820+0000","objects_scrubbed":2,"log_size":1989,"log_dups_size":0,"ondisk_log_size":1989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:44.206182+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1992,"num_write_kb":17367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'895","reported_seq":938,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:03.590278+0000","last_change":"2024-09-15T22:35:03.590318+0000","last_active":"2024-09-15T22:35:03.590278+0000","last_peered":"2024-09-15T22:35:03.590278+0000","last_clean":"2024-09-15T22:35:03.590278+0000","last_became_active":"2024-09-15T22:09:17.404772+0000","last_became_peered":"2024-09-15T22:09:17.404772+0000","last_unstale":"2024-09-15T22:35:03.590278+0000","last_undegraded":"2024-09-15T22:35:03.590278+0000","last_fullsized":"2024-09-15T22:35:03.590278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'895","last_scrub_stamp":"2024-09-15T22:35:03.590184+0000","last_deep_scrub":"27'895","last_deep_scrub_stamp":"2024-09-15T22:35:03.590184+0000","last_clean_scrub_stamp":"2024-09-15T22:35:03.590184+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:25.730501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3687","reported_seq":3724,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:17.340898+0000","last_change":"2024-09-15T22:35:17.340947+0000","last_active":"2024-09-15T22:35:17.340898+0000","last_peered":"2024-09-15T22:35:17.340898+0000","last_clean":"2024-09-15T22:35:17.340898+0000","last_became_active":"2024-09-15T22:09:21.457977+0000","last_became_peered":"2024-09-15T22:09:21.457977+0000","last_unstale":"2024-09-15T22:35:17.340898+0000","last_undegraded":"2024-09-15T22:35:17.340898+0000","last_fullsized":"2024-09-15T22:35:17.340898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3687","last_scrub_stamp":"2024-09-15T22:35:17.340796+0000","last_deep_scrub":"27'3687","last_deep_scrub_stamp":"2024-09-15T22:35:17.340796+0000","last_clean_scrub_stamp":"2024-09-15T22:35:17.340796+0000","objects_scrubbed":0,"log_size":3687,"log_dups_size":0,"ondisk_log_size":3687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:20.117193+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2724,"num_write_kb":59138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'900","reported_seq":945,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:06.110969+0000","last_change":"2024-09-15T22:35:06.110992+0000","last_active":"2024-09-15T22:35:06.110969+0000","last_peered":"2024-09-15T22:35:06.110969+0000","last_clean":"2024-09-15T22:35:06.110969+0000","last_became_active":"2024-09-15T22:09:17.405129+0000","last_became_peered":"2024-09-15T22:09:17.405129+0000","last_unstale":"2024-09-15T22:35:06.110969+0000","last_undegraded":"2024-09-15T22:35:06.110969+0000","last_fullsized":"2024-09-15T22:35:06.110969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'900","last_scrub_stamp":"2024-09-15T22:35:06.110900+0000","last_deep_scrub":"27'900","last_deep_scrub_stamp":"2024-09-15T22:35:06.110900+0000","last_clean_scrub_stamp":"2024-09-15T22:35:06.110900+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:05.590254+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'940","reported_seq":985,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:02.954283+0000","last_change":"2024-09-15T22:35:02.954308+0000","last_active":"2024-09-15T22:35:02.954283+0000","last_peered":"2024-09-15T22:35:02.954283+0000","last_clean":"2024-09-15T22:35:02.954283+0000","last_became_active":"2024-09-15T22:09:17.407877+0000","last_became_peered":"2024-09-15T22:09:17.407877+0000","last_unstale":"2024-09-15T22:35:02.954283+0000","last_undegraded":"2024-09-15T22:35:02.954283+0000","last_fullsized":"2024-09-15T22:35:02.954283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'940","last_scrub_stamp":"2024-09-15T22:35:02.954202+0000","last_deep_scrub":"27'940","last_deep_scrub_stamp":"2024-09-15T22:35:02.954202+0000","last_clean_scrub_stamp":"2024-09-15T22:35:02.954202+0000","objects_scrubbed":0,"log_size":940,"log_dups_size":0,"ondisk_log_size":940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:07:28.667910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'881","reported_seq":931,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:14.705440+0000","last_change":"2024-09-15T22:35:14.705494+0000","last_active":"2024-09-15T22:35:14.705440+0000","last_peered":"2024-09-15T22:35:14.705440+0000","last_clean":"2024-09-15T22:35:14.705440+0000","last_became_active":"2024-09-15T22:09:59.534380+0000","last_became_peered":"2024-09-15T22:09:59.534380+0000","last_unstale":"2024-09-15T22:35:14.705440+0000","last_undegraded":"2024-09-15T22:35:14.705440+0000","last_fullsized":"2024-09-15T22:35:14.705440+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'881","last_scrub_stamp":"2024-09-15T22:35:14.705359+0000","last_deep_scrub":"27'881","last_deep_scrub_stamp":"2024-09-15T22:35:14.705359+0000","last_clean_scrub_stamp":"2024-09-15T22:35:14.705359+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:41.495366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'916","reported_seq":961,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:03.649601+0000","last_change":"2024-09-15T22:35:03.649626+0000","last_active":"2024-09-15T22:35:03.649601+0000","last_peered":"2024-09-15T22:35:03.649601+0000","last_clean":"2024-09-15T22:35:03.649601+0000","last_became_active":"2024-09-15T22:09:17.405142+0000","last_became_peered":"2024-09-15T22:09:17.405142+0000","last_unstale":"2024-09-15T22:35:03.649601+0000","last_undegraded":"2024-09-15T22:35:03.649601+0000","last_fullsized":"2024-09-15T22:35:03.649601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'916","last_scrub_stamp":"2024-09-15T22:35:03.649517+0000","last_deep_scrub":"27'916","last_deep_scrub_stamp":"2024-09-15T22:35:03.649517+0000","last_clean_scrub_stamp":"2024-09-15T22:35:03.649517+0000","objects_scrubbed":0,"log_size":916,"log_dups_size":0,"ondisk_log_size":916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:55.426534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'885","reported_seq":930,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:58.410929+0000","last_change":"2024-09-15T22:34:58.410929+0000","last_active":"2024-09-15T22:34:58.410929+0000","last_peered":"2024-09-15T22:34:58.410929+0000","last_clean":"2024-09-15T22:34:58.410929+0000","last_became_active":"2024-09-15T22:09:17.408913+0000","last_became_peered":"2024-09-15T22:09:17.408913+0000","last_unstale":"2024-09-15T22:34:58.410929+0000","last_undegraded":"2024-09-15T22:34:58.410929+0000","last_fullsized":"2024-09-15T22:34:58.410929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'885","last_scrub_stamp":"2024-09-15T22:34:58.410806+0000","last_deep_scrub":"27'885","last_deep_scrub_stamp":"2024-09-15T22:34:58.410806+0000","last_clean_scrub_stamp":"2024-09-15T22:34:58.410806+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:20.551123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'886","reported_seq":931,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:57.759329+0000","last_change":"2024-09-15T22:34:57.759329+0000","last_active":"2024-09-15T22:34:57.759329+0000","last_peered":"2024-09-15T22:34:57.759329+0000","last_clean":"2024-09-15T22:34:57.759329+0000","last_became_active":"2024-09-15T22:09:17.400916+0000","last_became_peered":"2024-09-15T22:09:17.400916+0000","last_unstale":"2024-09-15T22:34:57.759329+0000","last_undegraded":"2024-09-15T22:34:57.759329+0000","last_fullsized":"2024-09-15T22:34:57.759329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'886","last_scrub_stamp":"2024-09-15T22:34:57.759238+0000","last_deep_scrub":"27'886","last_deep_scrub_stamp":"2024-09-15T22:34:57.759238+0000","last_clean_scrub_stamp":"2024-09-15T22:34:57.759238+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:54.306163+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'934","reported_seq":979,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:07.134603+0000","last_change":"2024-09-15T22:35:07.134603+0000","last_active":"2024-09-15T22:35:07.134603+0000","last_peered":"2024-09-15T22:35:07.134603+0000","last_clean":"2024-09-15T22:35:07.134603+0000","last_became_active":"2024-09-15T22:09:17.405319+0000","last_became_peered":"2024-09-15T22:09:17.405319+0000","last_unstale":"2024-09-15T22:35:07.134603+0000","last_undegraded":"2024-09-15T22:35:07.134603+0000","last_fullsized":"2024-09-15T22:35:07.134603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'934","last_scrub_stamp":"2024-09-15T22:35:07.134462+0000","last_deep_scrub":"27'934","last_deep_scrub_stamp":"2024-09-15T22:35:07.134462+0000","last_clean_scrub_stamp":"2024-09-15T22:35:07.134462+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:24.831795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'869","reported_seq":914,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:01.375902+0000","last_change":"2024-09-15T22:35:01.375902+0000","last_active":"2024-09-15T22:35:01.375902+0000","last_peered":"2024-09-15T22:35:01.375902+0000","last_clean":"2024-09-15T22:35:01.375902+0000","last_became_active":"2024-09-15T22:09:17.408949+0000","last_became_peered":"2024-09-15T22:09:17.408949+0000","last_unstale":"2024-09-15T22:35:01.375902+0000","last_undegraded":"2024-09-15T22:35:01.375902+0000","last_fullsized":"2024-09-15T22:35:01.375902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'869","last_scrub_stamp":"2024-09-15T22:35:01.375737+0000","last_deep_scrub":"27'869","last_deep_scrub_stamp":"2024-09-15T22:35:01.375737+0000","last_clean_scrub_stamp":"2024-09-15T22:35:01.375737+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:02.502397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'872","reported_seq":917,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:08.798416+0000","last_change":"2024-09-15T22:35:08.798416+0000","last_active":"2024-09-15T22:35:08.798416+0000","last_peered":"2024-09-15T22:35:08.798416+0000","last_clean":"2024-09-15T22:35:08.798416+0000","last_became_active":"2024-09-15T22:09:17.416170+0000","last_became_peered":"2024-09-15T22:09:17.416170+0000","last_unstale":"2024-09-15T22:35:08.798416+0000","last_undegraded":"2024-09-15T22:35:08.798416+0000","last_fullsized":"2024-09-15T22:35:08.798416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'872","last_scrub_stamp":"2024-09-15T22:35:08.798278+0000","last_deep_scrub":"27'872","last_deep_scrub_stamp":"2024-09-15T22:35:08.798278+0000","last_clean_scrub_stamp":"2024-09-15T22:35:08.798278+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:22.533157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'867","reported_seq":911,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:34:59.449001+0000","last_change":"2024-09-15T22:34:59.449025+0000","last_active":"2024-09-15T22:34:59.449001+0000","last_peered":"2024-09-15T22:34:59.449001+0000","last_clean":"2024-09-15T22:34:59.449001+0000","last_became_active":"2024-09-15T22:09:17.408969+0000","last_became_peered":"2024-09-15T22:09:17.408969+0000","last_unstale":"2024-09-15T22:34:59.449001+0000","last_undegraded":"2024-09-15T22:34:59.449001+0000","last_fullsized":"2024-09-15T22:34:59.449001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'867","last_scrub_stamp":"2024-09-15T22:34:59.448933+0000","last_deep_scrub":"27'867","last_deep_scrub_stamp":"2024-09-15T22:34:59.448933+0000","last_clean_scrub_stamp":"2024-09-15T22:34:59.448933+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:15.000873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'894","reported_seq":938,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:10.748130+0000","last_change":"2024-09-15T22:35:10.748150+0000","last_active":"2024-09-15T22:35:10.748130+0000","last_peered":"2024-09-15T22:35:10.748130+0000","last_clean":"2024-09-15T22:35:10.748130+0000","last_became_active":"2024-09-15T22:09:17.421846+0000","last_became_peered":"2024-09-15T22:09:17.421846+0000","last_unstale":"2024-09-15T22:35:10.748130+0000","last_undegraded":"2024-09-15T22:35:10.748130+0000","last_fullsized":"2024-09-15T22:35:10.748130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'894","last_scrub_stamp":"2024-09-15T22:35:10.748059+0000","last_deep_scrub":"27'894","last_deep_scrub_stamp":"2024-09-15T22:35:10.748059+0000","last_clean_scrub_stamp":"2024-09-15T22:35:10.748059+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:54.625062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'909","reported_seq":953,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:08.582561+0000","last_change":"2024-09-15T22:35:08.582586+0000","last_active":"2024-09-15T22:35:08.582561+0000","last_peered":"2024-09-15T22:35:08.582561+0000","last_clean":"2024-09-15T22:35:08.582561+0000","last_became_active":"2024-09-15T22:09:17.420849+0000","last_became_peered":"2024-09-15T22:09:17.420849+0000","last_unstale":"2024-09-15T22:35:08.582561+0000","last_undegraded":"2024-09-15T22:35:08.582561+0000","last_fullsized":"2024-09-15T22:35:08.582561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'909","last_scrub_stamp":"2024-09-15T22:35:08.582478+0000","last_deep_scrub":"27'909","last_deep_scrub_stamp":"2024-09-15T22:35:08.582478+0000","last_clean_scrub_stamp":"2024-09-15T22:35:08.582478+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:10.761827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'894","reported_seq":938,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:08.153414+0000","last_change":"2024-09-15T22:35:08.153451+0000","last_active":"2024-09-15T22:35:08.153414+0000","last_peered":"2024-09-15T22:35:08.153414+0000","last_clean":"2024-09-15T22:35:08.153414+0000","last_became_active":"2024-09-15T22:09:17.409837+0000","last_became_peered":"2024-09-15T22:09:17.409837+0000","last_unstale":"2024-09-15T22:35:08.153414+0000","last_undegraded":"2024-09-15T22:35:08.153414+0000","last_fullsized":"2024-09-15T22:35:08.153414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'894","last_scrub_stamp":"2024-09-15T22:35:08.153327+0000","last_deep_scrub":"27'894","last_deep_scrub_stamp":"2024-09-15T22:35:08.153327+0000","last_clean_scrub_stamp":"2024-09-15T22:35:08.153327+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:09.279987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'901","reported_seq":931,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:14.906598+0000","last_change":"2024-09-15T22:35:14.906622+0000","last_active":"2024-09-15T22:35:14.906598+0000","last_peered":"2024-09-15T22:35:14.906598+0000","last_clean":"2024-09-15T22:35:14.906598+0000","last_became_active":"2024-09-15T22:09:59.534485+0000","last_became_peered":"2024-09-15T22:09:59.534485+0000","last_unstale":"2024-09-15T22:35:14.906598+0000","last_undegraded":"2024-09-15T22:35:14.906598+0000","last_fullsized":"2024-09-15T22:35:14.906598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'901","last_scrub_stamp":"2024-09-15T22:35:14.906509+0000","last_deep_scrub":"27'901","last_deep_scrub_stamp":"2024-09-15T22:35:14.906509+0000","last_clean_scrub_stamp":"2024-09-15T22:35:14.906509+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:47.991466+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"27'851","reported_seq":895,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:01.959781+0000","last_change":"2024-09-15T22:35:01.959803+0000","last_active":"2024-09-15T22:35:01.959781+0000","last_peered":"2024-09-15T22:35:01.959781+0000","last_clean":"2024-09-15T22:35:01.959781+0000","last_became_active":"2024-09-15T22:09:17.401413+0000","last_became_peered":"2024-09-15T22:09:17.401413+0000","last_unstale":"2024-09-15T22:35:01.959781+0000","last_undegraded":"2024-09-15T22:35:01.959781+0000","last_fullsized":"2024-09-15T22:35:01.959781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'851","last_scrub_stamp":"2024-09-15T22:35:01.959703+0000","last_deep_scrub":"27'851","last_deep_scrub_stamp":"2024-09-15T22:35:01.959703+0000","last_clean_scrub_stamp":"2024-09-15T22:35:01.959703+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:04.867861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'922","reported_seq":951,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:04.973697+0000","last_change":"2024-09-15T22:35:04.973722+0000","last_active":"2024-09-15T22:35:04.973697+0000","last_peered":"2024-09-15T22:35:04.973697+0000","last_clean":"2024-09-15T22:35:04.973697+0000","last_became_active":"2024-09-15T22:09:59.528000+0000","last_became_peered":"2024-09-15T22:09:59.528000+0000","last_unstale":"2024-09-15T22:35:04.973697+0000","last_undegraded":"2024-09-15T22:35:04.973697+0000","last_fullsized":"2024-09-15T22:35:04.973697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'922","last_scrub_stamp":"2024-09-15T22:35:04.973613+0000","last_deep_scrub":"27'922","last_deep_scrub_stamp":"2024-09-15T22:35:04.973613+0000","last_clean_scrub_stamp":"2024-09-15T22:35:04.973613+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:31:05.867656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"27'882","reported_seq":926,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:06.794070+0000","last_change":"2024-09-15T22:35:06.794091+0000","last_active":"2024-09-15T22:35:06.794070+0000","last_peered":"2024-09-15T22:35:06.794070+0000","last_clean":"2024-09-15T22:35:06.794070+0000","last_became_active":"2024-09-15T22:09:17.411244+0000","last_became_peered":"2024-09-15T22:09:17.411244+0000","last_unstale":"2024-09-15T22:35:06.794070+0000","last_undegraded":"2024-09-15T22:35:06.794070+0000","last_fullsized":"2024-09-15T22:35:06.794070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'882","last_scrub_stamp":"2024-09-15T22:35:06.794003+0000","last_deep_scrub":"27'882","last_deep_scrub_stamp":"2024-09-15T22:35:06.794003+0000","last_clean_scrub_stamp":"2024-09-15T22:35:06.794003+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:30.935503+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'910","reported_seq":954,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:08.818896+0000","last_change":"2024-09-15T22:35:08.818922+0000","last_active":"2024-09-15T22:35:08.818896+0000","last_peered":"2024-09-15T22:35:08.818896+0000","last_clean":"2024-09-15T22:35:08.818896+0000","last_became_active":"2024-09-15T22:09:17.409681+0000","last_became_peered":"2024-09-15T22:09:17.409681+0000","last_unstale":"2024-09-15T22:35:08.818896+0000","last_undegraded":"2024-09-15T22:35:08.818896+0000","last_fullsized":"2024-09-15T22:35:08.818896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'910","last_scrub_stamp":"2024-09-15T22:35:08.818819+0000","last_deep_scrub":"27'910","last_deep_scrub_stamp":"2024-09-15T22:35:08.818819+0000","last_clean_scrub_stamp":"2024-09-15T22:35:08.818819+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:24.692191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'858","reported_seq":902,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:01.663644+0000","last_change":"2024-09-15T22:35:01.663671+0000","last_active":"2024-09-15T22:35:01.663644+0000","last_peered":"2024-09-15T22:35:01.663644+0000","last_clean":"2024-09-15T22:35:01.663644+0000","last_became_active":"2024-09-15T22:09:17.403220+0000","last_became_peered":"2024-09-15T22:09:17.403220+0000","last_unstale":"2024-09-15T22:35:01.663644+0000","last_undegraded":"2024-09-15T22:35:01.663644+0000","last_fullsized":"2024-09-15T22:35:01.663644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'858","last_scrub_stamp":"2024-09-15T22:35:01.663574+0000","last_deep_scrub":"27'858","last_deep_scrub_stamp":"2024-09-15T22:35:01.663574+0000","last_clean_scrub_stamp":"2024-09-15T22:35:01.663574+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:17.215514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'870","reported_seq":913,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:06.309020+0000","last_change":"2024-09-15T22:35:06.309047+0000","last_active":"2024-09-15T22:35:06.309020+0000","last_peered":"2024-09-15T22:35:06.309020+0000","last_clean":"2024-09-15T22:35:06.309020+0000","last_became_active":"2024-09-15T22:09:17.400288+0000","last_became_peered":"2024-09-15T22:09:17.400288+0000","last_unstale":"2024-09-15T22:35:06.309020+0000","last_undegraded":"2024-09-15T22:35:06.309020+0000","last_fullsized":"2024-09-15T22:35:06.309020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'870","last_scrub_stamp":"2024-09-15T22:35:06.308937+0000","last_deep_scrub":"27'870","last_deep_scrub_stamp":"2024-09-15T22:35:06.308937+0000","last_clean_scrub_stamp":"2024-09-15T22:35:06.308937+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:20.937859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'857","reported_seq":900,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:02.606818+0000","last_change":"2024-09-15T22:35:02.606839+0000","last_active":"2024-09-15T22:35:02.606818+0000","last_peered":"2024-09-15T22:35:02.606818+0000","last_clean":"2024-09-15T22:35:02.606818+0000","last_became_active":"2024-09-15T22:09:17.404038+0000","last_became_peered":"2024-09-15T22:09:17.404038+0000","last_unstale":"2024-09-15T22:35:02.606818+0000","last_undegraded":"2024-09-15T22:35:02.606818+0000","last_fullsized":"2024-09-15T22:35:02.606818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'857","last_scrub_stamp":"2024-09-15T22:35:02.606743+0000","last_deep_scrub":"27'857","last_deep_scrub_stamp":"2024-09-15T22:35:02.606743+0000","last_clean_scrub_stamp":"2024-09-15T22:35:02.606743+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:07.364308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'885","reported_seq":928,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:11.234958+0000","last_change":"2024-09-15T22:35:11.234978+0000","last_active":"2024-09-15T22:35:11.234958+0000","last_peered":"2024-09-15T22:35:11.234958+0000","last_clean":"2024-09-15T22:35:11.234958+0000","last_became_active":"2024-09-15T22:09:17.415354+0000","last_became_peered":"2024-09-15T22:09:17.415354+0000","last_unstale":"2024-09-15T22:35:11.234958+0000","last_undegraded":"2024-09-15T22:35:11.234958+0000","last_fullsized":"2024-09-15T22:35:11.234958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'885","last_scrub_stamp":"2024-09-15T22:35:11.234889+0000","last_deep_scrub":"27'885","last_deep_scrub_stamp":"2024-09-15T22:35:11.234889+0000","last_clean_scrub_stamp":"2024-09-15T22:35:11.234889+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:00.161351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'874","reported_seq":917,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:10.221792+0000","last_change":"2024-09-15T22:35:10.221814+0000","last_active":"2024-09-15T22:35:10.221792+0000","last_peered":"2024-09-15T22:35:10.221792+0000","last_clean":"2024-09-15T22:35:10.221792+0000","last_became_active":"2024-09-15T22:09:17.414875+0000","last_became_peered":"2024-09-15T22:09:17.414875+0000","last_unstale":"2024-09-15T22:35:10.221792+0000","last_undegraded":"2024-09-15T22:35:10.221792+0000","last_fullsized":"2024-09-15T22:35:10.221792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'874","last_scrub_stamp":"2024-09-15T22:35:10.221679+0000","last_deep_scrub":"27'874","last_deep_scrub_stamp":"2024-09-15T22:35:10.221679+0000","last_clean_scrub_stamp":"2024-09-15T22:35:10.221679+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:34.363179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'913","reported_seq":956,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:15.432160+0000","last_change":"2024-09-15T22:35:15.432202+0000","last_active":"2024-09-15T22:35:15.432160+0000","last_peered":"2024-09-15T22:35:15.432160+0000","last_clean":"2024-09-15T22:35:15.432160+0000","last_became_active":"2024-09-15T22:09:17.419854+0000","last_became_peered":"2024-09-15T22:09:17.419854+0000","last_unstale":"2024-09-15T22:35:15.432160+0000","last_undegraded":"2024-09-15T22:35:15.432160+0000","last_fullsized":"2024-09-15T22:35:15.432160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'913","last_scrub_stamp":"2024-09-15T22:35:15.432088+0000","last_deep_scrub":"27'913","last_deep_scrub_stamp":"2024-09-15T22:35:15.432088+0000","last_clean_scrub_stamp":"2024-09-15T22:35:15.432088+0000","objects_scrubbed":0,"log_size":913,"log_dups_size":0,"ondisk_log_size":913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:02.850480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'862","reported_seq":905,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:00.410125+0000","last_change":"2024-09-15T22:35:00.410164+0000","last_active":"2024-09-15T22:35:00.410125+0000","last_peered":"2024-09-15T22:35:00.410125+0000","last_clean":"2024-09-15T22:35:00.410125+0000","last_became_active":"2024-09-15T22:09:17.414020+0000","last_became_peered":"2024-09-15T22:09:17.414020+0000","last_unstale":"2024-09-15T22:35:00.410125+0000","last_undegraded":"2024-09-15T22:35:00.410125+0000","last_fullsized":"2024-09-15T22:35:00.410125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'862","last_scrub_stamp":"2024-09-15T22:35:00.410028+0000","last_deep_scrub":"27'862","last_deep_scrub_stamp":"2024-09-15T22:35:00.410028+0000","last_clean_scrub_stamp":"2024-09-15T22:35:00.410028+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:52.187045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'898","reported_seq":941,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:10.458389+0000","last_change":"2024-09-15T22:35:10.458419+0000","last_active":"2024-09-15T22:35:10.458389+0000","last_peered":"2024-09-15T22:35:10.458389+0000","last_clean":"2024-09-15T22:35:10.458389+0000","last_became_active":"2024-09-15T22:09:17.404181+0000","last_became_peered":"2024-09-15T22:09:17.404181+0000","last_unstale":"2024-09-15T22:35:10.458389+0000","last_undegraded":"2024-09-15T22:35:10.458389+0000","last_fullsized":"2024-09-15T22:35:10.458389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'898","last_scrub_stamp":"2024-09-15T22:35:10.458327+0000","last_deep_scrub":"27'898","last_deep_scrub_stamp":"2024-09-15T22:35:10.458327+0000","last_clean_scrub_stamp":"2024-09-15T22:35:10.458327+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:21.997412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'835","reported_seq":878,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:07.761717+0000","last_change":"2024-09-15T22:35:07.761761+0000","last_active":"2024-09-15T22:35:07.761717+0000","last_peered":"2024-09-15T22:35:07.761717+0000","last_clean":"2024-09-15T22:35:07.761717+0000","last_became_active":"2024-09-15T22:09:17.413987+0000","last_became_peered":"2024-09-15T22:09:17.413987+0000","last_unstale":"2024-09-15T22:35:07.761717+0000","last_undegraded":"2024-09-15T22:35:07.761717+0000","last_fullsized":"2024-09-15T22:35:07.761717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'835","last_scrub_stamp":"2024-09-15T22:35:07.761599+0000","last_deep_scrub":"27'835","last_deep_scrub_stamp":"2024-09-15T22:35:07.761599+0000","last_clean_scrub_stamp":"2024-09-15T22:35:07.761599+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:56.688061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'918","reported_seq":961,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:08.438577+0000","last_change":"2024-09-15T22:35:08.438616+0000","last_active":"2024-09-15T22:35:08.438577+0000","last_peered":"2024-09-15T22:35:08.438577+0000","last_clean":"2024-09-15T22:35:08.438577+0000","last_became_active":"2024-09-15T22:09:17.399470+0000","last_became_peered":"2024-09-15T22:09:17.399470+0000","last_unstale":"2024-09-15T22:35:08.438577+0000","last_undegraded":"2024-09-15T22:35:08.438577+0000","last_fullsized":"2024-09-15T22:35:08.438577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'918","last_scrub_stamp":"2024-09-15T22:35:08.438483+0000","last_deep_scrub":"27'918","last_deep_scrub_stamp":"2024-09-15T22:35:08.438483+0000","last_clean_scrub_stamp":"2024-09-15T22:35:08.438483+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:30.770473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'877","reported_seq":908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:07.029117+0000","last_change":"2024-09-15T22:35:07.029162+0000","last_active":"2024-09-15T22:35:07.029117+0000","last_peered":"2024-09-15T22:35:07.029117+0000","last_clean":"2024-09-15T22:35:07.029117+0000","last_became_active":"2024-09-15T22:09:59.803657+0000","last_became_peered":"2024-09-15T22:09:59.803657+0000","last_unstale":"2024-09-15T22:35:07.029117+0000","last_undegraded":"2024-09-15T22:35:07.029117+0000","last_fullsized":"2024-09-15T22:35:07.029117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'877","last_scrub_stamp":"2024-09-15T22:35:07.028976+0000","last_deep_scrub":"27'877","last_deep_scrub_stamp":"2024-09-15T22:35:07.028976+0000","last_clean_scrub_stamp":"2024-09-15T22:35:07.028976+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:03.194956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'928","reported_seq":973,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:02.647530+0000","last_change":"2024-09-15T22:35:02.647557+0000","last_active":"2024-09-15T22:35:02.647530+0000","last_peered":"2024-09-15T22:35:02.647530+0000","last_clean":"2024-09-15T22:35:02.647530+0000","last_became_active":"2024-09-15T22:09:17.404301+0000","last_became_peered":"2024-09-15T22:09:17.404301+0000","last_unstale":"2024-09-15T22:35:02.647530+0000","last_undegraded":"2024-09-15T22:35:02.647530+0000","last_fullsized":"2024-09-15T22:35:02.647530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'928","last_scrub_stamp":"2024-09-15T22:35:02.647432+0000","last_deep_scrub":"27'928","last_deep_scrub_stamp":"2024-09-15T22:35:02.647432+0000","last_clean_scrub_stamp":"2024-09-15T22:35:02.647432+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:53.211841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'838","reported_seq":883,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:07.786520+0000","last_change":"2024-09-15T22:35:07.786545+0000","last_active":"2024-09-15T22:35:07.786520+0000","last_peered":"2024-09-15T22:35:07.786520+0000","last_clean":"2024-09-15T22:35:07.786520+0000","last_became_active":"2024-09-15T22:09:17.402632+0000","last_became_peered":"2024-09-15T22:09:17.402632+0000","last_unstale":"2024-09-15T22:35:07.786520+0000","last_undegraded":"2024-09-15T22:35:07.786520+0000","last_fullsized":"2024-09-15T22:35:07.786520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'838","last_scrub_stamp":"2024-09-15T22:35:07.786429+0000","last_deep_scrub":"27'838","last_deep_scrub_stamp":"2024-09-15T22:35:07.786429+0000","last_clean_scrub_stamp":"2024-09-15T22:35:07.786429+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:38:31.206811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'834","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:35:00.359652+0000","last_change":"2024-09-15T22:35:00.359672+0000","last_active":"2024-09-15T22:35:00.359652+0000","last_peered":"2024-09-15T22:35:00.359652+0000","last_clean":"2024-09-15T22:35:00.359652+0000","last_became_active":"2024-09-15T22:09:17.402751+0000","last_became_peered":"2024-09-15T22:09:17.402751+0000","last_unstale":"2024-09-15T22:35:00.359652+0000","last_undegraded":"2024-09-15T22:35:00.359652+0000","last_fullsized":"2024-09-15T22:35:00.359652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'834","last_scrub_stamp":"2024-09-15T22:35:00.359584+0000","last_deep_scrub":"27'834","last_deep_scrub_stamp":"2024-09-15T22:35:00.359584+0000","last_clean_scrub_stamp":"2024-09-15T22:35:00.359584+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:05.117148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93952,"num_write_kb":3592319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123090,"ondisk_log_size":123090,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56939,"ondisk_log_size":56939,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":248864567,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2930,"num_read_kb":7996,"num_write":96424,"num_write_kb":735227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5441,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327417856,"data_stored":497729134,"data_compressed":51451918,"data_compressed_allocated":79175680,"data_compressed_original":249544704,"omap_allocated":0,"internal_metadata":0},"log_size":93592,"ondisk_log_size":93592,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542461,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":548100,"kb_used_data":43636,"kb_used_omap":1,"kb_used_meta":504446,"kb_avail":93823740,"statfs":{"total":96636764160,"available":96075509760,"internally_reserved":0,"allocated":44683264,"data_stored":67817371,"data_compressed":6954037,"data_compressed_allocated":10792960,"data_compressed_original":34103296,"omap_allocated":1590,"internal_metadata":516553162},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542461,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":562988,"kb_used_data":44636,"kb_used_omap":1,"kb_used_meta":518334,"kb_avail":93808852,"statfs":{"total":96636764160,"available":96060264448,"internally_reserved":0,"allocated":45707264,"data_stored":69135013,"data_compressed":7128351,"data_compressed_allocated":10952704,"data_compressed_original":34557952,"omap_allocated":1594,"internal_metadata":530774470},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542462,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":576000,"kb_used_data":61872,"kb_used_omap":1,"kb_used_meta":514110,"kb_avail":93795840,"statfs":{"total":96636764160,"available":96046940160,"internally_reserved":0,"allocated":63356928,"data_stored":97985800,"data_compressed":10458419,"data_compressed_allocated":16003072,"data_compressed_original":50806784,"omap_allocated":1594,"internal_metadata":526449094},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542463,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":450656,"kb_used_data":26640,"kb_used_omap":1,"kb_used_meta":423998,"kb_avail":93921184,"statfs":{"total":96636764160,"available":96175292416,"internally_reserved":0,"allocated":27279360,"data_stored":42060723,"data_compressed":4480082,"data_compressed_allocated":6909952,"data_compressed_original":21872640,"omap_allocated":1595,"internal_metadata":434174405},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542463,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":555356,"kb_used_data":41100,"kb_used_omap":1,"kb_used_meta":514238,"kb_avail":93816484,"statfs":{"total":96636764160,"available":96068079616,"internally_reserved":0,"allocated":42086400,"data_stored":63032789,"data_compressed":6347263,"data_compressed_allocated":9764864,"data_compressed_original":30887936,"omap_allocated":1593,"internal_metadata":526580167},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":336252,"kb_used_data":30188,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94035588,"statfs":{"total":96636764160,"available":96292442112,"internally_reserved":0,"allocated":30912512,"data_stored":46254901,"data_compressed":4726192,"data_compressed_allocated":7282688,"data_compressed_original":22794240,"omap_allocated":1592,"internal_metadata":313391560},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542462,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":399260,"kb_used_data":25228,"kb_used_omap":1,"kb_used_meta":374014,"kb_avail":93972580,"statfs":{"total":96636764160,"available":96227921920,"internally_reserved":0,"allocated":25833472,"data_stored":38457299,"data_compressed":3734837,"data_compressed_allocated":5775360,"data_compressed_original":18583552,"omap_allocated":1595,"internal_metadata":382990789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575166,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":657404,"kb_used_data":48812,"kb_used_omap":1,"kb_used_meta":608574,"kb_avail":93714436,"statfs":{"total":96636764160,"available":95963582464,"internally_reserved":0,"allocated":49983488,"data_stored":75106430,"data_compressed":7687781,"data_compressed_allocated":11784192,"data_compressed_original":37085184,"omap_allocated":1594,"internal_metadata":623180230},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25481216,"data_stored":37749374,"data_compressed":3702315,"data_compressed_allocated":5730304,"data_compressed_original":18010112,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49696768,"data_stored":74988873,"data_compressed":7687781,"data_compressed_allocated":11784192,"data_compressed_original":37085184,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30625792,"data_stored":46137344,"data_compressed":4726192,"data_compressed_allocated":7282688,"data_compressed_original":22794240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":41799680,"data_stored":62915232,"data_compressed":6347263,"data_compressed_allocated":9764864,"data_compressed_original":30887936,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26992640,"data_stored":41943166,"data_compressed":4480082,"data_compressed_allocated":6909952,"data_compressed_original":21872640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":63070208,"data_stored":97868243,"data_compressed":10458419,"data_compressed_allocated":16003072,"data_compressed_original":50806784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45420544,"data_stored":69017456,"data_compressed":7128351,"data_compressed_allocated":10952704,"data_compressed_original":34557952,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":44331008,"data_stored":67109446,"data_compressed":6921515,"data_compressed_allocated":10747904,"data_compressed_original":33529856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:35:20.732 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-15T22:35:20.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.861+0000 7fa5cb0ba640 1 Processor -- start 2024-09-15T22:35:20.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.861+0000 7fa5cb0ba640 1 -- start start 2024-09-15T22:35:20.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.862+0000 7fa5cb0ba640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa5c406e660 0x7fa5c4075260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:20.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.862+0000 7fa5cb0ba640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5c40b6570 0x7fa5c40b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:20.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.862+0000 7fa5cb0ba640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c406ea40 con 0x7fa5c40b5210 2024-09-15T22:35:20.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.862+0000 7fa5cb0ba640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c4074dd0 con 0x7fa5c40b6570 2024-09-15T22:35:20.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.862+0000 7fa5cb0ba640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c409ae10 con 0x7fa5c406e660 2024-09-15T22:35:20.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.862+0000 7fa5c3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5c40b6570 0x7fa5c40b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:20.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.862+0000 7fa5c3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5c40b6570 0x7fa5c40b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33248/0 (socket says 172.21.15.78:33248) 2024-09-15T22:35:20.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.862+0000 7fa5c3fff640 1 -- 172.21.15.78:0/1010284755 learned_addr learned my addr 172.21.15.78:0/1010284755 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:35:20.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.862+0000 7fa5c8e56640 1 --2- 172.21.15.78:0/1010284755 >> v2:172.21.15.175:3300/0 conn(0x7fa5c406e660 0x7fa5c4075260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:20.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.862+0000 7fa5c3fff640 1 -- 172.21.15.78:0/1010284755 >> v2:172.21.15.175:3300/0 conn(0x7fa5c406e660 msgr2=0x7fa5c4075260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:20.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.862+0000 7fa5c3fff640 1 --2- 172.21.15.78:0/1010284755 >> v2:172.21.15.175:3300/0 conn(0x7fa5c406e660 0x7fa5c4075260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:20.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.862+0000 7fa5c3fff640 1 -- 172.21.15.78:0/1010284755 >> v1:172.21.15.175:6789/0 conn(0x7fa5c40b5210 legacy=0x7fa5c40ace10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:35:20.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.862+0000 7fa5c3fff640 1 -- 172.21.15.78:0/1010284755 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c409b0f0 con 0x7fa5c40b6570 2024-09-15T22:35:20.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.862+0000 7fa5c8e56640 1 --2- 172.21.15.78:0/1010284755 >> v2:172.21.15.175:3300/0 conn(0x7fa5c406e660 0x7fa5c4075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:35:20.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.863+0000 7fa5c3fff640 1 --2- 172.21.15.78:0/1010284755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c40b6570 0x7fa5c40b4cd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40b7f90 tx=0x7fa5b802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56bda9c020dbbf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:20.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.863+0000 7fa5c37fe640 1 -- 172.21.15.78:0/1010284755 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8037070 con 0x7fa5c40b6570 2024-09-15T22:35:20.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.863+0000 7fa5c37fe640 1 -- 172.21.15.78:0/1010284755 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b8032440 con 0x7fa5c40b6570 2024-09-15T22:35:20.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.863+0000 7fa5c37fe640 1 -- 172.21.15.78:0/1010284755 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8032810 con 0x7fa5c40b6570 2024-09-15T22:35:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.863+0000 7fa5cb0ba640 1 -- 172.21.15.78:0/1010284755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c40b6570 msgr2=0x7fa5c40b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.863+0000 7fa5cb0ba640 1 --2- 172.21.15.78:0/1010284755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c40b6570 0x7fa5c40b4cd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40b7f90 tx=0x7fa5b802a1a0 comp rx=0 tx=0).stop 2024-09-15T22:35:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.864+0000 7fa5cb0ba640 1 -- 172.21.15.78:0/1010284755 shutdown_connections 2024-09-15T22:35:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.864+0000 7fa5cb0ba640 1 --2- 172.21.15.78:0/1010284755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c40b6570 0x7fa5c40b4cd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.864+0000 7fa5cb0ba640 1 --2- 172.21.15.78:0/1010284755 >> v2:172.21.15.175:3300/0 conn(0x7fa5c406e660 0x7fa5c4075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.864+0000 7fa5cb0ba640 1 -- 172.21.15.78:0/1010284755 >> 172.21.15.78:0/1010284755 conn(0x7fa5c40b6ed0 msgr2=0x7fa5c40b72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.864+0000 7fa5cb0ba640 1 -- 172.21.15.78:0/1010284755 shutdown_connections 2024-09-15T22:35:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.864+0000 7fa5cb0ba640 1 -- 172.21.15.78:0/1010284755 wait complete. 2024-09-15T22:35:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.865+0000 7fa5cb0ba640 1 Processor -- start 2024-09-15T22:35:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.865+0000 7fa5cb0ba640 1 -- start start 2024-09-15T22:35:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.865+0000 7fa5cb0ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c406e660 0x7fa5c41e0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.865+0000 7fa5cb0ba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5c40b5210 0x7fa5c40ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.865+0000 7fa5cb0ba640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c40b6570 0x7fa5c40af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.865+0000 7fa5cb0ba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c4075920 con 0x7fa5c406e660 2024-09-15T22:35:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.865+0000 7fa5cb0ba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c40757a0 con 0x7fa5c40b5210 2024-09-15T22:35:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.865+0000 7fa5cb0ba640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c409b580 con 0x7fa5c40b6570 2024-09-15T22:35:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.865+0000 7fa5c8e56640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c406e660 0x7fa5c41e0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.865+0000 7fa5c8e56640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c406e660 0x7fa5c41e0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33258/0 (socket says 172.21.15.78:33258) 2024-09-15T22:35:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.865+0000 7fa5c8e56640 1 -- 172.21.15.78:0/2742064488 learned_addr learned my addr 172.21.15.78:0/2742064488 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:35:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.866+0000 7fa5c8e56640 1 -- 172.21.15.78:0/2742064488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c40b6570 msgr2=0x7fa5c40af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.866+0000 7fa5c8e56640 1 --2- 172.21.15.78:0/2742064488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c40b6570 0x7fa5c40af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.866+0000 7fa5c8e56640 1 -- 172.21.15.78:0/2742064488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5c40b5210 msgr2=0x7fa5c40ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.866+0000 7fa5c8e56640 1 --2- 172.21.15.78:0/2742064488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5c40b5210 0x7fa5c40ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.866+0000 7fa5c8e56640 1 -- 172.21.15.78:0/2742064488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c40b0a10 con 0x7fa5c406e660 2024-09-15T22:35:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.866+0000 7fa5c8e56640 1 --2- 172.21.15.78:0/2742064488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c406e660 0x7fa5c41e0570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400c820 tx=0x7fa5b400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.866+0000 7fa5c17fa640 1 -- 172.21.15.78:0/2742064488 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4015070 con 0x7fa5c406e660 2024-09-15T22:35:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.866+0000 7fa5c17fa640 1 -- 172.21.15.78:0/2742064488 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b4007a30 con 0x7fa5c406e660 2024-09-15T22:35:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.866+0000 7fa5c17fa640 1 -- 172.21.15.78:0/2742064488 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4007e00 con 0x7fa5c406e660 2024-09-15T22:35:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.866+0000 7fa5cb0ba640 1 -- 172.21.15.78:0/2742064488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c40ba010 con 0x7fa5c406e660 2024-09-15T22:35:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.866+0000 7fa5cb0ba640 1 -- 172.21.15.78:0/2742064488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c40ae760 con 0x7fa5c406e660 2024-09-15T22:35:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.867+0000 7fa5cb0ba640 1 -- 172.21.15.78:0/2742064488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c409a9a0 con 0x7fa5c406e660 2024-09-15T22:35:20.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.867+0000 7fa5c17fa640 1 -- 172.21.15.78:0/2742064488 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa5b4018070 con 0x7fa5c406e660 2024-09-15T22:35:20.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.868+0000 7fa5c17fa640 1 --2- 172.21.15.78:0/2742064488 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa5b006c2b0 0x7fa5b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:20.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.868+0000 7fa5c17fa640 1 -- 172.21.15.78:0/2742064488 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7fa5b408b810 con 0x7fa5c406e660 2024-09-15T22:35:20.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.868+0000 7fa5c3fff640 1 --2- 172.21.15.78:0/2742064488 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa5b006c2b0 0x7fa5b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:20.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.868+0000 7fa5c3fff640 1 --2- 172.21.15.78:0/2742064488 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa5b006c2b0 0x7fa5b006e770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8034000 tx=0x7fa5b802c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:20.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:20.872+0000 7fa5c17fa640 1 -- 172.21.15.78:0/2742064488 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5b4059b10 con 0x7fa5c406e660 2024-09-15T22:35:21.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.038+0000 7fa5cb0ba640 1 -- 172.21.15.78:0/2742064488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa5c40ab150 con 0x7fa5c406e660 2024-09-15T22:35:21.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.043+0000 7fa5c17fa640 1 -- 172.21.15.78:0/2742064488 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fa5b4059410 con 0x7fa5c406e660 2024-09-15T22:35:21.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.044+0000 7fa5c17fa640 1 -- 172.21.15.78:0/2742064488 <== mon.0 v2:172.21.15.78:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa5b405d7c0 con 0x7fa5c406e660 2024-09-15T22:35:21.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.046+0000 7fa5cb0ba640 1 -- 172.21.15.78:0/2742064488 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa5b006c2b0 msgr2=0x7fa5b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.046+0000 7fa5cb0ba640 1 --2- 172.21.15.78:0/2742064488 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa5b006c2b0 0x7fa5b006e770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8034000 tx=0x7fa5b802c000 comp rx=0 tx=0).stop 2024-09-15T22:35:21.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.046+0000 7fa5cb0ba640 1 -- 172.21.15.78:0/2742064488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c406e660 msgr2=0x7fa5c41e0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.046+0000 7fa5cb0ba640 1 --2- 172.21.15.78:0/2742064488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c406e660 0x7fa5c41e0570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400c820 tx=0x7fa5b400cc20 comp rx=0 tx=0).stop 2024-09-15T22:35:21.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.046+0000 7fa5cb0ba640 1 -- 172.21.15.78:0/2742064488 shutdown_connections 2024-09-15T22:35:21.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.046+0000 7fa5cb0ba640 1 --2- 172.21.15.78:0/2742064488 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7fa5b006c2b0 0x7fa5b006e770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.046+0000 7fa5cb0ba640 1 --2- 172.21.15.78:0/2742064488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c40b6570 0x7fa5c40af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.046+0000 7fa5cb0ba640 1 --2- 172.21.15.78:0/2742064488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5c40b5210 0x7fa5c40ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.046+0000 7fa5cb0ba640 1 --2- 172.21.15.78:0/2742064488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c406e660 0x7fa5c41e0570 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.046+0000 7fa5cb0ba640 1 -- 172.21.15.78:0/2742064488 >> 172.21.15.78:0/2742064488 conn(0x7fa5c40b6ed0 msgr2=0x7fa5c406d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:21.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.046+0000 7fa5cb0ba640 1 -- 172.21.15.78:0/2742064488 shutdown_connections 2024-09-15T22:35:21.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.046+0000 7fa5cb0ba640 1 -- 172.21.15.78:0/2742064488 wait complete. 2024-09-15T22:35:21.060 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:35:21.060 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:35:21.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.157+0000 7efe6d9e8640 1 Processor -- start 2024-09-15T22:35:21.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.157+0000 7efe6d9e8640 1 -- start start 2024-09-15T22:35:21.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.158+0000 7efe6d9e8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe68071950 0x7efe68142b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.158+0000 7efe6d9e8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe68071d30 con 0x7efe681430b0 2024-09-15T22:35:21.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.158+0000 7efe6d9e8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe680bbc20 con 0x7efe680725c0 2024-09-15T22:35:21.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.158+0000 7efe6d9e8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efe680bbf00 con 0x7efe68071950 2024-09-15T22:35:21.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.158+0000 7efe667fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efe681430b0 0x7efe680b4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44988/0 (socket says 172.21.15.78:44988) 2024-09-15T22:35:21.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.158+0000 7efe667fc640 1 -- 172.21.15.78:0/313051338 learned_addr learned my addr 172.21.15.78:0/313051338 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:35:21.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe65ffb640 1 -- 172.21.15.78:0/313051338 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404857719 0 0) 0x7efe68071d30 con 0x7efe681430b0 2024-09-15T22:35:21.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe65ffb640 1 -- 172.21.15.78:0/313051338 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe54003520 con 0x7efe681430b0 2024-09-15T22:35:21.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe66ffd640 1 --2- 172.21.15.78:0/313051338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe68071950 0x7efe68142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe65ffb640 1 -- 172.21.15.78:0/313051338 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1173187011 0 0) 0x7efe54003520 con 0x7efe681430b0 2024-09-15T22:35:21.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe65ffb640 1 -- 172.21.15.78:0/313051338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe68071950 msgr2=0x7efe68142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:21.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe65ffb640 1 --2- 172.21.15.78:0/313051338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe68071950 0x7efe68142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe65ffb640 1 -- 172.21.15.78:0/313051338 >> v1:172.21.15.175:6789/0 conn(0x7efe680725c0 legacy=0x7efe68150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe65ffb640 1 -- 172.21.15.78:0/313051338 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe68072c90 con 0x7efe681430b0 2024-09-15T22:35:21.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe65ffb640 1 -- 172.21.15.78:0/313051338 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3961011974 0 0) 0x7efe50001670 con 0x7efe681430b0 2024-09-15T22:35:21.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe65ffb640 1 -- 172.21.15.78:0/313051338 >> v1:172.21.15.78:6789/0 conn(0x7efe681430b0 legacy=0x7efe680b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe65ffb640 1 --2- 172.21.15.78:0/313051338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe68071950 0x7efe540039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe65ffb640 1 --2- 172.21.15.78:0/313051338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe54003f60 0x7efe54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe65ffb640 1 --2- 172.21.15.78:0/313051338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe54004d40 0x7efe540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe65ffb640 1 -- 172.21.15.78:0/313051338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efe680bbf00 con 0x7efe54003f60 2024-09-15T22:35:21.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe65ffb640 1 -- 172.21.15.78:0/313051338 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efe5400bb50 con 0x7efe54004d40 2024-09-15T22:35:21.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe65ffb640 1 -- 172.21.15.78:0/313051338 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efe5400bd50 con 0x7efe68071950 2024-09-15T22:35:21.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe667fc640 1 --2- 172.21.15.78:0/313051338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe54003f60 0x7efe54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe66ffd640 1 --2- 172.21.15.78:0/313051338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe68071950 0x7efe540039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe677fe640 1 --2- 172.21.15.78:0/313051338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe54004d40 0x7efe540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe667fc640 1 -- 172.21.15.78:0/313051338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe68071950 msgr2=0x7efe540039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:21.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe667fc640 1 --2- 172.21.15.78:0/313051338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe68071950 0x7efe540039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe667fc640 1 -- 172.21.15.78:0/313051338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe54004d40 msgr2=0x7efe540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:21.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe667fc640 1 --2- 172.21.15.78:0/313051338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe54004d40 0x7efe540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.159+0000 7efe667fc640 1 -- 172.21.15.78:0/313051338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe54003520 con 0x7efe54003f60 2024-09-15T22:35:21.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.160+0000 7efe667fc640 1 --2- 172.21.15.78:0/313051338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe54003f60 0x7efe54004800 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c210 tx=0x7efe54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bd0fadf5afa6d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:21.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.160+0000 7efe65ffb640 1 -- 172.21.15.78:0/313051338 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50007d30 con 0x7efe54003f60 2024-09-15T22:35:21.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.160+0000 7efe65ffb640 1 -- 172.21.15.78:0/313051338 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efe50005af0 con 0x7efe54003f60 2024-09-15T22:35:21.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.160+0000 7efe65ffb640 1 -- 172.21.15.78:0/313051338 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50007070 con 0x7efe54003f60 2024-09-15T22:35:21.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.161+0000 7efe6d9e8640 1 -- 172.21.15.78:0/313051338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe54003f60 msgr2=0x7efe54004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.161+0000 7efe6d9e8640 1 --2- 172.21.15.78:0/313051338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe54003f60 0x7efe54004800 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c210 tx=0x7efe54005830 comp rx=0 tx=0).stop 2024-09-15T22:35:21.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.161+0000 7efe677fe640 1 -- 172.21.15.78:0/313051338 reap_dead start 2024-09-15T22:35:21.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.161+0000 7efe6d9e8640 1 -- 172.21.15.78:0/313051338 shutdown_connections 2024-09-15T22:35:21.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.161+0000 7efe6d9e8640 1 -- 172.21.15.78:0/313051338 >> 172.21.15.78:0/313051338 conn(0x7efe68075360 msgr2=0x7efe680bb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:21.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.161+0000 7efe6d9e8640 1 -- 172.21.15.78:0/313051338 shutdown_connections 2024-09-15T22:35:21.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.161+0000 7efe6d9e8640 1 -- 172.21.15.78:0/313051338 wait complete. 2024-09-15T22:35:21.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.162+0000 7efe6d9e8640 1 Processor -- start 2024-09-15T22:35:21.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.162+0000 7efe6d9e8640 1 -- start start 2024-09-15T22:35:21.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.162+0000 7efe6d9e8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe54003f60 0x7efe68148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.162+0000 7efe6d9e8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe680bb1f0 0x7efe681d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.162+0000 7efe6d9e8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe681cf930 0x7efe681cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe6d9e8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efe68073690 con 0x7efe681cf930 2024-09-15T22:35:21.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe6d9e8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efe68073510 con 0x7efe680bb1f0 2024-09-15T22:35:21.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe6d9e8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efe68072f60 con 0x7efe54003f60 2024-09-15T22:35:21.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe677fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe681cf930 0x7efe681cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe677fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe681cf930 0x7efe681cfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33272/0 (socket says 172.21.15.78:33272) 2024-09-15T22:35:21.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe66ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe54003f60 0x7efe68148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe677fe640 1 -- 172.21.15.78:0/671364282 learned_addr learned my addr 172.21.15.78:0/671364282 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:35:21.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe667fc640 1 --2- 172.21.15.78:0/671364282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe680bb1f0 0x7efe681d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe677fe640 1 -- 172.21.15.78:0/671364282 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe54003f60 msgr2=0x7efe68148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe677fe640 1 --2- 172.21.15.78:0/671364282 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe54003f60 0x7efe68148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe677fe640 1 -- 172.21.15.78:0/671364282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe680bb1f0 msgr2=0x7efe681d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe677fe640 1 --2- 172.21.15.78:0/671364282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe680bb1f0 0x7efe681d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe677fe640 1 -- 172.21.15.78:0/671364282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe681d0300 con 0x7efe681cf930 2024-09-15T22:35:21.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe677fe640 1 --2- 172.21.15.78:0/671364282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe681cf930 0x7efe681cfdc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efe68145870 tx=0x7efe6000f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:21.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe5ffff640 1 -- 172.21.15.78:0/671364282 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe600053a0 con 0x7efe681cf930 2024-09-15T22:35:21.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe5ffff640 1 -- 172.21.15.78:0/671364282 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efe60018070 con 0x7efe681cf930 2024-09-15T22:35:21.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe6d9e8640 1 -- 172.21.15.78:0/671364282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe680ba450 con 0x7efe681cf930 2024-09-15T22:35:21.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe5ffff640 1 -- 172.21.15.78:0/671364282 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60003850 con 0x7efe681cf930 2024-09-15T22:35:21.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.163+0000 7efe6d9e8640 1 -- 172.21.15.78:0/671364282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe681ceff0 con 0x7efe681cf930 2024-09-15T22:35:21.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.164+0000 7efe6d9e8640 1 -- 172.21.15.78:0/671364282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe68142b70 con 0x7efe681cf930 2024-09-15T22:35:21.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.165+0000 7efe5ffff640 1 -- 172.21.15.78:0/671364282 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efe600039f0 con 0x7efe681cf930 2024-09-15T22:35:21.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.165+0000 7efe5ffff640 1 --2- 172.21.15.78:0/671364282 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7efe4806c2b0 0x7efe4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.165+0000 7efe66ffd640 1 --2- 172.21.15.78:0/671364282 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7efe4806c2b0 0x7efe4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.165+0000 7efe5ffff640 1 -- 172.21.15.78:0/671364282 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7efe6008b2c0 con 0x7efe681cf930 2024-09-15T22:35:21.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.166+0000 7efe66ffd640 1 --2- 172.21.15.78:0/671364282 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7efe4806c2b0 0x7efe4806e770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe58014510 tx=0x7efe5800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:21.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.170+0000 7efe5ffff640 1 -- 172.21.15.78:0/671364282 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efe60058f80 con 0x7efe681cf930 2024-09-15T22:35:21.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.370+0000 7efe6d9e8640 1 -- 172.21.15.78:0/671364282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe680b2580 con 0x7efe681cf930 2024-09-15T22:35:21.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.370+0000 7efe5ffff640 1 -- 172.21.15.78:0/671364282 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3574 (secure 0 0 0) 0x7efe6008b0e0 con 0x7efe681cf930 2024-09-15T22:35:21.372 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:35:21.373 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"btime":"2024-09-15T22:09:35:458988+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1036052633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1036052633},{"type":"v1","addr":"172.21.15.78:6835","nonce":1036052633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:09:16.727586+0000","modified":"2024-09-15T22:09:34.782979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6833/4038139714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":4038139714},{"type":"v1","addr":"172.21.15.175:6833","nonce":4038139714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-09-15T22:35:21.373 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2024-09-15T22:35:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.372+0000 7efe6d9e8640 1 -- 172.21.15.78:0/671364282 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7efe4806c2b0 msgr2=0x7efe4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.372+0000 7efe6d9e8640 1 --2- 172.21.15.78:0/671364282 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7efe4806c2b0 0x7efe4806e770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe58014510 tx=0x7efe5800b040 comp rx=0 tx=0).stop 2024-09-15T22:35:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.372+0000 7efe6d9e8640 1 -- 172.21.15.78:0/671364282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe681cf930 msgr2=0x7efe681cfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.372+0000 7efe6d9e8640 1 --2- 172.21.15.78:0/671364282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe681cf930 0x7efe681cfdc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efe68145870 tx=0x7efe6000f920 comp rx=0 tx=0).stop 2024-09-15T22:35:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.372+0000 7efe6d9e8640 1 -- 172.21.15.78:0/671364282 shutdown_connections 2024-09-15T22:35:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.372+0000 7efe6d9e8640 1 --2- 172.21.15.78:0/671364282 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7efe4806c2b0 0x7efe4806e770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.372+0000 7efe6d9e8640 1 --2- 172.21.15.78:0/671364282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe681cf930 0x7efe681cfdc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.372+0000 7efe6d9e8640 1 --2- 172.21.15.78:0/671364282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe680bb1f0 0x7efe681d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.372+0000 7efe6d9e8640 1 --2- 172.21.15.78:0/671364282 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe54003f60 0x7efe68148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.372+0000 7efe6d9e8640 1 -- 172.21.15.78:0/671364282 >> 172.21.15.78:0/671364282 conn(0x7efe68075360 msgr2=0x7efe681ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.372+0000 7efe6d9e8640 1 -- 172.21.15.78:0/671364282 shutdown_connections 2024-09-15T22:35:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.372+0000 7efe6d9e8640 1 -- 172.21.15.78:0/671364282 wait complete. 2024-09-15T22:35:21.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:35:21.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.481+0000 7f3926e82640 1 Processor -- start 2024-09-15T22:35:21.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.481+0000 7f3926e82640 1 -- start start 2024-09-15T22:35:21.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.482+0000 7f3926e82640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3920073270 0x7f3920146050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.482+0000 7f3926e82640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f392013fa70 0x7f3920150130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.482+0000 7f3926e82640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39201458c0 con 0x7f39200b5250 2024-09-15T22:35:21.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.482+0000 7f3926e82640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f3920145bc0 con 0x7f3920073270 2024-09-15T22:35:21.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.482+0000 7f3926e82640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f39200b2ac0 con 0x7f392013fa70 2024-09-15T22:35:21.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.482+0000 7f3924c1e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3920073270 0x7f3920146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.482+0000 7f391ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f39200b5250 0x7f392013f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45004/0 (socket says 172.21.15.78:45004) 2024-09-15T22:35:21.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.482+0000 7f391ffff640 1 -- 172.21.15.78:0/832546978 learned_addr learned my addr 172.21.15.78:0/832546978 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:35:21.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.482+0000 7f392541f640 1 --2- 172.21.15.78:0/832546978 >> v2:172.21.15.175:3300/0 conn(0x7f392013fa70 0x7f3920150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.482+0000 7f3924c1e640 1 -- 172.21.15.78:0/832546978 >> v2:172.21.15.175:3300/0 conn(0x7f392013fa70 msgr2=0x7f3920150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:21.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.483+0000 7f3924c1e640 1 --2- 172.21.15.78:0/832546978 >> v2:172.21.15.175:3300/0 conn(0x7f392013fa70 0x7f3920150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.483+0000 7f3924c1e640 1 -- 172.21.15.78:0/832546978 >> v1:172.21.15.78:6789/0 conn(0x7f39200b5250 legacy=0x7f392013f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.483+0000 7f3924c1e640 1 -- 172.21.15.78:0/832546978 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392013fe80 con 0x7f3920073270 2024-09-15T22:35:21.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.483+0000 7f391f7fe640 1 -- 172.21.15.78:0/832546978 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2048073793 0 0) 0x7f39201458c0 con 0x7f39200b5250 2024-09-15T22:35:21.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.483+0000 7f392541f640 1 --2- 172.21.15.78:0/832546978 >> v2:172.21.15.175:3300/0 conn(0x7f392013fa70 0x7f3920150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:35:21.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.483+0000 7f3924c1e640 1 --2- 172.21.15.78:0/832546978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3920073270 0x7f3920146050 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f39200b56c0 tx=0x7f391002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff10e4e3603d4cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:21.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.483+0000 7f391f7fe640 1 -- 172.21.15.78:0/832546978 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910037070 con 0x7f3920073270 2024-09-15T22:35:21.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.483+0000 7f391f7fe640 1 -- 172.21.15.78:0/832546978 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f391002add0 con 0x7f3920073270 2024-09-15T22:35:21.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.483+0000 7f391f7fe640 1 -- 172.21.15.78:0/832546978 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910032680 con 0x7f3920073270 2024-09-15T22:35:21.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.484+0000 7f3926e82640 1 -- 172.21.15.78:0/832546978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3920073270 msgr2=0x7f3920146050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.484+0000 7f3926e82640 1 --2- 172.21.15.78:0/832546978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3920073270 0x7f3920146050 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f39200b56c0 tx=0x7f391002a080 comp rx=0 tx=0).stop 2024-09-15T22:35:21.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.484+0000 7f3926e82640 1 -- 172.21.15.78:0/832546978 shutdown_connections 2024-09-15T22:35:21.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.484+0000 7f3926e82640 1 --2- 172.21.15.78:0/832546978 >> v2:172.21.15.175:3300/0 conn(0x7f392013fa70 0x7f3920150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.484+0000 7f3926e82640 1 --2- 172.21.15.78:0/832546978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3920073270 0x7f3920146050 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.484+0000 7f3926e82640 1 -- 172.21.15.78:0/832546978 >> 172.21.15.78:0/832546978 conn(0x7f39200bb390 msgr2=0x7f39200bb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:21.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.484+0000 7f3926e82640 1 -- 172.21.15.78:0/832546978 shutdown_connections 2024-09-15T22:35:21.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.484+0000 7f3926e82640 1 -- 172.21.15.78:0/832546978 wait complete. 2024-09-15T22:35:21.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.485+0000 7f3926e82640 1 Processor -- start 2024-09-15T22:35:21.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.485+0000 7f3926e82640 1 -- start start 2024-09-15T22:35:21.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f3926e82640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3920073270 0x7f39201e0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f3926e82640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39200b5250 0x7f39201e0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f3926e82640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f392013fa70 0x7f392013e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f3926e82640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3920071650 con 0x7f392013fa70 2024-09-15T22:35:21.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f3926e82640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3920073650 con 0x7f3920073270 2024-09-15T22:35:21.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f3926e82640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f39200717d0 con 0x7f39200b5250 2024-09-15T22:35:21.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f392541f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f392013fa70 0x7f392013e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f392541f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f392013fa70 0x7f392013e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33294/0 (socket says 172.21.15.78:33294) 2024-09-15T22:35:21.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f392541f640 1 -- 172.21.15.78:0/3814284503 learned_addr learned my addr 172.21.15.78:0/3814284503 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:35:21.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f3924c1e640 1 --2- 172.21.15.78:0/3814284503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3920073270 0x7f39201e0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f391ffff640 1 --2- 172.21.15.78:0/3814284503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39200b5250 0x7f39201e0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f392541f640 1 -- 172.21.15.78:0/3814284503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39200b5250 msgr2=0x7f39201e0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f392541f640 1 --2- 172.21.15.78:0/3814284503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39200b5250 0x7f39201e0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f392541f640 1 -- 172.21.15.78:0/3814284503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3920073270 msgr2=0x7f39201e0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f392541f640 1 --2- 172.21.15.78:0/3814284503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3920073270 0x7f39201e0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f392541f640 1 -- 172.21.15.78:0/3814284503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3920142890 con 0x7f392013fa70 2024-09-15T22:35:21.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f391ffff640 1 --2- 172.21.15.78:0/3814284503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39200b5250 0x7f39201e0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:35:21.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f392541f640 1 --2- 172.21.15.78:0/3814284503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f392013fa70 0x7f392013e120 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f391800cd50 tx=0x7f391800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:21.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f391d7fa640 1 -- 172.21.15.78:0/3814284503 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391800f680 con 0x7f392013fa70 2024-09-15T22:35:21.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f391d7fa640 1 -- 172.21.15.78:0/3814284503 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f391800f840 con 0x7f392013fa70 2024-09-15T22:35:21.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f3926e82640 1 -- 172.21.15.78:0/3814284503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392006d7f0 con 0x7f392013fa70 2024-09-15T22:35:21.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.486+0000 7f391d7fa640 1 -- 172.21.15.78:0/3814284503 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391800fc50 con 0x7f392013fa70 2024-09-15T22:35:21.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.487+0000 7f3926e82640 1 -- 172.21.15.78:0/3814284503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39200af780 con 0x7f392013fa70 2024-09-15T22:35:21.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.488+0000 7f3926e82640 1 -- 172.21.15.78:0/3814284503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3920074090 con 0x7f392013fa70 2024-09-15T22:35:21.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.488+0000 7f391d7fa640 1 -- 172.21.15.78:0/3814284503 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f39180213f0 con 0x7f392013fa70 2024-09-15T22:35:21.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.489+0000 7f391d7fa640 1 --2- 172.21.15.78:0/3814284503 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f390c06c2b0 0x7f390c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.489+0000 7f391d7fa640 1 -- 172.21.15.78:0/3814284503 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7f391808c610 con 0x7f392013fa70 2024-09-15T22:35:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.489+0000 7f3924c1e640 1 --2- 172.21.15.78:0/3814284503 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f390c06c2b0 0x7f390c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.489+0000 7f3924c1e640 1 --2- 172.21.15.78:0/3814284503 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f390c06c2b0 0x7f390c06e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3910034000 tx=0x7f391002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:21.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.493+0000 7f391d7fa640 1 -- 172.21.15.78:0/3814284503 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3918014030 con 0x7f392013fa70 2024-09-15T22:35:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.693+0000 7f3926e82640 1 -- 172.21.15.78:0/3814284503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39200b41e0 con 0x7f392013fa70 2024-09-15T22:35:21.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.693+0000 7f391d7fa640 1 -- 172.21.15.78:0/3814284503 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3574 (secure 0 0 0) 0x7f391805a920 con 0x7f392013fa70 2024-09-15T22:35:21.695 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:35:21.695 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"btime":"2024-09-15T22:09:35:458988+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1036052633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1036052633},{"type":"v1","addr":"172.21.15.78:6835","nonce":1036052633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:09:16.727586+0000","modified":"2024-09-15T22:09:34.782979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6833/4038139714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":4038139714},{"type":"v1","addr":"172.21.15.175:6833","nonce":4038139714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-09-15T22:35:21.696 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2024-09-15T22:35:21.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.695+0000 7f3926e82640 1 -- 172.21.15.78:0/3814284503 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f390c06c2b0 msgr2=0x7f390c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.695+0000 7f3926e82640 1 --2- 172.21.15.78:0/3814284503 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f390c06c2b0 0x7f390c06e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3910034000 tx=0x7f391002e000 comp rx=0 tx=0).stop 2024-09-15T22:35:21.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.695+0000 7f3926e82640 1 -- 172.21.15.78:0/3814284503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f392013fa70 msgr2=0x7f392013e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.695+0000 7f3926e82640 1 --2- 172.21.15.78:0/3814284503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f392013fa70 0x7f392013e120 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f391800cd50 tx=0x7f391800a650 comp rx=0 tx=0).stop 2024-09-15T22:35:21.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.695+0000 7f3926e82640 1 -- 172.21.15.78:0/3814284503 shutdown_connections 2024-09-15T22:35:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.695+0000 7f3926e82640 1 --2- 172.21.15.78:0/3814284503 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f390c06c2b0 0x7f390c06e770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.695+0000 7f3926e82640 1 --2- 172.21.15.78:0/3814284503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f392013fa70 0x7f392013e120 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.695+0000 7f3926e82640 1 --2- 172.21.15.78:0/3814284503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39200b5250 0x7f39201e0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.695+0000 7f3926e82640 1 --2- 172.21.15.78:0/3814284503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3920073270 0x7f39201e0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.695+0000 7f3926e82640 1 -- 172.21.15.78:0/3814284503 >> 172.21.15.78:0/3814284503 conn(0x7f39200bb390 msgr2=0x7f39200b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:21.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.695+0000 7f3926e82640 1 -- 172.21.15.78:0/3814284503 shutdown_connections 2024-09-15T22:35:21.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.695+0000 7f3926e82640 1 -- 172.21.15.78:0/3814284503 wait complete. 2024-09-15T22:35:21.708 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:35:21.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.804+0000 7f9ab47cf640 1 Processor -- start 2024-09-15T22:35:21.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.804+0000 7f9ab47cf640 1 -- start start 2024-09-15T22:35:21.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.805+0000 7f9ab47cf640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9aac0630c0 0x7f9aac0b4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.805+0000 7f9ab47cf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9aac0b48b0 0x7f9aac142b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.805+0000 7f9ab47cf640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aac0634a0 con 0x7f9aac143080 2024-09-15T22:35:21.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.805+0000 7f9ab47cf640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f9aac0b4d40 con 0x7f9aac0b48b0 2024-09-15T22:35:21.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.805+0000 7f9ab47cf640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9aac0b0870 con 0x7f9aac0630c0 2024-09-15T22:35:21.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.805+0000 7f9ab1d6a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9aac0b48b0 0x7f9aac142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.805+0000 7f9ab1d6a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9aac0b48b0 0x7f9aac142b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33308/0 (socket says 172.21.15.78:33308) 2024-09-15T22:35:21.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.805+0000 7f9ab1d6a640 1 -- 172.21.15.78:0/2477610707 learned_addr learned my addr 172.21.15.78:0/2477610707 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:35:21.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.805+0000 7f9ab256b640 1 --2- 172.21.15.78:0/2477610707 >> v2:172.21.15.175:3300/0 conn(0x7f9aac0630c0 0x7f9aac0b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.805+0000 7f9ab1d6a640 1 -- 172.21.15.78:0/2477610707 >> v2:172.21.15.175:3300/0 conn(0x7f9aac0630c0 msgr2=0x7f9aac0b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:21.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.805+0000 7f9ab1d6a640 1 --2- 172.21.15.78:0/2477610707 >> v2:172.21.15.175:3300/0 conn(0x7f9aac0630c0 0x7f9aac0b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.805+0000 7f9ab1d6a640 1 -- 172.21.15.78:0/2477610707 >> v1:172.21.15.175:6789/0 conn(0x7f9aac143080 legacy=0x7f9aac148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:21.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.805+0000 7f9ab1d6a640 1 -- 172.21.15.78:0/2477610707 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac0709b0 con 0x7f9aac0b48b0 2024-09-15T22:35:21.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.805+0000 7f9ab256b640 1 --2- 172.21.15.78:0/2477610707 >> v2:172.21.15.175:3300/0 conn(0x7f9aac0630c0 0x7f9aac0b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:35:21.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.806+0000 7f9ab1d6a640 1 --2- 172.21.15.78:0/2477610707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac0b48b0 0x7f9aac142b40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9aac06d2c0 tx=0x7f9a9c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc36ededc3dffe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:21.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.806+0000 7f9ab1569640 1 -- 172.21.15.78:0/2477610707 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c004030 con 0x7f9aac0b48b0 2024-09-15T22:35:21.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.806+0000 7f9ab1569640 1 -- 172.21.15.78:0/2477610707 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9a9c0041d0 con 0x7f9aac0b48b0 2024-09-15T22:35:21.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.806+0000 7f9ab1569640 1 -- 172.21.15.78:0/2477610707 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c003610 con 0x7f9aac0b48b0 2024-09-15T22:35:21.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.806+0000 7f9ab47cf640 1 -- 172.21.15.78:0/2477610707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac0b48b0 msgr2=0x7f9aac142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.806+0000 7f9ab47cf640 1 --2- 172.21.15.78:0/2477610707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac0b48b0 0x7f9aac142b40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9aac06d2c0 tx=0x7f9a9c02a180 comp rx=0 tx=0).stop 2024-09-15T22:35:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.806+0000 7f9ab47cf640 1 -- 172.21.15.78:0/2477610707 shutdown_connections 2024-09-15T22:35:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.806+0000 7f9ab47cf640 1 --2- 172.21.15.78:0/2477610707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac0b48b0 0x7f9aac142b40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.806+0000 7f9ab47cf640 1 --2- 172.21.15.78:0/2477610707 >> v2:172.21.15.175:3300/0 conn(0x7f9aac0630c0 0x7f9aac0b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.806+0000 7f9ab47cf640 1 -- 172.21.15.78:0/2477610707 >> 172.21.15.78:0/2477610707 conn(0x7f9aac0b6470 msgr2=0x7f9aac0b6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.807+0000 7f9ab47cf640 1 -- 172.21.15.78:0/2477610707 shutdown_connections 2024-09-15T22:35:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.807+0000 7f9ab47cf640 1 -- 172.21.15.78:0/2477610707 wait complete. 2024-09-15T22:35:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.807+0000 7f9ab47cf640 1 Processor -- start 2024-09-15T22:35:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.807+0000 7f9ab47cf640 1 -- start start 2024-09-15T22:35:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab47cf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9aac0630c0 0x7f9aac1e0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab47cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac0b48b0 0x7f9aac0b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab47cf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9aac143080 0x7f9aac141750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab47cf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac0b5c50 con 0x7f9aac0b48b0 2024-09-15T22:35:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab47cf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac0b5fc0 con 0x7f9aac0630c0 2024-09-15T22:35:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab47cf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9aac0b0ac0 con 0x7f9aac143080 2024-09-15T22:35:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab1d6a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac0b48b0 0x7f9aac0b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab1d6a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac0b48b0 0x7f9aac0b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33320/0 (socket says 172.21.15.78:33320) 2024-09-15T22:35:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab1d6a640 1 -- 172.21.15.78:0/2678689093 learned_addr learned my addr 172.21.15.78:0/2678689093 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:35:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab256b640 1 --2- 172.21.15.78:0/2678689093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9aac0630c0 0x7f9aac1e0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab2d6c640 1 --2- 172.21.15.78:0/2678689093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9aac143080 0x7f9aac141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab1d6a640 1 -- 172.21.15.78:0/2678689093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9aac143080 msgr2=0x7f9aac141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab1d6a640 1 --2- 172.21.15.78:0/2678689093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9aac143080 0x7f9aac141750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab1d6a640 1 -- 172.21.15.78:0/2678689093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9aac0630c0 msgr2=0x7f9aac1e0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab1d6a640 1 --2- 172.21.15.78:0/2678689093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9aac0630c0 0x7f9aac1e0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.808+0000 7f9ab1d6a640 1 -- 172.21.15.78:0/2678689093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac1e0e60 con 0x7f9aac0b48b0 2024-09-15T22:35:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.809+0000 7f9ab1d6a640 1 --2- 172.21.15.78:0/2678689093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac0b48b0 0x7f9aac0b2660 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0090b0 tx=0x7f9a9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.809+0000 7f9aa2ffd640 1 -- 172.21.15.78:0/2678689093 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c005b90 con 0x7f9aac0b48b0 2024-09-15T22:35:21.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.809+0000 7f9aa2ffd640 1 -- 172.21.15.78:0/2678689093 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9a9c005d30 con 0x7f9aac0b48b0 2024-09-15T22:35:21.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.809+0000 7f9ab47cf640 1 -- 172.21.15.78:0/2678689093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aac1cc640 con 0x7f9aac0b48b0 2024-09-15T22:35:21.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.809+0000 7f9aa2ffd640 1 -- 172.21.15.78:0/2678689093 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c03d930 con 0x7f9aac0b48b0 2024-09-15T22:35:21.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.809+0000 7f9ab47cf640 1 -- 172.21.15.78:0/2678689093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aac1cd2c0 con 0x7f9aac0b48b0 2024-09-15T22:35:21.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.810+0000 7f9ab47cf640 1 -- 172.21.15.78:0/2678689093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aac0b30c0 con 0x7f9aac0b48b0 2024-09-15T22:35:21.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.810+0000 7f9aa2ffd640 1 -- 172.21.15.78:0/2678689093 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a9c03dad0 con 0x7f9aac0b48b0 2024-09-15T22:35:21.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.811+0000 7f9aa2ffd640 1 --2- 172.21.15.78:0/2678689093 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f9a9006c2b0 0x7f9a9006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.811+0000 7f9aa2ffd640 1 -- 172.21.15.78:0/2678689093 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7f9a9c0ac850 con 0x7f9aac0b48b0 2024-09-15T22:35:21.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.811+0000 7f9ab256b640 1 --2- 172.21.15.78:0/2678689093 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f9a9006c2b0 0x7f9a9006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.811+0000 7f9ab256b640 1 --2- 172.21.15.78:0/2678689093 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f9a9006c2b0 0x7f9a9006e770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0b0290 tx=0x7f9aa8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:21.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.815+0000 7f9aa2ffd640 1 -- 172.21.15.78:0/2678689093 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a9c04a030 con 0x7f9aac0b48b0 2024-09-15T22:35:21.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.980+0000 7f9ab47cf640 1 -- 172.21.15.78:0/2678689093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9aac06d9d0 con 0x7f9aac0b48b0 2024-09-15T22:35:21.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.981+0000 7f9aa2ffd640 1 -- 172.21.15.78:0/2678689093 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+19081 (secure 0 0 0) 0x7f9a9c041030 con 0x7f9aac0b48b0 2024-09-15T22:35:21.983 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-15T22:35:21.983 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":27,"fsid":"34e44e87-1d1a-416f-b208-c16e07980ff5","created":"2024-09-15T22:08:53.842443+0000","modified":"2024-09-15T22:09:59.520866+0000","last_up_change":"2024-09-15T22:09:04.830042+0000","last_in_change":"2024-09-15T22:08:55.864039+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:05.999373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:14.532061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:15.710676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:09:19.437681+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"71eb9af6-bf66-4450-a5d1-d4a81f71f95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6817","nonce":3548923409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6819","nonce":3548923409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6823","nonce":3548923409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3548923409},{"type":"v1","addr":"172.21.15.78:6821","nonce":3548923409}]},"public_addr":"172.21.15.78:6817/3548923409","cluster_addr":"172.21.15.78:6819/3548923409","heartbeat_back_addr":"172.21.15.78:6823/3548923409","heartbeat_front_addr":"172.21.15.78:6821/3548923409","state":["exists","up"]},{"osd":1,"uuid":"f0070f6d-7998-4ad3-b597-e5777e61d503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6809","nonce":1233827941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6811","nonce":1233827941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6815","nonce":1233827941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1233827941},{"type":"v1","addr":"172.21.15.78:6813","nonce":1233827941}]},"public_addr":"172.21.15.78:6809/1233827941","cluster_addr":"172.21.15.78:6811/1233827941","heartbeat_back_addr":"172.21.15.78:6815/1233827941","heartbeat_front_addr":"172.21.15.78:6813/1233827941","state":["exists","up"]},{"osd":2,"uuid":"6d9c91c7-2c8a-48f9-9bef-67ea7320980e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6825","nonce":636523247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6827","nonce":636523247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6831","nonce":636523247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":636523247},{"type":"v1","addr":"172.21.15.78:6829","nonce":636523247}]},"public_addr":"172.21.15.78:6825/636523247","cluster_addr":"172.21.15.78:6827/636523247","heartbeat_back_addr":"172.21.15.78:6831/636523247","heartbeat_front_addr":"172.21.15.78:6829/636523247","state":["exists","up"]},{"osd":3,"uuid":"943e38fb-b450-48c0-8f01-d381b0b8e313","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6801","nonce":1841812488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6803","nonce":1841812488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6807","nonce":1841812488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1841812488},{"type":"v1","addr":"172.21.15.78:6805","nonce":1841812488}]},"public_addr":"172.21.15.78:6801/1841812488","cluster_addr":"172.21.15.78:6803/1841812488","heartbeat_back_addr":"172.21.15.78:6807/1841812488","heartbeat_front_addr":"172.21.15.78:6805/1841812488","state":["exists","up"]},{"osd":4,"uuid":"259f50f8-3223-450d-8cd1-d0d333c278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6817","nonce":1803357070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6819","nonce":1803357070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6823","nonce":1803357070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1803357070},{"type":"v1","addr":"172.21.15.175:6821","nonce":1803357070}]},"public_addr":"172.21.15.175:6817/1803357070","cluster_addr":"172.21.15.175:6819/1803357070","heartbeat_back_addr":"172.21.15.175:6823/1803357070","heartbeat_front_addr":"172.21.15.175:6821/1803357070","state":["exists","up"]},{"osd":5,"uuid":"d70426cd-a39b-4a20-8c7b-bedc8352e303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6825","nonce":2221415707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6827","nonce":2221415707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6831","nonce":2221415707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2221415707},{"type":"v1","addr":"172.21.15.175:6829","nonce":2221415707}]},"public_addr":"172.21.15.175:6825/2221415707","cluster_addr":"172.21.15.175:6827/2221415707","heartbeat_back_addr":"172.21.15.175:6831/2221415707","heartbeat_front_addr":"172.21.15.175:6829/2221415707","state":["exists","up"]},{"osd":6,"uuid":"95b9ed3a-cbfc-45a5-8967-88db9da099ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6801","nonce":1974018373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6803","nonce":1974018373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6807","nonce":1974018373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1974018373},{"type":"v1","addr":"172.21.15.175:6805","nonce":1974018373}]},"public_addr":"172.21.15.175:6801/1974018373","cluster_addr":"172.21.15.175:6803/1974018373","heartbeat_back_addr":"172.21.15.175:6807/1974018373","heartbeat_front_addr":"172.21.15.175:6805/1974018373","state":["exists","up"]},{"osd":7,"uuid":"5fc56286-91e9-4a13-b161-ad7d30fc0119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6809","nonce":2386415083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6811","nonce":2386415083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6815","nonce":2386415083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2386415083},{"type":"v1","addr":"172.21.15.175:6813","nonce":2386415083}]},"public_addr":"172.21.15.175:6809/2386415083","cluster_addr":"172.21.15.175:6811/2386415083","heartbeat_back_addr":"172.21.15.175:6815/2386415083","heartbeat_front_addr":"172.21.15.175:6813/2386415083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.191845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.871482+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.594323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.463568+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.398880+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.490112+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.119097+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:02.677350+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":4,"to":6}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:35:21.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.983+0000 7f9ab47cf640 1 -- 172.21.15.78:0/2678689093 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f9a9006c2b0 msgr2=0x7f9a9006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.983+0000 7f9ab47cf640 1 --2- 172.21.15.78:0/2678689093 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f9a9006c2b0 0x7f9a9006e770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0b0290 tx=0x7f9aa8008040 comp rx=0 tx=0).stop 2024-09-15T22:35:21.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.983+0000 7f9ab47cf640 1 -- 172.21.15.78:0/2678689093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac0b48b0 msgr2=0x7f9aac0b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.983+0000 7f9ab47cf640 1 --2- 172.21.15.78:0/2678689093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac0b48b0 0x7f9aac0b2660 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0090b0 tx=0x7f9a9c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.983+0000 7f9ab47cf640 1 -- 172.21.15.78:0/2678689093 shutdown_connections 2024-09-15T22:35:21.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.983+0000 7f9ab47cf640 1 --2- 172.21.15.78:0/2678689093 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f9a9006c2b0 0x7f9a9006e770 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.983+0000 7f9ab47cf640 1 --2- 172.21.15.78:0/2678689093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9aac143080 0x7f9aac141750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.983+0000 7f9ab47cf640 1 --2- 172.21.15.78:0/2678689093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac0b48b0 0x7f9aac0b2660 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.983+0000 7f9ab47cf640 1 --2- 172.21.15.78:0/2678689093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9aac0630c0 0x7f9aac1e0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.983+0000 7f9ab47cf640 1 -- 172.21.15.78:0/2678689093 >> 172.21.15.78:0/2678689093 conn(0x7f9aac0b6470 msgr2=0x7f9aac0b8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:21.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.983+0000 7f9ab47cf640 1 -- 172.21.15.78:0/2678689093 shutdown_connections 2024-09-15T22:35:21.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:21.983+0000 7f9ab47cf640 1 -- 172.21.15.78:0/2678689093 wait complete. 2024-09-15T22:35:21.996 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:35:22.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.094+0000 7f0971cd0640 1 Processor -- start 2024-09-15T22:35:22.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.094+0000 7f0971cd0640 1 -- start start 2024-09-15T22:35:22.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.095+0000 7f0971cd0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f096c09d4c0 0x7f096c148290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:22.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.095+0000 7f0971cd0640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096c148b60 con 0x7f096c0b41a0 2024-09-15T22:35:22.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.095+0000 7f0971cd0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096c148880 con 0x7f096c147eb0 2024-09-15T22:35:22.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.095+0000 7f0971cd0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f096c0b3d10 con 0x7f096c09d4c0 2024-09-15T22:35:22.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.095+0000 7f096bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f096c0b41a0 0x7f096c14ef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45008/0 (socket says 172.21.15.78:45008) 2024-09-15T22:35:22.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.095+0000 7f096bfff640 1 -- 172.21.15.78:0/3063341501 learned_addr learned my addr 172.21.15.78:0/3063341501 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:35:22.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.095+0000 7f096a7fc640 1 -- 172.21.15.78:0/3063341501 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3477862412 0 0) 0x7f096c148b60 con 0x7f096c0b41a0 2024-09-15T22:35:22.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.095+0000 7f096affd640 1 --2- 172.21.15.78:0/3063341501 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f096c09d4c0 0x7f096c148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:22.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.095+0000 7f096a7fc640 1 -- 172.21.15.78:0/3063341501 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0954003520 con 0x7f096c0b41a0 2024-09-15T22:35:22.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096a7fc640 1 -- 172.21.15.78:0/3063341501 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1277776841 0 0) 0x7f0954003520 con 0x7f096c0b41a0 2024-09-15T22:35:22.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096a7fc640 1 -- 172.21.15.78:0/3063341501 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f096c09d4c0 msgr2=0x7f096c148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:22.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096a7fc640 1 --2- 172.21.15.78:0/3063341501 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f096c09d4c0 0x7f096c148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096a7fc640 1 -- 172.21.15.78:0/3063341501 >> v1:172.21.15.175:6789/0 conn(0x7f096c147eb0 legacy=0x7f096c141860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:22.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096a7fc640 1 -- 172.21.15.78:0/3063341501 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c09c290 con 0x7f096c0b41a0 2024-09-15T22:35:22.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096a7fc640 1 -- 172.21.15.78:0/3063341501 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3961011974 0 0) 0x7f0964001670 con 0x7f096c0b41a0 2024-09-15T22:35:22.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096a7fc640 1 -- 172.21.15.78:0/3063341501 >> v1:172.21.15.78:6789/0 conn(0x7f096c0b41a0 legacy=0x7f096c14ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:22.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096a7fc640 1 --2- 172.21.15.78:0/3063341501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09540039e0 0x7f0954003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:22.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096a7fc640 1 --2- 172.21.15.78:0/3063341501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0954004800 0x7f0954004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:22.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096a7fc640 1 --2- 172.21.15.78:0/3063341501 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f096c09d4c0 0x7f0954005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:22.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096a7fc640 1 -- 172.21.15.78:0/3063341501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f096c0b3d10 con 0x7f0954004800 2024-09-15T22:35:22.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096a7fc640 1 -- 172.21.15.78:0/3063341501 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f095400bb20 con 0x7f09540039e0 2024-09-15T22:35:22.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096a7fc640 1 -- 172.21.15.78:0/3063341501 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f095400bd20 con 0x7f096c09d4c0 2024-09-15T22:35:22.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096affd640 1 --2- 172.21.15.78:0/3063341501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0954004800 0x7f0954004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:22.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096b7fe640 1 --2- 172.21.15.78:0/3063341501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09540039e0 0x7f0954003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:22.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096bfff640 1 --2- 172.21.15.78:0/3063341501 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f096c09d4c0 0x7f0954005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:22.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096affd640 1 -- 172.21.15.78:0/3063341501 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f096c09d4c0 msgr2=0x7f0954005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:22.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096affd640 1 --2- 172.21.15.78:0/3063341501 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f096c09d4c0 0x7f0954005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096affd640 1 -- 172.21.15.78:0/3063341501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09540039e0 msgr2=0x7f0954003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:22.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096affd640 1 --2- 172.21.15.78:0/3063341501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09540039e0 0x7f0954003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096affd640 1 -- 172.21.15.78:0/3063341501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0954003520 con 0x7f0954004800 2024-09-15T22:35:22.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.096+0000 7f096bfff640 1 --2- 172.21.15.78:0/3063341501 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f096c09d4c0 0x7f0954005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:35:22.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.097+0000 7f096affd640 1 --2- 172.21.15.78:0/3063341501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0954004800 0x7f0954004c80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f096c09dd60 tx=0x7f0954005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570c29cc62e9df8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:22.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.097+0000 7f096a7fc640 1 -- 172.21.15.78:0/3063341501 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0960036070 con 0x7f0954004800 2024-09-15T22:35:22.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.097+0000 7f096a7fc640 1 -- 172.21.15.78:0/3063341501 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0960031400 con 0x7f0954004800 2024-09-15T22:35:22.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.097+0000 7f096a7fc640 1 -- 172.21.15.78:0/3063341501 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0960009690 con 0x7f0954004800 2024-09-15T22:35:22.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.097+0000 7f0971cd0640 1 -- 172.21.15.78:0/3063341501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0954004800 msgr2=0x7f0954004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:22.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.097+0000 7f0971cd0640 1 --2- 172.21.15.78:0/3063341501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0954004800 0x7f0954004c80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f096c09dd60 tx=0x7f0954005830 comp rx=0 tx=0).stop 2024-09-15T22:35:22.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.097+0000 7f096bfff640 1 -- 172.21.15.78:0/3063341501 reap_dead start 2024-09-15T22:35:22.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.097+0000 7f0971cd0640 1 -- 172.21.15.78:0/3063341501 shutdown_connections 2024-09-15T22:35:22.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.097+0000 7f0971cd0640 1 -- 172.21.15.78:0/3063341501 >> 172.21.15.78:0/3063341501 conn(0x7f096c06c270 msgr2=0x7f096c06c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:22.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.098+0000 7f0971cd0640 1 -- 172.21.15.78:0/3063341501 shutdown_connections 2024-09-15T22:35:22.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.098+0000 7f0971cd0640 1 -- 172.21.15.78:0/3063341501 wait complete. 2024-09-15T22:35:22.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.099+0000 7f0971cd0640 1 Processor -- start 2024-09-15T22:35:22.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.099+0000 7f0971cd0640 1 -- start start 2024-09-15T22:35:22.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.099+0000 7f0971cd0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0954004800 0x7f096c0b8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:22.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.099+0000 7f0971cd0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f096c146340 0x7f096c131210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:22.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.099+0000 7f0971cd0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f096c131750 0x7f096c1de720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:22.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.099+0000 7f0971cd0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f096c148290 con 0x7f096c146340 2024-09-15T22:35:22.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.099+0000 7f0971cd0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f096c09c9e0 con 0x7f096c131750 2024-09-15T22:35:22.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.099+0000 7f0971cd0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f096c148410 con 0x7f0954004800 2024-09-15T22:35:22.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.099+0000 7f096affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f096c146340 0x7f096c131210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.099+0000 7f096affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f096c146340 0x7f096c131210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33334/0 (socket says 172.21.15.78:33334) 2024-09-15T22:35:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.099+0000 7f096affd640 1 -- 172.21.15.78:0/1121935378 learned_addr learned my addr 172.21.15.78:0/1121935378 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:35:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.100+0000 7f096b7fe640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0954004800 0x7f096c0b8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.100+0000 7f096bfff640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f096c131750 0x7f096c1de720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.100+0000 7f096affd640 1 -- 172.21.15.78:0/1121935378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0954004800 msgr2=0x7f096c0b8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.100+0000 7f096affd640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0954004800 0x7f096c0b8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.100+0000 7f096affd640 1 -- 172.21.15.78:0/1121935378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f096c131750 msgr2=0x7f096c1de720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.100+0000 7f096affd640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f096c131750 0x7f096c1de720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.100+0000 7f096affd640 1 -- 172.21.15.78:0/1121935378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c131bd0 con 0x7f096c146340 2024-09-15T22:35:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.100+0000 7f096b7fe640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0954004800 0x7f096c0b8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:35:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.100+0000 7f096bfff640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f096c131750 0x7f096c1de720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:35:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.100+0000 7f096affd640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f096c146340 0x7f096c131210 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0960009b80 tx=0x7f0960004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.100+0000 7f0953fff640 1 -- 172.21.15.78:0/1121935378 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0960040020 con 0x7f096c146340 2024-09-15T22:35:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.100+0000 7f0953fff640 1 -- 172.21.15.78:0/1121935378 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0960003b40 con 0x7f096c146340 2024-09-15T22:35:22.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.100+0000 7f0971cd0640 1 -- 172.21.15.78:0/1121935378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096c146b00 con 0x7f096c146340 2024-09-15T22:35:22.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.100+0000 7f0953fff640 1 -- 172.21.15.78:0/1121935378 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0960036040 con 0x7f096c146340 2024-09-15T22:35:22.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.100+0000 7f0971cd0640 1 -- 172.21.15.78:0/1121935378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f096c147430 con 0x7f096c146340 2024-09-15T22:35:22.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.101+0000 7f0971cd0640 1 -- 172.21.15.78:0/1121935378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f096c0b4610 con 0x7f096c146340 2024-09-15T22:35:22.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.101+0000 7f0953fff640 1 -- 172.21.15.78:0/1121935378 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0960043020 con 0x7f096c146340 2024-09-15T22:35:22.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.102+0000 7f0953fff640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f095806c2b0 0x7f095806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:22.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.102+0000 7f0953fff640 1 -- 172.21.15.78:0/1121935378 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6822+0+0 (secure 0 0 0) 0x7f09600abe60 con 0x7f096c146340 2024-09-15T22:35:22.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.102+0000 7f096b7fe640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f095806c2b0 0x7f095806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:22.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.102+0000 7f096b7fe640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f095806c2b0 0x7f095806e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f095c0019f0 tx=0x7f095c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:22.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.106+0000 7f0953fff640 1 -- 172.21.15.78:0/1121935378 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f096004a030 con 0x7f096c146340 2024-09-15T22:35:22.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.306+0000 7f0971cd0640 1 -- 172.21.15.78:0/1121935378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f096c0b5700 con 0x7f096c146340 2024-09-15T22:35:22.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.310+0000 7f0953fff640 1 -- 172.21.15.78:0/1121935378 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f096c131bd0 con 0x7f096c146340 2024-09-15T22:35:22.312 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:35:22.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.312+0000 7f0971cd0640 1 -- 172.21.15.78:0/1121935378 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f095806c2b0 msgr2=0x7f095806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:22.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.312+0000 7f0971cd0640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f095806c2b0 0x7f095806e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f095c0019f0 tx=0x7f095c009040 comp rx=0 tx=0).stop 2024-09-15T22:35:22.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.312+0000 7f0971cd0640 1 -- 172.21.15.78:0/1121935378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f096c146340 msgr2=0x7f096c131210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:22.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.312+0000 7f0971cd0640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f096c146340 0x7f096c131210 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0960009b80 tx=0x7f0960004730 comp rx=0 tx=0).stop 2024-09-15T22:35:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.312+0000 7f0971cd0640 1 -- 172.21.15.78:0/1121935378 shutdown_connections 2024-09-15T22:35:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.312+0000 7f0971cd0640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f095806c2b0 0x7f095806e770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.312+0000 7f0971cd0640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f096c131750 0x7f096c1de720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.312+0000 7f0971cd0640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f096c146340 0x7f096c131210 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.312+0000 7f0971cd0640 1 --2- 172.21.15.78:0/1121935378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0954004800 0x7f096c0b8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.312+0000 7f0971cd0640 1 -- 172.21.15.78:0/1121935378 >> 172.21.15.78:0/1121935378 conn(0x7f096c06c270 msgr2=0x7f096c141840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.312+0000 7f0971cd0640 1 -- 172.21.15.78:0/1121935378 shutdown_connections 2024-09-15T22:35:22.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.312+0000 7f0971cd0640 1 -- 172.21.15.78:0/1121935378 wait complete. 2024-09-15T22:35:22.326 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:35:22.418 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2024-09-15T22:35:22.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.424+0000 7f1ee3065640 1 Processor -- start 2024-09-15T22:35:22.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.424+0000 7f1ee3065640 1 -- start start 2024-09-15T22:35:22.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1ee3065640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1edc0b4620 0x7f1edc0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:22.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1ee3065640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1edc072fb0 0x7f1edc145800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1ee3065640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1edc145d40 0x7f1edc148d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1ee3065640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f1edc0b4a00 con 0x7f1edc0b4620 2024-09-15T22:35:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1ee3065640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1edc0734d0 con 0x7f1edc145d40 2024-09-15T22:35:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1ee3065640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1edc0b4dc0 con 0x7f1edc072fb0 2024-09-15T22:35:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1ee0e01640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1edc0b4620 0x7f1edc0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1ee0e01640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1edc0b4620 0x7f1edc0716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33340/0 (socket says 172.21.15.78:33340) 2024-09-15T22:35:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1ee0e01640 1 -- 172.21.15.78:0/1665535311 learned_addr learned my addr 172.21.15.78:0/1665535311 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:35:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1ee1602640 1 --2- 172.21.15.78:0/1665535311 >> v2:172.21.15.175:3300/0 conn(0x7f1edc145d40 0x7f1edc148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1edbfff640 1 --2- 172.21.15.78:0/1665535311 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1edc072fb0 0x7f1edc145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1ee0e01640 1 -- 172.21.15.78:0/1665535311 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1edc072fb0 msgr2=0x7f1edc145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1ee0e01640 1 --2- 172.21.15.78:0/1665535311 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1edc072fb0 0x7f1edc145800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1ee0e01640 1 -- 172.21.15.78:0/1665535311 >> v2:172.21.15.175:3300/0 conn(0x7f1edc145d40 msgr2=0x7f1edc148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:22.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1ee0e01640 1 --2- 172.21.15.78:0/1665535311 >> v2:172.21.15.175:3300/0 conn(0x7f1edc145d40 0x7f1edc148d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.425+0000 7f1ee0e01640 1 -- 172.21.15.78:0/1665535311 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1edc0b50a0 con 0x7f1edc0b4620 2024-09-15T22:35:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.426+0000 7f1ee0e01640 1 --2- 172.21.15.78:0/1665535311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc0b4620 0x7f1edc0716c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1edc071510 tx=0x7f1ecc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3506c267ca3fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.426+0000 7f1edb7fe640 1 -- 172.21.15.78:0/1665535311 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc037070 con 0x7f1edc0b4620 2024-09-15T22:35:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.426+0000 7f1edb7fe640 1 -- 172.21.15.78:0/1665535311 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1ecc032440 con 0x7f1edc0b4620 2024-09-15T22:35:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.426+0000 7f1edb7fe640 1 -- 172.21.15.78:0/1665535311 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc032830 con 0x7f1edc0b4620 2024-09-15T22:35:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.427+0000 7f1ee3065640 1 -- 172.21.15.78:0/1665535311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc0b4620 msgr2=0x7f1edc0716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.427+0000 7f1ee3065640 1 --2- 172.21.15.78:0/1665535311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc0b4620 0x7f1edc0716c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1edc071510 tx=0x7f1ecc02a1e0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.427+0000 7f1ee3065640 1 -- 172.21.15.78:0/1665535311 shutdown_connections 2024-09-15T22:35:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.427+0000 7f1ee3065640 1 --2- 172.21.15.78:0/1665535311 >> v2:172.21.15.175:3300/0 conn(0x7f1edc145d40 0x7f1edc148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.427+0000 7f1ee3065640 1 --2- 172.21.15.78:0/1665535311 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1edc072fb0 0x7f1edc145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.427+0000 7f1ee3065640 1 --2- 172.21.15.78:0/1665535311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc0b4620 0x7f1edc0716c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.427+0000 7f1ee3065640 1 -- 172.21.15.78:0/1665535311 >> 172.21.15.78:0/1665535311 conn(0x7f1edc0bb390 msgr2=0x7f1edc0bb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.427+0000 7f1ee3065640 1 -- 172.21.15.78:0/1665535311 shutdown_connections 2024-09-15T22:35:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.427+0000 7f1ee3065640 1 -- 172.21.15.78:0/1665535311 wait complete. 2024-09-15T22:35:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.428+0000 7f1ee3065640 1 Processor -- start 2024-09-15T22:35:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.428+0000 7f1ee3065640 1 -- start start 2024-09-15T22:35:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1ee3065640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1edc072fb0 0x7f1edc145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1ee3065640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc0b4620 0x7f1edc1ddd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1ee3065640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1edc145d40 0x7f1edc1de2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1ee3065640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc071c00 con 0x7f1edc0b4620 2024-09-15T22:35:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1ee3065640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc072ce0 con 0x7f1edc145d40 2024-09-15T22:35:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1ee3065640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1edc071d80 con 0x7f1edc072fb0 2024-09-15T22:35:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1edbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc0b4620 0x7f1edc1ddd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1edbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc0b4620 0x7f1edc1ddd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33342/0 (socket says 172.21.15.78:33342) 2024-09-15T22:35:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1edbfff640 1 -- 172.21.15.78:0/3735132585 learned_addr learned my addr 172.21.15.78:0/3735132585 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:35:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1ee1602640 1 --2- 172.21.15.78:0/3735132585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1edc145d40 0x7f1edc1de2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1ee0e01640 1 --2- 172.21.15.78:0/3735132585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1edc072fb0 0x7f1edc145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1edbfff640 1 -- 172.21.15.78:0/3735132585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1edc072fb0 msgr2=0x7f1edc145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1edbfff640 1 --2- 172.21.15.78:0/3735132585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1edc072fb0 0x7f1edc145600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1edbfff640 1 -- 172.21.15.78:0/3735132585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1edc145d40 msgr2=0x7f1edc1de2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1edbfff640 1 --2- 172.21.15.78:0/3735132585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1edc145d40 0x7f1edc1de2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1edbfff640 1 -- 172.21.15.78:0/3735132585 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1edc0af5d0 con 0x7f1edc0b4620 2024-09-15T22:35:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.429+0000 7f1edbfff640 1 --2- 172.21.15.78:0/3735132585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc0b4620 0x7f1edc1ddd60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000d800 tx=0x7f1ed000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.430+0000 7f1ed97fa640 1 -- 172.21.15.78:0/3735132585 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed000b660 con 0x7f1edc0b4620 2024-09-15T22:35:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.430+0000 7f1ed97fa640 1 -- 172.21.15.78:0/3735132585 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1ed0019070 con 0x7f1edc0b4620 2024-09-15T22:35:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.430+0000 7f1ee3065640 1 -- 172.21.15.78:0/3735132585 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1edc0ae880 con 0x7f1edc0b4620 2024-09-15T22:35:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.430+0000 7f1ed97fa640 1 -- 172.21.15.78:0/3735132585 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed000ba40 con 0x7f1edc0b4620 2024-09-15T22:35:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.430+0000 7f1ee3065640 1 -- 172.21.15.78:0/3735132585 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1edc0af840 con 0x7f1edc0b4620 2024-09-15T22:35:22.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.431+0000 7f1ee3065640 1 -- 172.21.15.78:0/3735132585 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1edc146310 con 0x7f1edc0b4620 2024-09-15T22:35:22.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.431+0000 7f1ed97fa640 1 -- 172.21.15.78:0/3735132585 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1ed000bbe0 con 0x7f1edc0b4620 2024-09-15T22:35:22.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.431+0000 7f1ed97fa640 1 --2- 172.21.15.78:0/3735132585 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f1ec806c2b0 0x7f1ec806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:22.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.432+0000 7f1ed97fa640 1 -- 172.21.15.78:0/3735132585 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6908+0+0 (secure 0 0 0) 0x7f1ed008bc10 con 0x7f1edc0b4620 2024-09-15T22:35:22.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.432+0000 7f1ee0e01640 1 --2- 172.21.15.78:0/3735132585 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f1ec806c2b0 0x7f1ec806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:22.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.432+0000 7f1ee0e01640 1 --2- 172.21.15.78:0/3735132585 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f1ec806c2b0 0x7f1ec806e770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc034000 tx=0x7f1ecc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:22.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.436+0000 7f1ed97fa640 1 -- 172.21.15.78:0/3735132585 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1edc146310 con 0x7f1edc0b4620 2024-09-15T22:35:22.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:22.634+0000 7f1ee3065640 1 -- 172.21.15.78:0/3735132585 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1edc072610 con 0x7f1edc0b4620 2024-09-15T22:35:23.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.313+0000 7f1ed97fa640 1 -- 172.21.15.78:0/3735132585 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f1ed0059890 con 0x7f1edc0b4620 2024-09-15T22:35:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.316+0000 7f1ee3065640 1 -- 172.21.15.78:0/3735132585 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f1ec806c2b0 msgr2=0x7f1ec806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.316+0000 7f1ee3065640 1 --2- 172.21.15.78:0/3735132585 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f1ec806c2b0 0x7f1ec806e770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc034000 tx=0x7f1ecc02e000 comp rx=0 tx=0).stop 2024-09-15T22:35:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.316+0000 7f1ee3065640 1 -- 172.21.15.78:0/3735132585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc0b4620 msgr2=0x7f1edc1ddd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.316+0000 7f1ee3065640 1 --2- 172.21.15.78:0/3735132585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc0b4620 0x7f1edc1ddd60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000d800 tx=0x7f1ed000dcc0 comp rx=0 tx=0).stop 2024-09-15T22:35:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.316+0000 7f1ee3065640 1 -- 172.21.15.78:0/3735132585 shutdown_connections 2024-09-15T22:35:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.316+0000 7f1ee3065640 1 --2- 172.21.15.78:0/3735132585 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f1ec806c2b0 0x7f1ec806e770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.316+0000 7f1ee3065640 1 --2- 172.21.15.78:0/3735132585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1edc145d40 0x7f1edc1de2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.316+0000 7f1ee3065640 1 --2- 172.21.15.78:0/3735132585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc0b4620 0x7f1edc1ddd60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.316+0000 7f1ee3065640 1 --2- 172.21.15.78:0/3735132585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1edc072fb0 0x7f1edc145600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.316+0000 7f1ee3065640 1 -- 172.21.15.78:0/3735132585 >> 172.21.15.78:0/3735132585 conn(0x7f1edc0bb390 msgr2=0x7f1edc0bb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.316+0000 7f1ee3065640 1 -- 172.21.15.78:0/3735132585 shutdown_connections 2024-09-15T22:35:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.316+0000 7f1ee3065640 1 -- 172.21.15.78:0/3735132585 wait complete. 2024-09-15T22:35:23.330 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:35:23.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.433+0000 7f8c21eba640 1 Processor -- start 2024-09-15T22:35:23.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.433+0000 7f8c21eba640 1 -- start start 2024-09-15T22:35:23.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.434+0000 7f8c21eba640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c1c0b1890 0x7f8c1c149510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:23.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.434+0000 7f8c21eba640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c1c149a50 0x7f8c1c149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:23.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.434+0000 7f8c21eba640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c1c0b10b0 con 0x7f8c1c06e850 2024-09-15T22:35:23.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.434+0000 7f8c21eba640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f8c1c0b7b40 con 0x7f8c1c149a50 2024-09-15T22:35:23.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.434+0000 7f8c21eba640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1c0b7d90 con 0x7f8c1c0b1890 2024-09-15T22:35:23.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.434+0000 7f8c1bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c1c149a50 0x7f8c1c149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:23.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.434+0000 7f8c1b7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8c1c06e850 0x7f8c1c09e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45016/0 (socket says 172.21.15.78:45016) 2024-09-15T22:35:23.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.434+0000 7f8c1b7fe640 1 -- 172.21.15.78:0/1737565003 learned_addr learned my addr 172.21.15.78:0/1737565003 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:35:23.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.435+0000 7f8c12ffd640 1 --2- 172.21.15.78:0/1737565003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c1c0b1890 0x7f8c1c149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:23.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.435+0000 7f8c1bfff640 1 -- 172.21.15.78:0/1737565003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c1c0b1890 msgr2=0x7f8c1c149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:23.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.435+0000 7f8c1bfff640 1 --2- 172.21.15.78:0/1737565003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c1c0b1890 0x7f8c1c149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:23.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.435+0000 7f8c1bfff640 1 -- 172.21.15.78:0/1737565003 >> v1:172.21.15.78:6789/0 conn(0x7f8c1c06e850 legacy=0x7f8c1c09e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:23.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.435+0000 7f8c1bfff640 1 -- 172.21.15.78:0/1737565003 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c06ec30 con 0x7f8c1c149a50 2024-09-15T22:35:23.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.435+0000 7f8c1affd640 1 -- 172.21.15.78:0/1737565003 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4113915403 0 0) 0x7f8c1c0b10b0 con 0x7f8c1c06e850 2024-09-15T22:35:23.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.435+0000 7f8c12ffd640 1 --2- 172.21.15.78:0/1737565003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c1c0b1890 0x7f8c1c149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:35:23.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.435+0000 7f8c1bfff640 1 --2- 172.21.15.78:0/1737565003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1c149a50 0x7f8c1c149ee0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009d90 tx=0x7f8c1402a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a8f95826707141 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:23.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.435+0000 7f8c1affd640 1 -- 172.21.15.78:0/1737565003 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c14007740 con 0x7f8c1c149a50 2024-09-15T22:35:23.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.435+0000 7f8c1affd640 1 -- 172.21.15.78:0/1737565003 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8c140078e0 con 0x7f8c1c149a50 2024-09-15T22:35:23.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.435+0000 7f8c1affd640 1 -- 172.21.15.78:0/1737565003 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c14007cd0 con 0x7f8c1c149a50 2024-09-15T22:35:23.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.436+0000 7f8c21eba640 1 -- 172.21.15.78:0/1737565003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1c149a50 msgr2=0x7f8c1c149ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:23.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.436+0000 7f8c21eba640 1 --2- 172.21.15.78:0/1737565003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1c149a50 0x7f8c1c149ee0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009d90 tx=0x7f8c1402a530 comp rx=0 tx=0).stop 2024-09-15T22:35:23.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.436+0000 7f8c21eba640 1 -- 172.21.15.78:0/1737565003 shutdown_connections 2024-09-15T22:35:23.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.436+0000 7f8c21eba640 1 --2- 172.21.15.78:0/1737565003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1c149a50 0x7f8c1c149ee0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:23.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.436+0000 7f8c21eba640 1 --2- 172.21.15.78:0/1737565003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c1c0b1890 0x7f8c1c149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:23.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.436+0000 7f8c21eba640 1 -- 172.21.15.78:0/1737565003 >> 172.21.15.78:0/1737565003 conn(0x7f8c1c075840 msgr2=0x7f8c1c0bb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:23.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.436+0000 7f8c21eba640 1 -- 172.21.15.78:0/1737565003 shutdown_connections 2024-09-15T22:35:23.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.436+0000 7f8c21eba640 1 -- 172.21.15.78:0/1737565003 wait complete. 2024-09-15T22:35:23.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.437+0000 7f8c21eba640 1 Processor -- start 2024-09-15T22:35:23.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.437+0000 7f8c21eba640 1 -- start start 2024-09-15T22:35:23.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c21eba640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c1c06e850 0x7f8c1c1deb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:23.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c21eba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c1c0b1890 0x7f8c1c123790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:23.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c21eba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1c149a50 0x7f8c1c123cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:23.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c21eba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c0b1590 con 0x7f8c1c149a50 2024-09-15T22:35:23.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c21eba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c09ec40 con 0x7f8c1c0b1890 2024-09-15T22:35:23.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c21eba640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1c073fb0 con 0x7f8c1c06e850 2024-09-15T22:35:23.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c1bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1c149a50 0x7f8c1c123cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:23.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c1bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1c149a50 0x7f8c1c123cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33350/0 (socket says 172.21.15.78:33350) 2024-09-15T22:35:23.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c1bfff640 1 -- 172.21.15.78:0/747655808 learned_addr learned my addr 172.21.15.78:0/747655808 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:35:23.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c1b7fe640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c1c06e850 0x7f8c1c1deb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:23.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c12ffd640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c1c0b1890 0x7f8c1c123790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:23.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c1bfff640 1 -- 172.21.15.78:0/747655808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c1c06e850 msgr2=0x7f8c1c1deb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:23.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c1bfff640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c1c06e850 0x7f8c1c1deb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:23.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c1bfff640 1 -- 172.21.15.78:0/747655808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c1c0b1890 msgr2=0x7f8c1c123790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:23.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c1bfff640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c1c0b1890 0x7f8c1c123790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:23.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c1bfff640 1 -- 172.21.15.78:0/747655808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c0b4a70 con 0x7f8c1c149a50 2024-09-15T22:35:23.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c1b7fe640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c1c06e850 0x7f8c1c1deb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:35:23.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c12ffd640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c1c0b1890 0x7f8c1c123790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:35:23.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.438+0000 7f8c1bfff640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1c149a50 0x7f8c1c123cd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009d90 tx=0x7f8c14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:23.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.439+0000 7f8c18ff9640 1 -- 172.21.15.78:0/747655808 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c14040070 con 0x7f8c1c149a50 2024-09-15T22:35:23.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.439+0000 7f8c18ff9640 1 -- 172.21.15.78:0/747655808 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8c14031c90 con 0x7f8c1c149a50 2024-09-15T22:35:23.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.439+0000 7f8c21eba640 1 -- 172.21.15.78:0/747655808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1c1df660 con 0x7f8c1c149a50 2024-09-15T22:35:23.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.439+0000 7f8c18ff9640 1 -- 172.21.15.78:0/747655808 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c140456c0 con 0x7f8c1c149a50 2024-09-15T22:35:23.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.439+0000 7f8c21eba640 1 -- 172.21.15.78:0/747655808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1c125c70 con 0x7f8c1c149a50 2024-09-15T22:35:23.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.440+0000 7f8c21eba640 1 -- 172.21.15.78:0/747655808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c1c0b6e90 con 0x7f8c1c149a50 2024-09-15T22:35:23.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.440+0000 7f8c18ff9640 1 -- 172.21.15.78:0/747655808 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8c14039040 con 0x7f8c1c149a50 2024-09-15T22:35:23.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.440+0000 7f8c18ff9640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8bfc06c2b0 0x7f8bfc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:23.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.441+0000 7f8c18ff9640 1 -- 172.21.15.78:0/747655808 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6908+0+0 (secure 0 0 0) 0x7f8c140ad300 con 0x7f8c1c149a50 2024-09-15T22:35:23.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.441+0000 7f8c1b7fe640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8bfc06c2b0 0x7f8bfc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:23.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.441+0000 7f8c1b7fe640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8bfc06c2b0 0x7f8bfc06e770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c000f60 tx=0x7f8c0c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:23.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.445+0000 7f8c18ff9640 1 -- 172.21.15.78:0/747655808 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c1c0b6e90 con 0x7f8c1c149a50 2024-09-15T22:35:23.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:23.610+0000 7f8c21eba640 1 -- 172.21.15.78:0/747655808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8c1c123060 con 0x7f8c1c149a50 2024-09-15T22:35:24.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.317+0000 7f8c18ff9640 1 -- 172.21.15.78:0/747655808 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7f8c1407b650 con 0x7f8c1c149a50 2024-09-15T22:35:24.319 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:35:24.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.320+0000 7f8c21eba640 1 -- 172.21.15.78:0/747655808 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8bfc06c2b0 msgr2=0x7f8bfc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:24.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.320+0000 7f8c21eba640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8bfc06c2b0 0x7f8bfc06e770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c000f60 tx=0x7f8c0c009040 comp rx=0 tx=0).stop 2024-09-15T22:35:24.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.320+0000 7f8c21eba640 1 -- 172.21.15.78:0/747655808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1c149a50 msgr2=0x7f8c1c123cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.320+0000 7f8c21eba640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1c149a50 0x7f8c1c123cd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009d90 tx=0x7f8c14004a40 comp rx=0 tx=0).stop 2024-09-15T22:35:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.320+0000 7f8c21eba640 1 -- 172.21.15.78:0/747655808 shutdown_connections 2024-09-15T22:35:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.320+0000 7f8c21eba640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f8bfc06c2b0 0x7f8bfc06e770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.320+0000 7f8c21eba640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1c149a50 0x7f8c1c123cd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.320+0000 7f8c21eba640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c1c0b1890 0x7f8c1c123790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.320+0000 7f8c21eba640 1 --2- 172.21.15.78:0/747655808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c1c06e850 0x7f8c1c1deb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.320+0000 7f8c21eba640 1 -- 172.21.15.78:0/747655808 >> 172.21.15.78:0/747655808 conn(0x7f8c1c075840 msgr2=0x7f8c1c0b8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.321+0000 7f8c21eba640 1 -- 172.21.15.78:0/747655808 shutdown_connections 2024-09-15T22:35:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.321+0000 7f8c21eba640 1 -- 172.21.15.78:0/747655808 wait complete. 2024-09-15T22:35:24.337 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:35:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.444+0000 7f667ab8d640 1 Processor -- start 2024-09-15T22:35:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.444+0000 7f667ab8d640 1 -- start start 2024-09-15T22:35:24.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f667ab8d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66740b8ba0 0x7f66740b8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f667ab8d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6674144870 con 0x7f6674145330 2024-09-15T22:35:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f667ab8d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6674144b30 con 0x7f66740b6b10 2024-09-15T22:35:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f667ab8d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f66741457c0 con 0x7f66740b8ba0 2024-09-15T22:35:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f667912a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6674145330 0x7f66740b61d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45028/0 (socket says 172.21.15.78:45028) 2024-09-15T22:35:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f667912a640 1 -- 172.21.15.78:0/1304259120 learned_addr learned my addr 172.21.15.78:0/1304259120 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-09-15T22:35:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f6678929640 1 --2- 172.21.15.78:0/1304259120 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66740b8ba0 0x7f66740b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2040550223 0 0) 0x7f6674144870 con 0x7f6674145330 2024-09-15T22:35:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f665c003520 con 0x7f6674145330 2024-09-15T22:35:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099814985 0 0) 0x7f6674144b30 con 0x7f66740b6b10 2024-09-15T22:35:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6674144870 con 0x7f66740b6b10 2024-09-15T22:35:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3801047703 0 0) 0x7f665c003520 con 0x7f6674145330 2024-09-15T22:35:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66740b8ba0 msgr2=0x7f66740b8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f66737fe640 1 --2- 172.21.15.78:0/1304259120 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66740b8ba0 0x7f66740b8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 >> v1:172.21.15.175:6789/0 conn(0x7f66740b6b10 legacy=0x7f66740b9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66740b8f80 con 0x7f6674145330 2024-09-15T22:35:24.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3961011974 0 0) 0x7f666c0019f0 con 0x7f6674145330 2024-09-15T22:35:24.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 >> v1:172.21.15.78:6789/0 conn(0x7f6674145330 legacy=0x7f66740b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:24.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.445+0000 7f66737fe640 1 --2- 172.21.15.78:0/1304259120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f665c003b70 0x7f665c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.446+0000 7f66737fe640 1 --2- 172.21.15.78:0/1304259120 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66740b8ba0 0x7f665c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.446+0000 7f66737fe640 1 --2- 172.21.15.78:0/1304259120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f665c004d40 0x7f665c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.446+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f665c00ba70 con 0x7f665c004d40 2024-09-15T22:35:24.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.446+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f665c00bbf0 con 0x7f665c003b70 2024-09-15T22:35:24.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.446+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f665c00bdf0 con 0x7f66740b8ba0 2024-09-15T22:35:24.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.446+0000 7f6678929640 1 --2- 172.21.15.78:0/1304259120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f665c003b70 0x7f665c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.446+0000 7f667912a640 1 --2- 172.21.15.78:0/1304259120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f665c004d40 0x7f665c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.446+0000 7f6673fff640 1 --2- 172.21.15.78:0/1304259120 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66740b8ba0 0x7f665c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.446+0000 7f667912a640 1 -- 172.21.15.78:0/1304259120 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66740b8ba0 msgr2=0x7f665c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:24.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.446+0000 7f667912a640 1 --2- 172.21.15.78:0/1304259120 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66740b8ba0 0x7f665c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.446+0000 7f667912a640 1 -- 172.21.15.78:0/1304259120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f665c003b70 msgr2=0x7f665c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:24.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.446+0000 7f667912a640 1 --2- 172.21.15.78:0/1304259120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f665c003b70 0x7f665c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.446+0000 7f667912a640 1 -- 172.21.15.78:0/1304259120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c003520 con 0x7f665c004d40 2024-09-15T22:35:24.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.447+0000 7f667912a640 1 --2- 172.21.15.78:0/1304259120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f665c004d40 0x7f665c0051c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f666c00a720 tx=0x7f665c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5747d1d1fb227cd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:24.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.447+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c00a370 con 0x7f665c004d40 2024-09-15T22:35:24.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.447+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f666c02f070 con 0x7f665c004d40 2024-09-15T22:35:24.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.447+0000 7f66737fe640 1 -- 172.21.15.78:0/1304259120 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c02bbb0 con 0x7f665c004d40 2024-09-15T22:35:24.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.447+0000 7f667ab8d640 1 -- 172.21.15.78:0/1304259120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f665c004d40 msgr2=0x7f665c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:24.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.447+0000 7f667ab8d640 1 --2- 172.21.15.78:0/1304259120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f665c004d40 0x7f665c0051c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f666c00a720 tx=0x7f665c005830 comp rx=0 tx=0).stop 2024-09-15T22:35:24.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.447+0000 7f667912a640 1 -- 172.21.15.78:0/1304259120 reap_dead start 2024-09-15T22:35:24.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.447+0000 7f667ab8d640 1 -- 172.21.15.78:0/1304259120 shutdown_connections 2024-09-15T22:35:24.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.447+0000 7f667ab8d640 1 -- 172.21.15.78:0/1304259120 >> 172.21.15.78:0/1304259120 conn(0x7f667409c1f0 msgr2=0x7f667409c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:24.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.447+0000 7f667ab8d640 1 -- 172.21.15.78:0/1304259120 shutdown_connections 2024-09-15T22:35:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.447+0000 7f667ab8d640 1 -- 172.21.15.78:0/1304259120 wait complete. 2024-09-15T22:35:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.448+0000 7f667ab8d640 1 Processor -- start 2024-09-15T22:35:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.448+0000 7f667ab8d640 1 -- start start 2024-09-15T22:35:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.449+0000 7f667ab8d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66740b3690 0x7f66741d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.449+0000 7f667ab8d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66741db1b0 0x7f667409b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.449+0000 7f667ab8d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66741db630 0x7f667409b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.449+0000 7f667ab8d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6674144ea0 con 0x7f66741db630 2024-09-15T22:35:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.449+0000 7f667ab8d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f66740b8490 con 0x7f66741db1b0 2024-09-15T22:35:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.449+0000 7f667ab8d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f66740b68e0 con 0x7f66740b3690 2024-09-15T22:35:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.449+0000 7f667912a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66741db630 0x7f667409b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.449+0000 7f667912a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66741db630 0x7f667409b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33370/0 (socket says 172.21.15.78:33370) 2024-09-15T22:35:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.449+0000 7f667912a640 1 -- 172.21.15.78:0/3508398146 learned_addr learned my addr 172.21.15.78:0/3508398146 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:35:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.449+0000 7f6673fff640 1 --2- 172.21.15.78:0/3508398146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66741db1b0 0x7f667409b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.449+0000 7f6678929640 1 --2- 172.21.15.78:0/3508398146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66740b3690 0x7f66741d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.450+0000 7f667912a640 1 -- 172.21.15.78:0/3508398146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66740b3690 msgr2=0x7f66741d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:24.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.450+0000 7f667912a640 1 --2- 172.21.15.78:0/3508398146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66740b3690 0x7f66741d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.450+0000 7f667912a640 1 -- 172.21.15.78:0/3508398146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66741db1b0 msgr2=0x7f667409b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:24.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.450+0000 7f667912a640 1 --2- 172.21.15.78:0/3508398146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66741db1b0 0x7f667409b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.450+0000 7f667912a640 1 -- 172.21.15.78:0/3508398146 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66740b3a70 con 0x7f66741db630 2024-09-15T22:35:24.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.450+0000 7f6678929640 1 --2- 172.21.15.78:0/3508398146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66740b3690 0x7f66741d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:35:24.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.450+0000 7f667912a640 1 --2- 172.21.15.78:0/3508398146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66741db630 0x7f667409b970 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f666c00a720 tx=0x7f666c02d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:24.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.450+0000 7f66717fa640 1 -- 172.21.15.78:0/3508398146 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c0011c0 con 0x7f66741db630 2024-09-15T22:35:24.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.450+0000 7f66717fa640 1 -- 172.21.15.78:0/3508398146 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f666c00a350 con 0x7f66741db630 2024-09-15T22:35:24.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.450+0000 7f667ab8d640 1 -- 172.21.15.78:0/3508398146 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66740b41b0 con 0x7f66741db630 2024-09-15T22:35:24.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.450+0000 7f66717fa640 1 -- 172.21.15.78:0/3508398146 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c0346d0 con 0x7f66741db630 2024-09-15T22:35:24.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.450+0000 7f667ab8d640 1 -- 172.21.15.78:0/3508398146 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66740b3e40 con 0x7f66741db630 2024-09-15T22:35:24.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.451+0000 7f667ab8d640 1 -- 172.21.15.78:0/3508398146 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66740b4b30 con 0x7f66741db630 2024-09-15T22:35:24.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.451+0000 7f66717fa640 1 -- 172.21.15.78:0/3508398146 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f666c034870 con 0x7f66741db630 2024-09-15T22:35:24.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.452+0000 7f66717fa640 1 --2- 172.21.15.78:0/3508398146 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f666006c2b0 0x7f666006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.452+0000 7f66717fa640 1 -- 172.21.15.78:0/3508398146 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6470+0+0 (secure 0 0 0) 0x7f666c0abab0 con 0x7f66741db630 2024-09-15T22:35:24.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.452+0000 7f6678929640 1 --2- 172.21.15.78:0/3508398146 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f666006c2b0 0x7f666006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.452+0000 7f6678929640 1 --2- 172.21.15.78:0/3508398146 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f666006c2b0 0x7f666006e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6664009bc0 tx=0x7f6664008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:24.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.456+0000 7f66717fa640 1 -- 172.21.15.78:0/3508398146 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66740b4b30 con 0x7f66741db630 2024-09-15T22:35:24.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:24.645+0000 7f667ab8d640 1 -- 172.21.15.78:0/3508398146 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f66740b9a40 con 0x7f66741db630 2024-09-15T22:35:25.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.322+0000 7f66717fa640 1 -- 172.21.15.78:0/3508398146 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f666c046060 con 0x7f66741db630 2024-09-15T22:35:25.324 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2024-09-15T22:35:25.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.327+0000 7f667ab8d640 1 -- 172.21.15.78:0/3508398146 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f666006c2b0 msgr2=0x7f666006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:25.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.327+0000 7f667ab8d640 1 --2- 172.21.15.78:0/3508398146 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f666006c2b0 0x7f666006e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6664009bc0 tx=0x7f6664008040 comp rx=0 tx=0).stop 2024-09-15T22:35:25.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.327+0000 7f667ab8d640 1 -- 172.21.15.78:0/3508398146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66741db630 msgr2=0x7f667409b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:25.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.327+0000 7f667ab8d640 1 --2- 172.21.15.78:0/3508398146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66741db630 0x7f667409b970 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f666c00a720 tx=0x7f666c02d070 comp rx=0 tx=0).stop 2024-09-15T22:35:25.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.327+0000 7f667ab8d640 1 -- 172.21.15.78:0/3508398146 shutdown_connections 2024-09-15T22:35:25.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.327+0000 7f667ab8d640 1 --2- 172.21.15.78:0/3508398146 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f666006c2b0 0x7f666006e770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.327+0000 7f667ab8d640 1 --2- 172.21.15.78:0/3508398146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66741db630 0x7f667409b970 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.327+0000 7f667ab8d640 1 --2- 172.21.15.78:0/3508398146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66741db1b0 0x7f667409b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.327+0000 7f667ab8d640 1 --2- 172.21.15.78:0/3508398146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66740b3690 0x7f66741d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.327+0000 7f667ab8d640 1 -- 172.21.15.78:0/3508398146 >> 172.21.15.78:0/3508398146 conn(0x7f667409c1f0 msgr2=0x7f66741ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:25.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.327+0000 7f667ab8d640 1 -- 172.21.15.78:0/3508398146 shutdown_connections 2024-09-15T22:35:25.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.327+0000 7f667ab8d640 1 -- 172.21.15.78:0/3508398146 wait complete. 2024-09-15T22:35:25.347 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-15T22:35:25.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.456+0000 7f618e665640 1 Processor -- start 2024-09-15T22:35:25.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.456+0000 7f618e665640 1 -- start start 2024-09-15T22:35:25.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.457+0000 7f618e665640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f618809fe40 0x7f618809bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:25.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.457+0000 7f618e665640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61881488a0 0x7f6188144be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:25.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.457+0000 7f618e665640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6188145120 0x7f618814b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:25.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.457+0000 7f618e665640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f61880a0220 con 0x7f61881488a0 2024-09-15T22:35:25.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.457+0000 7f618e665640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f61880bbcd0 con 0x7f618809fe40 2024-09-15T22:35:25.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.457+0000 7f618e665640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6188147dc0 con 0x7f6188145120 2024-09-15T22:35:25.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.457+0000 7f617ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61881488a0 0x7f6188144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:25.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.457+0000 7f617ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61881488a0 0x7f6188144be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33374/0 (socket says 172.21.15.78:33374) 2024-09-15T22:35:25.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.457+0000 7f617ffff640 1 -- 172.21.15.78:0/3262290299 learned_addr learned my addr 172.21.15.78:0/3262290299 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:35:25.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.457+0000 7f617ffff640 1 -- 172.21.15.78:0/3262290299 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6188145120 msgr2=0x7f618814b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:25.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.457+0000 7f617ffff640 1 --2- 172.21.15.78:0/3262290299 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6188145120 0x7f618814b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.457+0000 7f617ffff640 1 -- 172.21.15.78:0/3262290299 >> v2:172.21.15.175:3300/0 conn(0x7f618809fe40 msgr2=0x7f618809bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:25.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.457+0000 7f6187fff640 1 --2- 172.21.15.78:0/3262290299 >> v2:172.21.15.175:3300/0 conn(0x7f618809fe40 0x7f618809bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:25.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.457+0000 7f617ffff640 1 --2- 172.21.15.78:0/3262290299 >> v2:172.21.15.175:3300/0 conn(0x7f618809fe40 0x7f618809bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.457+0000 7f617ffff640 1 -- 172.21.15.78:0/3262290299 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61881480a0 con 0x7f61881488a0 2024-09-15T22:35:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.458+0000 7f617ffff640 1 --2- 172.21.15.78:0/3262290299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61881488a0 0x7f6188144be0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f61880be9f0 tx=0x7f617002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff10a3ff3ec0881 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.458+0000 7f61877fe640 1 -- 172.21.15.78:0/3262290299 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170037070 con 0x7f61881488a0 2024-09-15T22:35:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.458+0000 7f61877fe640 1 -- 172.21.15.78:0/3262290299 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6170032440 con 0x7f61881488a0 2024-09-15T22:35:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.458+0000 7f61877fe640 1 -- 172.21.15.78:0/3262290299 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170032830 con 0x7f61881488a0 2024-09-15T22:35:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.459+0000 7f618e665640 1 -- 172.21.15.78:0/3262290299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61881488a0 msgr2=0x7f6188144be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.459+0000 7f618e665640 1 --2- 172.21.15.78:0/3262290299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61881488a0 0x7f6188144be0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f61880be9f0 tx=0x7f617002a140 comp rx=0 tx=0).stop 2024-09-15T22:35:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.459+0000 7f618e665640 1 -- 172.21.15.78:0/3262290299 shutdown_connections 2024-09-15T22:35:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.459+0000 7f618e665640 1 --2- 172.21.15.78:0/3262290299 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6188145120 0x7f618814b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.459+0000 7f618e665640 1 --2- 172.21.15.78:0/3262290299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61881488a0 0x7f6188144be0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.459+0000 7f618e665640 1 --2- 172.21.15.78:0/3262290299 >> v2:172.21.15.175:3300/0 conn(0x7f618809fe40 0x7f618809bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.459+0000 7f618e665640 1 -- 172.21.15.78:0/3262290299 >> 172.21.15.78:0/3262290299 conn(0x7f61880bdd70 msgr2=0x7f61880be180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.459+0000 7f618e665640 1 -- 172.21.15.78:0/3262290299 shutdown_connections 2024-09-15T22:35:25.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.459+0000 7f618e665640 1 -- 172.21.15.78:0/3262290299 wait complete. 2024-09-15T22:35:25.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.460+0000 7f618e665640 1 Processor -- start 2024-09-15T22:35:25.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.460+0000 7f618e665640 1 -- start start 2024-09-15T22:35:25.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f618e665640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f618809fe40 0x7f61880badb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:25.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f618e665640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6188145120 0x7f618814b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:25.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f618e665640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61881488a0 0x7f618814bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:25.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f618e665640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f61881455d0 con 0x7f6188145120 2024-09-15T22:35:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f618e665640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f618809c1e0 con 0x7f618809fe40 2024-09-15T22:35:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f618e665640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f61880bb950 con 0x7f61881488a0 2024-09-15T22:35:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f617ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6188145120 0x7f618814b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f617ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6188145120 0x7f618814b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33390/0 (socket says 172.21.15.78:33390) 2024-09-15T22:35:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f617ffff640 1 -- 172.21.15.78:0/4157516211 learned_addr learned my addr 172.21.15.78:0/4157516211 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-15T22:35:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f6187fff640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f618809fe40 0x7f61880badb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f618cc02640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61881488a0 0x7f618814bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f617ffff640 1 -- 172.21.15.78:0/4157516211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61881488a0 msgr2=0x7f618814bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f617ffff640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61881488a0 0x7f618814bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f617ffff640 1 -- 172.21.15.78:0/4157516211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f618809fe40 msgr2=0x7f61880badb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f617ffff640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f618809fe40 0x7f61880badb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f617ffff640 1 -- 172.21.15.78:0/4157516211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618814b000 con 0x7f6188145120 2024-09-15T22:35:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f618cc02640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61881488a0 0x7f618814bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:35:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f6187fff640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f618809fe40 0x7f61880badb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:35:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f617ffff640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6188145120 0x7f618814b620 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f617002a180 tx=0x7f61700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f61857fa640 1 -- 172.21.15.78:0/4157516211 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170037040 con 0x7f6188145120 2024-09-15T22:35:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f61857fa640 1 -- 172.21.15.78:0/4157516211 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6170042070 con 0x7f6188145120 2024-09-15T22:35:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f618e665640 1 -- 172.21.15.78:0/4157516211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61881497b0 con 0x7f6188145120 2024-09-15T22:35:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f61857fa640 1 -- 172.21.15.78:0/4157516211 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170030bf0 con 0x7f6188145120 2024-09-15T22:35:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.461+0000 7f618e665640 1 -- 172.21.15.78:0/4157516211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618814ad20 con 0x7f6188145120 2024-09-15T22:35:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.462+0000 7f618e665640 1 -- 172.21.15.78:0/4157516211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618806d0f0 con 0x7f6188145120 2024-09-15T22:35:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.463+0000 7f61857fa640 1 -- 172.21.15.78:0/4157516211 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6170047460 con 0x7f6188145120 2024-09-15T22:35:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.463+0000 7f61857fa640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f616806c2b0 0x7f616806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.463+0000 7f61857fa640 1 -- 172.21.15.78:0/4157516211 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7f61700ac010 con 0x7f6188145120 2024-09-15T22:35:25.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.463+0000 7f6187fff640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f616806c2b0 0x7f616806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:25.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.464+0000 7f6187fff640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f616806c2b0 0x7f616806e770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f61881da9d0 tx=0x7f6178008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:25.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.468+0000 7f61857fa640 1 -- 172.21.15.78:0/4157516211 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6170045360 con 0x7f6188145120 2024-09-15T22:35:25.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:25.666+0000 7f618e665640 1 -- 172.21.15.78:0/4157516211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6188149560 con 0x7f6188145120 2024-09-15T22:35:26.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:26.327+0000 7f61857fa640 1 -- 172.21.15.78:0/4157516211 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f617007a6f0 con 0x7f6188145120 2024-09-15T22:35:26.329 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data_ec' removed 2024-09-15T22:35:26.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:26.331+0000 7f618e665640 1 -- 172.21.15.78:0/4157516211 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f616806c2b0 msgr2=0x7f616806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:26.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:26.331+0000 7f618e665640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f616806c2b0 0x7f616806e770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f61881da9d0 tx=0x7f6178008040 comp rx=0 tx=0).stop 2024-09-15T22:35:26.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:26.331+0000 7f618e665640 1 -- 172.21.15.78:0/4157516211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6188145120 msgr2=0x7f618814b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:26.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:26.331+0000 7f618e665640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6188145120 0x7f618814b620 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f617002a180 tx=0x7f61700046c0 comp rx=0 tx=0).stop 2024-09-15T22:35:26.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:26.331+0000 7f618e665640 1 -- 172.21.15.78:0/4157516211 shutdown_connections 2024-09-15T22:35:26.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:26.331+0000 7f618e665640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.78:6832/3668002812,v1:172.21.15.78:6833/3668002812] conn(0x7f616806c2b0 0x7f616806e770 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f61881da9d0 tx=0x7f6178008040 comp rx=0 tx=0).stop 2024-09-15T22:35:26.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:26.331+0000 7f618e665640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61881488a0 0x7f618814bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:26.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:26.331+0000 7f618e665640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6188145120 0x7f618814b620 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:26.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:26.331+0000 7f618e665640 1 --2- 172.21.15.78:0/4157516211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f618809fe40 0x7f61880badb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:26.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:26.331+0000 7f618e665640 1 -- 172.21.15.78:0/4157516211 >> 172.21.15.78:0/4157516211 conn(0x7f61880bdd70 msgr2=0x7f61880bc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:26.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:26.332+0000 7f618e665640 1 -- 172.21.15.78:0/4157516211 shutdown_connections 2024-09-15T22:35:26.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-15T22:35:26.332+0000 7f618e665640 1 -- 172.21.15.78:0/4157516211 wait complete. 2024-09-15T22:35:26.353 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-15T22:35:26.354 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:35:26.354 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:35:26.366 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:35:26.366 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:35:26.366 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:35:26.380 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:35:26.380 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-15T22:35:26.380 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-15T22:35:26.380 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:35:26.456 INFO:tasks.ceph.osd.0:Stopped 2024-09-15T22:35:26.456 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-15T22:35:26.456 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:35:26.531 INFO:tasks.ceph.osd.1:Stopped 2024-09-15T22:35:26.531 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-15T22:35:26.531 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:35:26.590 INFO:tasks.ceph.osd.2:Stopped 2024-09-15T22:35:26.591 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-15T22:35:26.591 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:35:26.661 INFO:tasks.ceph.osd.3:Stopped 2024-09-15T22:35:26.661 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-15T22:35:26.661 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:35:26.726 INFO:tasks.ceph.osd.4:Stopped 2024-09-15T22:35:26.727 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-15T22:35:26.727 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:35:26.798 INFO:tasks.ceph.osd.5:Stopped 2024-09-15T22:35:26.798 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-15T22:35:26.798 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:35:26.861 INFO:tasks.ceph.osd.6:Stopped 2024-09-15T22:35:26.862 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-15T22:35:26.862 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:35:26.925 INFO:tasks.ceph.osd.7:Stopped 2024-09-15T22:35:26.925 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-15T22:35:26.925 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-15T22:35:26.925 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:35:26.953 INFO:tasks.ceph.mgr.y:Stopped 2024-09-15T22:35:26.954 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-15T22:35:26.954 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:35:26.981 INFO:tasks.ceph.mgr.x:Stopped 2024-09-15T22:35:26.981 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-15T22:35:26.981 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-15T22:35:26.981 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:35:27.006 INFO:tasks.ceph.mon.a:Stopped 2024-09-15T22:35:27.006 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-15T22:35:27.006 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:35:27.032 INFO:tasks.ceph.mon.b:Stopped 2024-09-15T22:35:27.033 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-15T22:35:27.033 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:35:27.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-15T22:35:27.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-15T22:35:27.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-15T22:35:27.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-15T22:35:27.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-15T22:35:27.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-15T22:35:27.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-15T22:35:27.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-15T22:35:27.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-15T22:35:27.085 INFO:tasks.ceph.mon.c:Stopped 2024-09-15T22:35:27.085 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-15T22:35:27.086 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-15T22:35:27.167 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-15T22:35:27.167 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-15T22:35:27.777 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-15T22:35:27.777 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-15T22:35:27.949 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-15T22:35:27.950 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-15T22:35:28.005 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-15T22:35:28.005 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-15T22:35:28.096 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-15T22:35:28.096 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-15T22:35:28.934 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-15T22:35:28.934 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-15T22:35:29.053 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-15T22:35:29.053 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-15T22:35:29.127 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-15T22:35:29.127 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-15T22:35:29.217 INFO:tasks.ceph:Archiving mon data... 2024-09-15T22:35:29.218 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906235/data/mon.a.tgz 2024-09-15T22:35:29.218 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-15T22:35:29.246 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.YOSkzWIPeJ 2024-09-15T22:35:29.246 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.YOSkzWIPeJ 2024-09-15T22:35:29.383 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.YOSkzWIPeJ 2024-09-15T22:35:29.481 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.YOSkzWIPeJ is 320KB 2024-09-15T22:35:29.575 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.YOSkzWIPeJ 2024-09-15T22:35:29.591 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906235/data/mon.b.tgz 2024-09-15T22:35:29.591 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-09-15T22:35:29.612 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.7lbNYy4xdm 2024-09-15T22:35:29.613 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7lbNYy4xdm 2024-09-15T22:35:29.750 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.7lbNYy4xdm 2024-09-15T22:35:29.893 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.7lbNYy4xdm is 329KB 2024-09-15T22:35:29.987 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.7lbNYy4xdm 2024-09-15T22:35:30.003 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906235/data/mon.c.tgz 2024-09-15T22:35:30.003 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-09-15T22:35:30.057 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.52bwQQ9y4q 2024-09-15T22:35:30.058 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.52bwQQ9y4q 2024-09-15T22:35:30.183 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.52bwQQ9y4q 2024-09-15T22:35:30.266 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.52bwQQ9y4q is 329KB 2024-09-15T22:35:30.361 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.52bwQQ9y4q 2024-09-15T22:35:30.376 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-15T22:35:30.376 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T22:35:30.380 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T22:35:30.484 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T22:35:30.499 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T22:35:30.499 INFO:tasks.ceph:Archiving crash dumps... 2024-09-15T22:35:30.501 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906235/remote/smithi078/crash 2024-09-15T22:35:30.502 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T22:35:30.551 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906235/remote/smithi175/crash 2024-09-15T22:35:30.552 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T22:35:30.577 INFO:tasks.ceph:Shutting down logrotate 2024-09-15T22:35:30.577 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:35:30.596 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:35:30.671 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-15T22:35:30.697 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-15T22:35:30.722 INFO:tasks.ceph:Compressing logs... 2024-09-15T22:35:30.722 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:35:30.740 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:35:30.766 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-15T22:35:30.786 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41835.log 2024-09-15T22:35:30.786 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42563.log 2024-09-15T22:35:30.786 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43838.log 2024-09-15T22:35:30.786 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46858.log 2024-09-15T22:35:30.788 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43107.log 2024-09-15T22:35:30.788 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.43838.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41835.log.gz 2024-09-15T22:35:30.788 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.46858.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42560.log 2024-09-15T22:35:30.788 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46564.log 2024-09-15T22:35:30.788 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46858.log.gz 2024-09-15T22:35:30.788 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42571.log 2024-09-15T22:35:30.788 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41548.log 2024-09-15T22:35:30.788 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42571.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46564.log.gz 2024-09-15T22:35:30.788 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47570.log 2024-09-15T22:35:30.788 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47320.log 2024-09-15T22:35:30.788 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42573.log 2024-09-15T22:35:30.788 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43233.log 2024-09-15T22:35:30.789 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42771.log 2024-09-15T22:35:30.789 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-15T22:35:30.789 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47570.log: /var/log/ceph/ceph-client.admin.47320.log: /var/log/ceph/ceph-client.admin.42573.log: /var/log/ceph/ceph-client.admin.43233.log: /var/log/ceph/ceph-client.admin.42771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47068.log 2024-09-15T22:35:30.789 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47320.log.gz 2024-09-15T22:35:30.789 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47570.log.gz 2024-09-15T22:35:30.789 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47110.log 2024-09-15T22:35:30.789 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40557.log 2024-09-15T22:35:30.789 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47068.log.gz 2024-09-15T22:35:30.789 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40725.log 2024-09-15T22:35:30.789 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47110.log.gz/var/log/ceph/ceph-client.admin.40557.log: 2024-09-15T22:35:30.789 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35964.log 2024-09-15T22:35:30.789 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41751.log 2024-09-15T22:35:30.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47528.log 2024-09-15T22:35:30.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42570.log 2024-09-15T22:35:30.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47404.log 2024-09-15T22:35:30.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42570.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47528.log.gz 2024-09-15T22:35:30.790 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43446.log 2024-09-15T22:35:30.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46732.log 2024-09-15T22:35:30.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43446.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47404.log.gz 2024-09-15T22:35:30.790 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40325.log 2024-09-15T22:35:30.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40767.log 2024-09-15T22:35:30.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40325.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46732.log.gz 2024-09-15T22:35:30.790 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40135.log 2024-09-15T22:35:30.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47362.log 2024-09-15T22:35:30.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47780.log 2024-09-15T22:35:30.791 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42219.log 2024-09-15T22:35:30.791 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47362.log.gz 2024-09-15T22:35:30.791 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47780.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30123.log 2024-09-15T22:35:30.791 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47780.log.gz 2024-09-15T22:35:30.791 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40599.log 2024-09-15T22:35:30.791 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.tmp-client.admin.30123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41301.log 2024-09-15T22:35:30.791 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30123.log.gz 2024-09-15T22:35:30.791 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40239.log 2024-09-15T22:35:30.791 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41961.log 2024-09-15T22:35:30.791 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42049.log 2024-09-15T22:35:30.791 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46322.log 2024-09-15T22:35:30.791 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47654.log 2024-09-15T22:35:30.791 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46322.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T22:35:30.792 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47654.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46322.log.gz 2024-09-15T22:35:30.792 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42230.log 2024-09-15T22:35:30.792 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47654.log.gz 2024-09-15T22:35:30.792 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43065.log 2024-09-15T22:35:30.792 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40429.log 2024-09-15T22:35:30.792 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42004.log 2024-09-15T22:35:30.792 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40683.log 2024-09-15T22:35:30.792 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47696.log 2024-09-15T22:35:30.792 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47026.log 2024-09-15T22:35:30.792 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36227.log 2024-09-15T22:35:30.792 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47026.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47696.log.gz 2024-09-15T22:35:30.792 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47194.log 2024-09-15T22:35:30.792 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47026.log.gz 2024-09-15T22:35:30.792 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40641.log 2024-09-15T22:35:30.793 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46606.log 2024-09-15T22:35:30.793 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47194.log.gz 2024-09-15T22:35:30.793 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40197.log 2024-09-15T22:35:30.793 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47612.log 2024-09-15T22:35:30.793 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40197.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46606.log.gz 2024-09-15T22:35:30.793 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42572.log 2024-09-15T22:35:30.793 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41919.log 2024-09-15T22:35:30.793 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42572.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47612.log.gz 2024-09-15T22:35:30.793 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46816.log 2024-09-15T22:35:30.793 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42563.log.gz 2024-09-15T22:35:30.793 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42897.log 2024-09-15T22:35:30.793 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.46816.log: -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-15T22:35:30.793 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42560.log.gz 2024-09-15T22:35:30.793 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42571.log.gz 2024-09-15T22:35:30.794 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41625.log 2024-09-15T22:35:30.794 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46816.log.gz 2024-09-15T22:35:30.794 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43275.log 2024-09-15T22:35:30.794 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40387.log 2024-09-15T22:35:30.794 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43107.log.gz 2024-09-15T22:35:30.794 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42917.log 2024-09-15T22:35:30.794 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41490.log 2024-09-15T22:35:30.794 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46900.log 2024-09-15T22:35:30.794 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46690.log 2024-09-15T22:35:30.794 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46942.log 2024-09-15T22:35:30.794 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46514.log 2024-09-15T22:35:30.794 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46900.log.gz 2024-09-15T22:35:30.794 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46942.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46690.log.gz 2024-09-15T22:35:30.794 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47236.log 2024-09-15T22:35:30.795 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46942.log.gz 2024-09-15T22:35:30.795 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46514.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-15T22:35:30.795 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47236.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46514.log.gz 2024-09-15T22:35:30.795 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42791.log 2024-09-15T22:35:30.795 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47236.log.gz 2024-09-15T22:35:30.795 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-15T22:35:30.795 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42228.log 2024-09-15T22:35:30.795 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47738.log 2024-09-15T22:35:30.795 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47278.log 2024-09-15T22:35:30.795 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40809.log 2024-09-15T22:35:30.805 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36242.log 2024-09-15T22:35:30.805 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-15T22:35:30.805 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36413.log 2024-09-15T22:35:30.805 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-15T22:35:30.805 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36324.log 2024-09-15T22:35:30.805 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-15T22:35:30.806 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36324.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T22:35:30.806 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36373.log 2024-09-15T22:35:30.806 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-15T22:35:30.806 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36162.log 2024-09-15T22:35:30.806 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36122.log 2024-09-15T22:35:30.806 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36162.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-15T22:35:30.806 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36122.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-15T22:35:30.806 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T22:35:30.806 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-15T22:35:30.806 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-15T22:35:30.806 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36202.log 2024-09-15T22:35:30.806 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36282.log 2024-09-15T22:35:30.808 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36202.log: /var/log/ceph/ceph-client.admin.36282.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36242.log.gz 2024-09-15T22:35:30.811 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47278.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47738.log.gz 2024-09-15T22:35:30.811 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43149.log 2024-09-15T22:35:30.811 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47278.log.gz 2024-09-15T22:35:30.811 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41667.log 2024-09-15T22:35:30.811 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36319.log 2024-09-15T22:35:30.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47152.log 2024-09-15T22:35:30.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41793.log 2024-09-15T22:35:30.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47152.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-15T22:35:30.812 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47152.log.gz 2024-09-15T22:35:30.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40058.log 2024-09-15T22:35:30.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42236.log 2024-09-15T22:35:30.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46380.log 2024-09-15T22:35:30.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42236.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T22:35:30.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42574.log 2024-09-15T22:35:30.812 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46380.log.gz 2024-09-15T22:35:30.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41877.log 2024-09-15T22:35:30.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40875.log 2024-09-15T22:35:30.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46648.log 2024-09-15T22:35:30.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42958.log 2024-09-15T22:35:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42833.log 2024-09-15T22:35:30.813 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8%/var/log/ceph/ceph-client.admin.42958.log: -- replaced with /var/log/ceph/ceph-client.admin.46648.log.gz 2024-09-15T22:35:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42566.log 2024-09-15T22:35:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39966.log 2024-09-15T22:35:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42833.log: /var/log/ceph/ceph-client.admin.42566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47486.log 2024-09-15T22:35:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43191.log 2024-09-15T22:35:30.813 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T22:35:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42235.log 2024-09-15T22:35:30.813 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47486.log.gz 2024-09-15T22:35:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43023.log 2024-09-15T22:35:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41709.log 2024-09-15T22:35:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47444.log 2024-09-15T22:35:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42237.log 2024-09-15T22:35:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40281.log 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40515.log 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47444.log.gz 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46774.log 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42238.log 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46984.log 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40471.log 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46774.log.gz 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46984.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40471.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.46984.log.gz -5 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43317.log 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42232.log 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43317.log: /var/log/ceph/ceph-client.admin.42232.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41548.log.gz 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42566.log.gz 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42572.log.gz 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42573.log.gz 2024-09-15T22:35:30.814 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42570.log.gz 2024-09-15T22:35:30.816 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36282.log.gz 2024-09-15T22:35:30.816 INFO:teuthology.orchestra.run.smithi175.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36122.log.gz 2024-09-15T22:35:30.816 INFO:teuthology.orchestra.run.smithi175.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36162.log.gz 2024-09-15T22:35:30.816 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36202.log.gz 2024-09-15T22:35:30.816 INFO:teuthology.orchestra.run.smithi175.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36413.log.gz 2024-09-15T22:35:30.818 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39966.log.gz 2024-09-15T22:35:30.818 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42833.log.gz 2024-09-15T22:35:30.818 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42574.log.gz -- replaced with /var/log/ceph/ceph-client.admin.42791.log.gz 2024-09-15T22:35:30.818 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-15T22:35:30.818 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42958.log.gz -- replaced with /var/log/ceph/ceph-client.admin.42917.log.gz 2024-09-15T22:35:30.818 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-15T22:35:30.818 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42897.log.gz 2024-09-15T22:35:30.818 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43023.log.gz 2024-09-15T22:35:30.818 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42771.log.gz 2024-09-15T22:35:30.818 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43065.log.gz 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43149.log.gz 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43446.log.gz -- replaced with /var/log/ceph/ceph-client.admin.43275.log.gz 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43191.log.gz 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43233.log.gz 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.43317.log.gz 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41751.log.gz 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41793.log.gz 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42049.log.gz 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41961.log.gz -- replaced with /var/log/ceph/ceph-client.admin.41877.log.gz 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42004.log.gz 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41919.log.gz 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40725.log.gz 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40767.log.gz 2024-09-15T22:35:30.819 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40683.log.gz 2024-09-15T22:35:30.820 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40599.log.gz 2024-09-15T22:35:30.820 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40875.log.gz 2024-09-15T22:35:30.820 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40641.log.gz 2024-09-15T22:35:30.820 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.40809.log.gz 2024-09-15T22:35:30.820 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41490.log.gz 2024-09-15T22:35:30.820 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36227.log.gz 2024-09-15T22:35:30.822 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36319.log.gz 2024-09-15T22:35:30.824 INFO:teuthology.orchestra.run.smithi175.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T22:35:30.830 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40197.log.gz 2024-09-15T22:35:30.830 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40058.log.gz -- replaced with /var/log/ceph/ceph-client.admin.40387.log.gz 2024-09-15T22:35:30.830 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-15T22:35:30.830 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40135.log.gz -- replaced with /var/log/ceph/ceph-client.admin.40281.log.gz 2024-09-15T22:35:30.830 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-15T22:35:30.830 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40239.log.gz -- replaced with /var/log/ceph/ceph-client.admin.40325.log.gz 2024-09-15T22:35:30.830 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-15T22:35:30.848 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35964.log.gz 2024-09-15T22:35:30.856 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% 88.0% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40429.log.gz -- replaced with /var/log/ceph/ceph-client.admin.42228.log.gz 2024-09-15T22:35:30.857 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-15T22:35:30.857 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42237.log.gz 2024-09-15T22:35:30.857 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40471.log.gz 2024-09-15T22:35:30.857 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42219.log.gz -- replaced with /var/log/ceph/ceph-client.admin.42238.log.gz 2024-09-15T22:35:30.857 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-15T22:35:30.857 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40515.log.gz 2024-09-15T22:35:30.857 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40557.log.gz 2024-09-15T22:35:30.857 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42235.log.gz 2024-09-15T22:35:30.857 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42230.log.gz 2024-09-15T22:35:30.857 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42236.log.gz 2024-09-15T22:35:30.857 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42232.log.gz 2024-09-15T22:35:30.863 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41709.log.gz 2024-09-15T22:35:30.864 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41667.log.gz 2024-09-15T22:35:30.864 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41625.log.gz 2024-09-15T22:35:30.864 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T22:35:30.884 INFO:teuthology.orchestra.run.smithi078.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.41301.log.gz 2024-09-15T22:35:30.887 INFO:teuthology.orchestra.run.smithi078.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-15T22:35:31.758 INFO:teuthology.orchestra.run.smithi175.stderr: 93.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T22:35:32.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-15T22:35:32.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-15T22:35:32.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-15T22:35:32.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-15T22:35:32.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-15T22:35:32.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-15T22:35:32.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-15T22:35:32.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-15T22:35:32.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-15T22:35:32.311 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36324.log.gz 2024-09-15T22:35:32.312 INFO:teuthology.orchestra.run.smithi175.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36373.log.gz 2024-09-15T22:35:32.742 INFO:teuthology.orchestra.run.smithi175.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-15T22:35:37.382 INFO:teuthology.orchestra.run.smithi078.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-15T22:35:37.922 INFO:teuthology.orchestra.run.smithi175.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-15T22:35:39.557 INFO:teuthology.orchestra.run.smithi175.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-15T22:36:01.679 INFO:teuthology.orchestra.run.smithi078.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-15T22:36:20.707 INFO:teuthology.orchestra.run.smithi175.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-15T22:38:01.179 INFO:teuthology.orchestra.run.smithi175.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-15T22:38:18.127 INFO:teuthology.orchestra.run.smithi175.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-15T22:38:50.654 INFO:teuthology.orchestra.run.smithi175.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-15T22:39:01.361 INFO:teuthology.orchestra.run.smithi175.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-15T22:39:01.361 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-09-15T22:39:01.361 INFO:teuthology.orchestra.run.smithi175.stderr:real 3m30.584s 2024-09-15T22:39:01.361 INFO:teuthology.orchestra.run.smithi175.stderr:user 3m16.501s 2024-09-15T22:39:01.361 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m7.846s 2024-09-15T22:39:35.575 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-15T22:40:40.687 INFO:teuthology.orchestra.run.smithi078.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-15T22:42:15.189 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-15T22:42:29.785 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-15T22:48:24.272 INFO:teuthology.orchestra.run.smithi078.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.43838.log.gz 2024-09-15T22:48:24.300 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-15T22:48:24.300 INFO:teuthology.orchestra.run.smithi078.stderr:real 12m53.521s 2024-09-15T22:48:24.300 INFO:teuthology.orchestra.run.smithi078.stderr:user 8m30.831s 2024-09-15T22:48:24.301 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m22.058s 2024-09-15T22:48:24.301 INFO:tasks.ceph:Archiving logs... 2024-09-15T22:48:24.302 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906235/remote/smithi078/log 2024-09-15T22:48:24.303 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:49:51.633 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906235/remote/smithi175/log 2024-09-15T22:49:51.634 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:51:29.847 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T22:51:29.860 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T22:51:29.861 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:51:29.864 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:51:29.991 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T22:51:30.001 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T22:51:30.002 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:51:30.005 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:51:30.019 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:51:30.022 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:51:30.050 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:51:30.050 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-09-15T22:51:30.050 INFO:teuthology.orchestra.run.smithi078.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 +1136us[+1114us] +/- 57ms 2024-09-15T22:51:30.050 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 35 -994us[ -994us] +/- 55ms 2024-09-15T22:51:30.050 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -133us[ -133us] +/- 79ms 2024-09-15T22:51:30.050 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:51:30.071 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:51:30.071 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-09-15T22:51:30.071 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv01.front.sepia.ceph.com 3 6 377 38 +1141us[+1136us] +/- 57ms 2024-09-15T22:51:30.071 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 -1008us[-1013us] +/- 55ms 2024-09-15T22:51:30.071 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 -121us[ -125us] +/- 79ms 2024-09-15T22:51:30.072 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:51:30.072 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T22:51:30.082 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T22:51:30.083 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T22:51:30.120 DEBUG:teuthology.orchestra.run.smithi078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:51:30.226 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:51:30.314 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:51:30.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:51:30.345 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:51:30.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:51:30.375 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T22:51:30.385 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T22:51:30.395 INFO:teuthology.task.internal:Duration was 2917.594861 seconds 2024-09-15T22:51:30.395 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T22:51:30.405 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T22:51:30.405 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:51:30.408 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:51:30.466 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:51:30.512 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:51:30.870 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T22:51:30.870 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2024-09-15T22:51:30.870 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:51:30.897 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-09-15T22:51:30.898 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:51:30.931 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T22:51:30.932 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:51:30.941 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:51:31.000 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T22:51:31.000 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:51:31.017 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:51:31.163 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T22:51:31.176 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T22:51:31.176 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:51:31.202 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:51:31.256 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T22:51:31.268 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:51:31.271 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:51:31.300 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-09-15T22:51:31.347 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2024-09-15T22:51:31.364 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:51:31.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:51:31.379 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:51:31.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:51:31.397 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T22:51:31.408 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T22:51:31.409 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906235/remote/smithi078 2024-09-15T22:51:31.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:51:31.455 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906235/remote/smithi175 2024-09-15T22:51:31.455 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:51:31.494 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T22:51:31.494 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:51:31.497 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:51:31.539 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T22:51:31.550 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T22:51:31.550 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T22:51:31.562 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T22:51:31.563 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:51:31.565 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:51:31.578 INFO:teuthology.orchestra.run.smithi078.stdout: 265818 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:51 /home/ubuntu/cephtest 2024-09-15T22:51:31.594 INFO:teuthology.orchestra.run.smithi175.stdout: 265852 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:51 /home/ubuntu/cephtest 2024-09-15T22:51:31.595 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T22:51:31.606 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T22:51:31.629 INFO:teuthology.run:Summary data: description: fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_dbench traceless/50pc} duration: 2917.5948605537415 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-15T22:51:31.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T22:51:31.704 INFO:teuthology.run:pass